2024-09-20T20:47:17.371 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-20T20:47:17.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T20:47:17.479 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7912591' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ed8ee0f26ef720e6504cefa8be1a2d0872192de7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 8245 sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 sleep_before_teardown: 0 subset: 3/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ed8ee0f26ef720e6504cefa8be1a2d0872192de7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ed8ee0f26ef720e6504cefa8be1a2d0872192de7 targets: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBnuWX41arIUNYpjKuEOHDCpfkYg1pWFNvdaWnaUha71E2ok3odGMGUgfKtvzTB8spgmQfXO9a28M1jYAxWZw4w= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMonTRw5qRu0szQLKxrt31wrjDdKiqw2AK5XqdwewrvfPP3pu5O96y9yvUFw4ejgEb4atKcnedHaeXSNMV7V0M8= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9uZZwQfOCWU4I6SXe8EwJqjdSKI/VeibC3NTyroiVu6CNaYBb4wCqxg2Bm40jDi2SG+xckkstzcIzSUV1z354= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDK39ftOs8qbeP57ncCklKXMRUh5yZA6gtj7NBZgkYm0EpmwYz4F4E0Ks46XM/23755edz2/bb5KutmQ4ArEm4g= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-19_21:32:06 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-20T20:47:17.479 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ed8ee0f26ef720e6504cefa8be1a2d0872192de7/qa; will attempt to use it 2024-09-20T20:47:17.480 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ed8ee0f26ef720e6504cefa8be1a2d0872192de7/qa/tasks 2024-09-20T20:47:17.480 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-20T20:47:17.482 INFO:teuthology.task.internal:Checking packages... 2024-09-20T20:47:17.503 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9e2ac70bb7aea67d34f0d50002344abbe7803736' 2024-09-20T20:47:17.503 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T20:47:17.503 INFO:teuthology.packaging:ref: None 2024-09-20T20:47:17.503 INFO:teuthology.packaging:tag: None 2024-09-20T20:47:17.503 INFO:teuthology.packaging:branch: squid 2024-09-20T20:47:17.503 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:47:17.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-20T20:47:17.734 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:47:17.736 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-20T20:47:17.742 INFO:teuthology.task.internal:no buildpackages task found 2024-09-20T20:47:17.743 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-20T20:47:17.751 INFO:teuthology.task.internal:Saving configuration 2024-09-20T20:47:17.763 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-20T20:47:17.770 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-20T20:47:17.795 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 20:41:31.445489', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOkoxCyBybZ64RXE4wU7vIHni8MiZmPE2AAfXr7MLbi7'} 2024-09-20T20:47:17.819 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 20:41:31.441572', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIVT3VkciKYCwgwcWBWGo1mp59rGOjkZ/YeeFZDiXLVB'} 2024-09-20T20:47:17.844 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 20:41:31.444106', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIFrjz3KChzmjD4pAK+7EdgDOa6D1i3ohiUytoL56Xic'} 2024-09-20T20:47:17.866 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 20:41:31.442943', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAUYhT4W4uEFGykWp8KvVMefmKkEMa9iJJmyJnBXE3lj'} 2024-09-20T20:47:17.866 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-20T20:47:17.872 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-20T20:47:17.872 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['osd.0'] 2024-09-20T20:47:17.872 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['osd.1'] 2024-09-20T20:47:17.873 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['osd.2'] 2024-09-20T20:47:17.873 INFO:teuthology.run_tasks:Running task console_log... 2024-09-20T20:47:18.062 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7d21feb490>, signals=[15]) 2024-09-20T20:47:18.063 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-20T20:47:18.069 INFO:teuthology.task.internal:Opening connections... 2024-09-20T20:47:18.069 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-20T20:47:18.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:47:18.147 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-09-20T20:47:18.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:47:18.226 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-09-20T20:47:18.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:47:18.306 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-09-20T20:47:18.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:47:18.383 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-20T20:47:18.397 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-20T20:47:18.403 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-20T20:47:18.403 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-20T20:47:18.452 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T20:47:18.452 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Ubuntu" 2024-09-20T20:47:18.452 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="22.04" 2024-09-20T20:47:18.452 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T20:47:18.452 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_CODENAME=jammy 2024-09-20T20:47:18.453 INFO:teuthology.orchestra.run.smithi112.stdout:ID=ubuntu 2024-09-20T20:47:18.453 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE=debian 2024-09-20T20:47:18.453 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T20:47:18.453 INFO:teuthology.orchestra.run.smithi112.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T20:47:18.453 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T20:47:18.453 INFO:teuthology.orchestra.run.smithi112.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T20:47:18.454 INFO:teuthology.orchestra.run.smithi112.stdout:UBUNTU_CODENAME=jammy 2024-09-20T20:47:18.454 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-20T20:47:18.482 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-09-20T20:47:18.488 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-09-20T20:47:18.488 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-09-20T20:47:18.534 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T20:47:18.534 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2024-09-20T20:47:18.534 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2024-09-20T20:47:18.534 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T20:47:18.534 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2024-09-20T20:47:18.535 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2024-09-20T20:47:18.535 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2024-09-20T20:47:18.535 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T20:47:18.535 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T20:47:18.535 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T20:47:18.535 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T20:47:18.535 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2024-09-20T20:47:18.536 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-09-20T20:47:18.556 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-09-20T20:47:18.561 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-09-20T20:47:18.561 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-09-20T20:47:18.609 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T20:47:18.609 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2024-09-20T20:47:18.609 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2024-09-20T20:47:18.610 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T20:47:18.610 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2024-09-20T20:47:18.610 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2024-09-20T20:47:18.610 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2024-09-20T20:47:18.610 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T20:47:18.610 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T20:47:18.610 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T20:47:18.610 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T20:47:18.610 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2024-09-20T20:47:18.610 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-09-20T20:47:18.631 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-09-20T20:47:18.637 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-09-20T20:47:18.637 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-09-20T20:47:18.684 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T20:47:18.684 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2024-09-20T20:47:18.684 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="22.04" 2024-09-20T20:47:18.684 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T20:47:18.685 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=jammy 2024-09-20T20:47:18.685 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2024-09-20T20:47:18.685 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2024-09-20T20:47:18.685 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T20:47:18.685 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T20:47:18.685 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T20:47:18.685 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T20:47:18.685 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=jammy 2024-09-20T20:47:18.685 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-09-20T20:47:18.706 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-20T20:47:18.715 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-20T20:47:18.753 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-20T20:47:18.753 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-20T20:47:18.755 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-09-20T20:47:18.758 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-09-20T20:47:18.760 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-09-20T20:47:18.765 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-20T20:47:18.771 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-20T20:47:18.771 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-20T20:47:18.805 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-09-20T20:47:18.807 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-09-20T20:47:18.809 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-09-20T20:47:18.821 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-20T20:47:18.923 INFO:teuthology.run_tasks:Running task kernel... 2024-09-20T20:47:18.937 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-20T20:47:18.937 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-20T20:47:18.938 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T20:47:18.938 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T20:47:18.938 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T20:47:18.939 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T20:47:18.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:47:18.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:47:18.944 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-20T20:47:18.944 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-09-20T20:47:18.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:47:18.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:47:18.946 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-09-20T20:47:18.946 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-20T20:47:18.990 INFO:teuthology.orchestra.run.smithi139.stdout:5.15.0-56-generic 2024-09-20T20:47:18.990 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.15.0-56-generic 2024-09-20T20:47:18.990 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get clean 2024-09-20T20:47:18.992 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-56-generic 2024-09-20T20:47:18.992 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.15.0-56-generic 2024-09-20T20:47:18.992 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-20T20:47:18.993 INFO:teuthology.orchestra.run.smithi203.stdout:5.15.0-56-generic 2024-09-20T20:47:18.993 INFO:teuthology.task.kernel:Running kernel on smithi203: 5.15.0-56-generic 2024-09-20T20:47:18.993 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get clean 2024-09-20T20:47:18.994 INFO:teuthology.orchestra.run.smithi161.stdout:5.15.0-56-generic 2024-09-20T20:47:18.995 INFO:teuthology.task.kernel:Running kernel on smithi161: 5.15.0-56-generic 2024-09-20T20:47:18.995 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2024-09-20T20:47:19.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-20T20:47:19.123 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-09-20T20:47:19.127 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get update 2024-09-20T20:47:19.137 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-09-20T20:47:19.244 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:47:19.248 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:47:19.259 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T20:47:19.259 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T20:47:19.262 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:47:19.268 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:47:19.269 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T20:47:19.272 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T20:47:19.272 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T20:47:19.294 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T20:47:19.329 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T20:47:19.333 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T20:47:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T20:47:19.362 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T20:47:19.380 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T20:47:19.388 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T20:47:19.472 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T20:47:19.475 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T20:47:19.503 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T20:47:19.507 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T20:47:19.537 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T20:47:19.540 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T20:47:19.545 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T20:47:19.570 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T20:47:19.573 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T20:47:19.573 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T20:47:19.574 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T20:47:19.576 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T20:47:19.577 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T20:47:19.578 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T20:47:19.580 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T20:47:19.581 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T20:47:19.581 INFO:teuthology.orchestra.run.smithi203.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T20:47:19.593 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T20:47:19.597 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T20:47:19.597 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T20:47:19.602 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T20:47:19.604 INFO:teuthology.orchestra.run.smithi203.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T20:47:19.608 INFO:teuthology.orchestra.run.smithi203.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T20:47:19.608 INFO:teuthology.orchestra.run.smithi203.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T20:47:19.609 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T20:47:19.610 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T20:47:19.613 INFO:teuthology.orchestra.run.smithi203.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T20:47:19.613 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T20:47:19.613 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T20:47:19.617 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T20:47:19.620 INFO:teuthology.orchestra.run.smithi203.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T20:47:19.621 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T20:47:19.621 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T20:47:19.621 INFO:teuthology.orchestra.run.smithi203.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T20:47:19.622 INFO:teuthology.orchestra.run.smithi203.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T20:47:19.622 INFO:teuthology.orchestra.run.smithi203.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T20:47:19.622 INFO:teuthology.orchestra.run.smithi203.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T20:47:19.633 INFO:teuthology.orchestra.run.smithi203.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T20:47:19.635 INFO:teuthology.orchestra.run.smithi203.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T20:47:19.640 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T20:47:19.641 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T20:47:19.642 INFO:teuthology.orchestra.run.smithi203.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T20:47:19.643 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T20:47:19.643 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T20:47:19.643 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T20:47:19.643 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T20:47:19.643 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T20:47:19.644 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T20:47:19.644 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T20:47:19.645 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T20:47:19.646 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T20:47:19.646 INFO:teuthology.orchestra.run.smithi203.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T20:47:19.647 INFO:teuthology.orchestra.run.smithi203.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T20:47:19.647 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T20:47:19.647 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T20:47:19.650 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T20:47:19.652 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T20:47:19.653 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T20:47:19.654 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T20:47:19.655 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T20:47:19.664 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T20:47:19.665 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T20:47:19.665 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T20:47:19.668 INFO:teuthology.orchestra.run.smithi203.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T20:47:19.668 INFO:teuthology.orchestra.run.smithi203.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T20:47:19.672 INFO:teuthology.orchestra.run.smithi203.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T20:47:19.672 INFO:teuthology.orchestra.run.smithi203.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T20:47:19.679 INFO:teuthology.orchestra.run.smithi203.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T20:47:19.682 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T20:47:19.682 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T20:47:19.683 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T20:47:19.683 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T20:47:19.683 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T20:47:19.684 INFO:teuthology.orchestra.run.smithi203.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T20:47:19.685 INFO:teuthology.orchestra.run.smithi203.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T20:47:19.686 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T20:47:19.686 INFO:teuthology.orchestra.run.smithi203.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T20:47:19.686 INFO:teuthology.orchestra.run.smithi203.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T20:47:19.687 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T20:47:19.687 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T20:47:19.689 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T20:47:19.689 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T20:47:19.690 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T20:47:19.691 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T20:47:19.691 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T20:47:19.700 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T20:47:19.708 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T20:47:19.711 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T20:47:19.712 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T20:47:19.712 INFO:teuthology.orchestra.run.smithi203.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T20:47:19.713 INFO:teuthology.orchestra.run.smithi203.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T20:47:19.713 INFO:teuthology.orchestra.run.smithi203.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T20:47:19.713 INFO:teuthology.orchestra.run.smithi203.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T20:47:19.714 INFO:teuthology.orchestra.run.smithi203.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T20:47:19.714 INFO:teuthology.orchestra.run.smithi203.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T20:47:19.714 INFO:teuthology.orchestra.run.smithi203.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T20:47:19.714 INFO:teuthology.orchestra.run.smithi203.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T20:47:19.718 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T20:47:19.720 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T20:47:19.720 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T20:47:19.721 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T20:47:19.721 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T20:47:19.721 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T20:47:19.722 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T20:47:19.722 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T20:47:19.723 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T20:47:19.723 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T20:47:19.726 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T20:47:19.728 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T20:47:19.728 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T20:47:19.728 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T20:47:19.729 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T20:47:19.729 INFO:teuthology.orchestra.run.smithi203.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T20:47:19.739 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T20:47:19.740 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T20:47:19.741 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T20:47:19.741 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T20:47:19.742 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T20:47:19.743 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T20:47:19.743 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T20:47:19.743 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T20:47:19.743 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T20:47:19.746 INFO:teuthology.orchestra.run.smithi203.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T20:47:19.757 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T20:47:19.758 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T20:47:19.758 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T20:47:19.759 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T20:47:19.759 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T20:47:19.823 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T20:47:19.825 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T20:47:20.111 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T20:47:20.246 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T20:47:20.262 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T20:47:20.271 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T20:47:20.272 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T20:47:20.273 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T20:47:20.285 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T20:47:20.298 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T20:47:20.299 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T20:47:20.370 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T20:47:20.381 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T20:47:20.381 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T20:47:20.384 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T20:47:20.385 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T20:47:20.393 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T20:47:20.394 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T20:47:20.397 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T20:47:20.425 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T20:47:20.426 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T20:47:20.432 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T20:47:20.432 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T20:47:20.433 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T20:47:20.434 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T20:47:20.445 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T20:47:20.451 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T20:47:20.451 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T20:47:20.452 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T20:47:20.508 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T20:47:20.531 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T20:47:20.532 INFO:teuthology.orchestra.run.smithi139.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T20:47:25.910 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 16.3 MB in 2s (7,621 kB/s) 2024-09-20T20:47:26.070 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 16.3 MB in 2s (7,665 kB/s) 2024-09-20T20:47:26.114 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 16.3 MB in 2s (7,473 kB/s) 2024-09-20T20:47:26.303 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 16.3 MB in 2s (7,583 kB/s) 2024-09-20T20:47:27.187 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-20T20:47:27.203 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:47:27.264 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-20T20:47:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-20T20:47:27.445 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-20T20:47:27.451 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-09-20T20:47:27.452 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-09-20T20:47:27.458 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:47:27.464 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:47:27.517 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-20T20:47:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-20T20:47:27.617 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:47:27.617 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:47:27.617 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:47:27.618 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:47:27.618 INFO:teuthology.orchestra.run.smithi161.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T20:47:27.618 INFO:teuthology.orchestra.run.smithi161.stdout: python2.7-minimal 2024-09-20T20:47:27.618 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:47:27.620 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-09-20T20:47:27.620 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:47:27.620 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T20:47:27.620 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T20:47:27.621 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-09-20T20:47:27.621 INFO:teuthology.orchestra.run.smithi161.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T20:47:27.622 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2024-09-20T20:47:27.622 INFO:teuthology.orchestra.run.smithi161.stdout: thermald 2024-09-20T20:47:27.681 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-09-20T20:47:27.681 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:47:27.681 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T20:47:27.682 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T20:47:27.683 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2024-09-20T20:47:27.684 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T20:47:27.706 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-20T20:47:27.707 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-20T20:47:27.735 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2024-09-20T20:47:27.736 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2024-09-20T20:47:27.862 INFO:teuthology.orchestra.run.smithi161.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:47:27.862 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 113 MB of archives. 2024-09-20T20:47:27.862 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T20:47:27.862 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T20:47:27.876 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:47:27.876 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:47:27.877 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:47:27.877 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:47:27.877 INFO:teuthology.orchestra.run.smithi139.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T20:47:27.877 INFO:teuthology.orchestra.run.smithi139.stdout: python2.7-minimal 2024-09-20T20:47:27.877 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:47:27.879 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-09-20T20:47:27.879 INFO:teuthology.orchestra.run.smithi139.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:47:27.879 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T20:47:27.879 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T20:47:27.881 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-09-20T20:47:27.881 INFO:teuthology.orchestra.run.smithi139.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T20:47:27.881 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2024-09-20T20:47:27.881 INFO:teuthology.orchestra.run.smithi139.stdout: thermald 2024-09-20T20:47:27.895 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-20T20:47:27.912 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:47:27.912 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:47:27.912 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:47:27.912 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:47:27.912 INFO:teuthology.orchestra.run.smithi203.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T20:47:27.913 INFO:teuthology.orchestra.run.smithi203.stdout: python2.7-minimal 2024-09-20T20:47:27.913 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:47:27.914 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:47:27.915 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2024-09-20T20:47:27.915 INFO:teuthology.orchestra.run.smithi203.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:47:27.915 INFO:teuthology.orchestra.run.smithi203.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T20:47:27.915 INFO:teuthology.orchestra.run.smithi203.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T20:47:27.916 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2024-09-20T20:47:27.916 INFO:teuthology.orchestra.run.smithi203.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T20:47:27.916 INFO:teuthology.orchestra.run.smithi203.stdout:Recommended packages: 2024-09-20T20:47:27.916 INFO:teuthology.orchestra.run.smithi203.stdout: thermald 2024-09-20T20:47:27.924 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-09-20T20:47:27.924 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:47:27.924 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T20:47:27.924 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T20:47:27.926 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2024-09-20T20:47:27.926 INFO:teuthology.orchestra.run.smithi139.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T20:47:27.965 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2024-09-20T20:47:27.966 INFO:teuthology.orchestra.run.smithi203.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:47:27.966 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T20:47:27.966 INFO:teuthology.orchestra.run.smithi203.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T20:47:27.967 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages will be upgraded: 2024-09-20T20:47:27.968 INFO:teuthology.orchestra.run.smithi203.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T20:47:27.981 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-20T20:47:28.027 INFO:teuthology.orchestra.run.smithi203.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:47:28.027 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 113 MB of archives. 2024-09-20T20:47:28.027 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T20:47:28.027 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T20:47:28.105 INFO:teuthology.orchestra.run.smithi139.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:47:28.105 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 113 MB of archives. 2024-09-20T20:47:28.105 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T20:47:28.105 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T20:47:28.174 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-20T20:47:28.175 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-20T20:47:28.340 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:47:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:47:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:47:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:47:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T20:47:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: python2.7-minimal 2024-09-20T20:47:28.341 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:47:28.342 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-20T20:47:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:47:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T20:47:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T20:47:28.344 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-20T20:47:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T20:47:28.344 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-20T20:47:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: thermald 2024-09-20T20:47:28.399 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-20T20:47:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:47:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T20:47:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T20:47:28.401 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2024-09-20T20:47:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T20:47:28.452 INFO:teuthology.orchestra.run.smithi112.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:47:28.452 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 113 MB of archives. 2024-09-20T20:47:28.452 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T20:47:28.452 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T20:47:28.464 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T20:47:28.550 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T20:47:28.889 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T20:47:28.987 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T20:47:29.316 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T20:47:29.334 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T20:47:29.334 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T20:47:29.334 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T20:47:29.454 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T20:47:29.529 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T20:47:29.553 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T20:47:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T20:47:29.747 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T20:47:29.748 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T20:47:29.748 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T20:47:29.865 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T20:47:29.878 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T20:47:29.949 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 113 MB in 2s (71.8 MB/s) 2024-09-20T20:47:29.965 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T20:47:30.128 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T20:47:30.372 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 113 MB in 2s (72.8 MB/s) 2024-09-20T20:47:30.553 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T20:47:31.864 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T20:47:31.864 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T20:47:31.864 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T20:47:32.173 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T20:47:32.177 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:32.192 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T20:47:32.193 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T20:47:32.193 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T20:47:32.241 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:32.551 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T20:47:32.552 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T20:47:32.614 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T20:47:32.618 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:32.635 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T20:47:32.734 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T20:47:32.967 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:33.024 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 113 MB in 5s (24.1 MB/s) 2024-09-20T20:47:33.146 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 113 MB in 5s (22.5 MB/s) 2024-09-20T20:47:33.216 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T20:47:33.328 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T20:47:34.334 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T20:47:34.355 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:34.458 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:34.945 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T20:47:34.966 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:35.003 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:35.127 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T20:47:35.132 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:35.135 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T20:47:35.156 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:35.222 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:35.248 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:35.342 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T20:47:35.346 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:35.425 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:35.780 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T20:47:35.801 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:35.838 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:37.766 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T20:47:37.787 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:37.797 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T20:47:37.818 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:37.874 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:37.907 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:38.384 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T20:47:38.386 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T20:47:38.404 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:38.406 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:38.442 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:38.444 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:42.053 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:42.178 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:42.519 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:42.648 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:42.906 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:42.943 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T20:47:42.966 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T20:47:43.009 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:47:43.067 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:43.424 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:43.570 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:43.915 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T20:47:43.937 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T20:47:44.004 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:47:44.760 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:44.818 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:44.885 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:44.943 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:45.243 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:45.276 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:45.380 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:45.413 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:45.691 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T20:47:45.707 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T20:47:45.713 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T20:47:45.730 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T20:47:45.757 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:47:45.799 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:47:48.900 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T20:47:48.937 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:48.975 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:50.338 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T20:47:50.375 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:50.413 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:51.492 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T20:47:51.520 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T20:47:51.529 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:51.531 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:51.557 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:47:51.567 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:51.595 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:51.659 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:52.001 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:47:52.123 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:52.257 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T20:47:52.386 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:53.332 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:53.712 INFO:teuthology.orchestra.run.smithi203.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:47:53.712 INFO:teuthology.orchestra.run.smithi203.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T20:47:53.712 INFO:teuthology.orchestra.run.smithi203.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:47:53.712 INFO:teuthology.orchestra.run.smithi203.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T20:47:53.715 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:47:53.820 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:53.864 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:53.980 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T20:47:54.109 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:54.205 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:54.249 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:47:54.327 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:54.372 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:47:54.660 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:47:54.704 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:47:55.379 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:55.601 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:47:55.601 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T20:47:55.601 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:47:55.601 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T20:47:55.716 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T20:47:55.740 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:55.835 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:55.853 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T20:47:55.867 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T20:47:55.875 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T20:47:55.982 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:55.984 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:56.004 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:57.219 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T20:47:57.309 INFO:teuthology.orchestra.run.smithi139.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:47:57.309 INFO:teuthology.orchestra.run.smithi139.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T20:47:57.309 INFO:teuthology.orchestra.run.smithi139.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:47:57.309 INFO:teuthology.orchestra.run.smithi139.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T20:47:57.331 INFO:teuthology.orchestra.run.smithi161.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:47:57.331 INFO:teuthology.orchestra.run.smithi161.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T20:47:57.331 INFO:teuthology.orchestra.run.smithi161.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:47:57.331 INFO:teuthology.orchestra.run.smithi161.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T20:47:57.346 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T20:47:57.361 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:57.417 INFO:teuthology.orchestra.run.smithi203.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T20:47:57.417 INFO:teuthology.orchestra.run.smithi203.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:47:57.449 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:57.463 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:57.488 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:58.851 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T20:47:58.881 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T20:47:58.923 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:58.977 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T20:47:58.982 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T20:47:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T20:47:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:47:59.083 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:47:59.102 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:48:00.493 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:48:00.513 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:48:00.566 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T20:48:00.566 INFO:teuthology.orchestra.run.smithi161.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:48:00.579 INFO:teuthology.orchestra.run.smithi139.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T20:48:00.579 INFO:teuthology.orchestra.run.smithi139.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:48:12.015 INFO:teuthology.orchestra.run.smithi203.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T20:48:12.015 INFO:teuthology.orchestra.run.smithi203.stdout:Sourcing file `/etc/default/grub' 2024-09-20T20:48:12.028 INFO:teuthology.orchestra.run.smithi203.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:48:12.053 INFO:teuthology.orchestra.run.smithi203.stdout:Generating grub configuration file ... 2024-09-20T20:48:12.319 INFO:teuthology.orchestra.run.smithi203.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:48:12.344 INFO:teuthology.orchestra.run.smithi203.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:48:12.664 INFO:teuthology.orchestra.run.smithi203.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:48:12.670 INFO:teuthology.orchestra.run.smithi203.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:48:12.742 INFO:teuthology.orchestra.run.smithi203.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:48:12.748 INFO:teuthology.orchestra.run.smithi203.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:48:12.899 INFO:teuthology.orchestra.run.smithi203.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:48:12.899 INFO:teuthology.orchestra.run.smithi203.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:48:12.899 INFO:teuthology.orchestra.run.smithi203.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:48:12.940 INFO:teuthology.orchestra.run.smithi203.stdout:done 2024-09-20T20:48:13.433 DEBUG:teuthology.orchestra.run.smithi203:> dpkg -s linux-image-generic 2024-09-20T20:48:13.455 INFO:teuthology.orchestra.run.smithi203.stdout:Package: linux-image-generic 2024-09-20T20:48:13.455 INFO:teuthology.orchestra.run.smithi203.stdout:Status: install ok installed 2024-09-20T20:48:13.455 INFO:teuthology.orchestra.run.smithi203.stdout:Priority: optional 2024-09-20T20:48:13.455 INFO:teuthology.orchestra.run.smithi203.stdout:Section: kernel 2024-09-20T20:48:13.455 INFO:teuthology.orchestra.run.smithi203.stdout:Installed-Size: 21 2024-09-20T20:48:13.455 INFO:teuthology.orchestra.run.smithi203.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:48:13.455 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: amd64 2024-09-20T20:48:13.455 INFO:teuthology.orchestra.run.smithi203.stdout:Source: linux-meta 2024-09-20T20:48:13.455 INFO:teuthology.orchestra.run.smithi203.stdout:Version: 5.15.0.122.122 2024-09-20T20:48:13.455 INFO:teuthology.orchestra.run.smithi203.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:48:13.456 INFO:teuthology.orchestra.run.smithi203.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:48:13.456 INFO:teuthology.orchestra.run.smithi203.stdout:Recommends: thermald 2024-09-20T20:48:13.456 INFO:teuthology.orchestra.run.smithi203.stdout:Description: Generic Linux kernel image 2024-09-20T20:48:13.456 INFO:teuthology.orchestra.run.smithi203.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:48:13.456 INFO:teuthology.orchestra.run.smithi203.stdout: available. 2024-09-20T20:48:13.456 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T20:48:13.456 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T20:48:13.456 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T20:48:13.456 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-20T20:48:13.456 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi203.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T20:48:13.457 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get clean 2024-09-20T20:48:13.599 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get update 2024-09-20T20:48:13.601 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T20:48:13.602 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub' 2024-09-20T20:48:13.622 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:48:13.644 INFO:teuthology.orchestra.run.smithi112.stdout:Generating grub configuration file ... 2024-09-20T20:48:13.845 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:48:13.857 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:48:13.941 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:48:13.971 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:48:13.995 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:48:14.020 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:48:14.349 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:48:14.355 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:48:14.426 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:48:14.431 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:48:14.456 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T20:48:14.456 INFO:teuthology.orchestra.run.smithi161.stdout:Sourcing file `/etc/default/grub' 2024-09-20T20:48:14.468 INFO:teuthology.orchestra.run.smithi161.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:48:14.497 INFO:teuthology.orchestra.run.smithi161.stdout:Generating grub configuration file ... 2024-09-20T20:48:14.628 INFO:teuthology.orchestra.run.smithi112.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:48:14.628 INFO:teuthology.orchestra.run.smithi112.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:48:14.628 INFO:teuthology.orchestra.run.smithi112.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:48:14.669 INFO:teuthology.orchestra.run.smithi112.stdout:done 2024-09-20T20:48:14.839 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:48:14.856 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:48:14.891 INFO:teuthology.orchestra.run.smithi139.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T20:48:14.891 INFO:teuthology.orchestra.run.smithi139.stdout:Sourcing file `/etc/default/grub' 2024-09-20T20:48:14.910 INFO:teuthology.orchestra.run.smithi139.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:48:14.922 INFO:teuthology.orchestra.run.smithi139.stdout:Generating grub configuration file ... 2024-09-20T20:48:15.130 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:48:15.136 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:48:15.163 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-20T20:48:15.169 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:48:15.180 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-20T20:48:15.180 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-20T20:48:15.180 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-20T20:48:15.180 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.122.122 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:48:15.181 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-20T20:48:15.182 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T20:48:15.182 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T20:48:15.182 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T20:48:15.182 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-20T20:48:15.182 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T20:48:15.183 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-20T20:48:15.192 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:48:15.210 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:48:15.215 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:48:15.261 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-20T20:48:15.279 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:48:15.338 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-20T20:48:15.375 INFO:teuthology.orchestra.run.smithi161.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:48:15.375 INFO:teuthology.orchestra.run.smithi161.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:48:15.375 INFO:teuthology.orchestra.run.smithi161.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:48:15.389 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-20T20:48:15.411 INFO:teuthology.orchestra.run.smithi161.stdout:done 2024-09-20T20:48:15.477 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:48:15.482 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:48:15.524 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:48:15.550 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2024-09-20T20:48:15.551 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2024-09-20T20:48:15.551 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:48:15.557 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:48:15.648 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:48:15.726 INFO:teuthology.orchestra.run.smithi139.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:48:15.726 INFO:teuthology.orchestra.run.smithi139.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:48:15.726 INFO:teuthology.orchestra.run.smithi139.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:48:15.728 INFO:teuthology.orchestra.run.smithi203.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T20:48:15.729 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:48:15.729 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:48:15.729 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:48:15.729 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:48:15.729 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:48:15.730 INFO:teuthology.orchestra.run.smithi203.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:48:15.730 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:48:15.741 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:48:15.770 INFO:teuthology.orchestra.run.smithi203.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:48:15.771 DEBUG:teuthology.orchestra.run.smithi203:> dpkg -s linux-image-generic 2024-09-20T20:48:15.776 INFO:teuthology.orchestra.run.smithi139.stdout:done 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Package: linux-image-generic 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Status: install ok installed 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Priority: optional 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Section: kernel 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Installed-Size: 21 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: amd64 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Source: linux-meta 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Version: 5.15.0.122.122 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:48:15.786 INFO:teuthology.orchestra.run.smithi203.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:48:15.787 INFO:teuthology.orchestra.run.smithi203.stdout:Recommends: thermald 2024-09-20T20:48:15.787 INFO:teuthology.orchestra.run.smithi203.stdout:Description: Generic Linux kernel image 2024-09-20T20:48:15.787 INFO:teuthology.orchestra.run.smithi203.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:48:15.787 INFO:teuthology.orchestra.run.smithi203.stdout: available. 2024-09-20T20:48:15.787 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-09-20T20:48:15.811 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:48:15.830 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.kT6PH6lOKI 2024-09-20T20:48:15.831 DEBUG:teuthology.orchestra.run.smithi203:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kT6PH6lOKI 2024-09-20T20:48:15.884 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.kT6PH6lOKI 2024-09-20T20:48:15.893 DEBUG:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2024-09-20T20:48:15.911 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2024-09-20T20:48:15.911 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2024-09-20T20:48:15.911 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2024-09-20T20:48:15.911 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2024-09-20T20:48:15.911 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 21 2024-09-20T20:48:15.911 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:48:15.911 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2024-09-20T20:48:15.912 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2024-09-20T20:48:15.912 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 5.15.0.122.122 2024-09-20T20:48:15.912 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:48:15.912 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:48:15.912 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2024-09-20T20:48:15.912 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2024-09-20T20:48:15.912 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:48:15.912 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2024-09-20T20:48:15.912 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T20:48:15.912 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T20:48:15.912 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T20:48:15.912 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-20T20:48:15.913 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T20:48:15.913 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2024-09-20T20:48:16.001 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.kT6PH6lOKI is 10KB 2024-09-20T20:48:16.013 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.kT6PH6lOKI 2024-09-20T20:48:16.018 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T20:48:16.070 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T20:48:16.070 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T20:48:16.070 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T20:48:16.116 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-09-20T20:48:16.134 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T20:48:16.134 DEBUG:teuthology.orchestra.run.smithi203:> sudo update-grub 2024-09-20T20:48:16.226 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:48:16.287 DEBUG:teuthology.orchestra.run.smithi139:> dpkg -s linux-image-generic 2024-09-20T20:48:16.311 INFO:teuthology.orchestra.run.smithi139.stdout:Package: linux-image-generic 2024-09-20T20:48:16.311 INFO:teuthology.orchestra.run.smithi139.stdout:Status: install ok installed 2024-09-20T20:48:16.311 INFO:teuthology.orchestra.run.smithi139.stdout:Priority: optional 2024-09-20T20:48:16.311 INFO:teuthology.orchestra.run.smithi139.stdout:Section: kernel 2024-09-20T20:48:16.311 INFO:teuthology.orchestra.run.smithi139.stdout:Installed-Size: 21 2024-09-20T20:48:16.312 INFO:teuthology.orchestra.run.smithi139.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:48:16.312 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: amd64 2024-09-20T20:48:16.312 INFO:teuthology.orchestra.run.smithi139.stdout:Source: linux-meta 2024-09-20T20:48:16.312 INFO:teuthology.orchestra.run.smithi139.stdout:Version: 5.15.0.122.122 2024-09-20T20:48:16.312 INFO:teuthology.orchestra.run.smithi139.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:48:16.312 INFO:teuthology.orchestra.run.smithi139.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:48:16.312 INFO:teuthology.orchestra.run.smithi139.stdout:Recommends: thermald 2024-09-20T20:48:16.312 INFO:teuthology.orchestra.run.smithi139.stdout:Description: Generic Linux kernel image 2024-09-20T20:48:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:48:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: available. 2024-09-20T20:48:16.312 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T20:48:16.313 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T20:48:16.313 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T20:48:16.313 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-20T20:48:16.313 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T20:48:16.313 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get clean 2024-09-20T20:48:16.350 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:48:16.432 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:48:16.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-09-20T20:48:16.513 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:48:16.650 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:48:16.650 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:48:16.650 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:48:16.661 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:48:16.968 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-20T20:48:16.986 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:48:17.038 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-20T20:48:17.227 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-20T20:48:17.227 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-20T20:48:17.390 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub' 2024-09-20T20:48:17.391 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:48:17.394 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-09-20T20:48:17.397 INFO:teuthology.orchestra.run.smithi112.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T20:48:17.397 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:48:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:48:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:48:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:48:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:48:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:48:17.398 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:48:17.439 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:48:17.441 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-20T20:48:17.496 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-20T20:48:17.496 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-20T20:48:17.496 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.122.122 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:48:17.497 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-20T20:48:17.498 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-20T20:48:17.541 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.n9liqml0Cx 2024-09-20T20:48:17.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub/grub.cfg /tmp/tmp.n9liqml0Cx 2024-09-20T20:48:17.577 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:48:17.583 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:48:17.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.n9liqml0Cx 2024-09-20T20:48:17.677 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-20T20:48:17.696 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:48:17.713 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.n9liqml0Cx is 10KB 2024-09-20T20:48:17.726 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.n9liqml0Cx 2024-09-20T20:48:17.731 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T20:48:17.761 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-20T20:48:17.786 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T20:48:17.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T20:48:17.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T20:48:17.816 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:48:17.821 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:48:17.861 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:48:17.866 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:48:17.881 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T20:48:17.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo update-grub 2024-09-20T20:48:17.970 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-09-20T20:48:17.970 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-09-20T20:48:18.006 INFO:teuthology.orchestra.run.smithi203.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:48:18.006 INFO:teuthology.orchestra.run.smithi203.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:48:18.006 INFO:teuthology.orchestra.run.smithi203.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:48:18.029 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-09-20T20:48:18.045 DEBUG:teuthology.orchestra.run.smithi203:> sudo shutdown -r now 2024-09-20T20:48:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-20T20:48:18.137 INFO:teuthology.orchestra.run.smithi161.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T20:48:18.137 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:48:18.137 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:48:18.137 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:48:18.137 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:48:18.138 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:48:18.138 INFO:teuthology.orchestra.run.smithi161.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:48:18.138 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:48:18.143 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:48:18.178 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:48:18.180 DEBUG:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2024-09-20T20:48:18.194 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2024-09-20T20:48:18.194 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2024-09-20T20:48:18.194 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2024-09-20T20:48:18.194 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 21 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 5.15.0.122.122 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:48:18.195 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2024-09-20T20:48:18.196 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-09-20T20:48:18.204 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-20T20:48:18.243 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.XyV7gJLrnA 2024-09-20T20:48:18.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub/grub.cfg /tmp/tmp.XyV7gJLrnA 2024-09-20T20:48:18.299 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.XyV7gJLrnA 2024-09-20T20:48:18.402 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-20T20:48:18.403 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-20T20:48:18.428 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.XyV7gJLrnA is 10KB 2024-09-20T20:48:18.440 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.XyV7gJLrnA 2024-09-20T20:48:18.445 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T20:48:18.500 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T20:48:18.500 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T20:48:18.500 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T20:48:18.571 INFO:teuthology.orchestra.run.smithi139.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T20:48:18.571 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:48:18.571 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:48:18.572 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:48:18.572 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:48:18.572 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:48:18.572 INFO:teuthology.orchestra.run.smithi139.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:48:18.572 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:48:18.596 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T20:48:18.597 DEBUG:teuthology.orchestra.run.smithi161:> sudo update-grub 2024-09-20T20:48:18.613 INFO:teuthology.orchestra.run.smithi139.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:48:18.615 DEBUG:teuthology.orchestra.run.smithi139:> dpkg -s linux-image-generic 2024-09-20T20:48:18.630 INFO:teuthology.orchestra.run.smithi139.stdout:Package: linux-image-generic 2024-09-20T20:48:18.630 INFO:teuthology.orchestra.run.smithi139.stdout:Status: install ok installed 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Priority: optional 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Section: kernel 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Installed-Size: 21 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: amd64 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Source: linux-meta 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Version: 5.15.0.122.122 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Recommends: thermald 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:Description: Generic Linux kernel image 2024-09-20T20:48:18.631 INFO:teuthology.orchestra.run.smithi139.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:48:18.632 INFO:teuthology.orchestra.run.smithi139.stdout: available. 2024-09-20T20:48:18.632 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-09-20T20:48:18.677 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.wyvNtiMgGH 2024-09-20T20:48:18.677 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wyvNtiMgGH 2024-09-20T20:48:18.731 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.wyvNtiMgGH 2024-09-20T20:48:18.861 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.wyvNtiMgGH is 10KB 2024-09-20T20:48:18.874 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.wyvNtiMgGH 2024-09-20T20:48:18.879 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T20:48:18.933 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T20:48:18.933 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T20:48:18.934 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T20:48:18.998 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T20:48:18.998 DEBUG:teuthology.orchestra.run.smithi139:> sudo update-grub 2024-09-20T20:48:19.352 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub' 2024-09-20T20:48:19.358 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:48:19.362 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-20T20:48:19.592 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:48:19.598 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:48:19.862 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:48:19.867 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:48:19.883 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2024-09-20T20:48:19.884 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:48:19.889 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-09-20T20:48:19.908 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:48:19.913 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:48:20.042 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:48:20.042 INFO:teuthology.orchestra.run.smithi112.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:48:20.043 INFO:teuthology.orchestra.run.smithi112.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:48:20.053 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-20T20:48:20.055 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-20T20:48:20.071 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:48:20.077 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:48:20.254 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub' 2024-09-20T20:48:20.255 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:48:20.256 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-09-20T20:48:20.313 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:48:20.318 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:48:20.354 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:48:20.359 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:48:20.466 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:48:20.472 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:48:20.487 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:48:20.488 INFO:teuthology.orchestra.run.smithi161.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:48:20.488 INFO:teuthology.orchestra.run.smithi161.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:48:20.498 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-09-20T20:48:20.513 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2024-09-20T20:48:20.712 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:48:20.717 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:48:20.759 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:48:20.765 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:48:20.920 INFO:teuthology.orchestra.run.smithi139.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:48:20.920 INFO:teuthology.orchestra.run.smithi139.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:48:20.920 INFO:teuthology.orchestra.run.smithi139.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:48:20.934 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-09-20T20:48:20.949 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2024-09-20T20:48:48.074 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-20T20:48:48.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-20T20:48:48.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:48:50.101 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-20T20:48:50.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-20T20:48:50.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:48:50.516 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-20T20:48:50.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-20T20:48:50.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:48:50.953 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-20T20:48:50.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-20T20:48:50.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:49:06.543 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-20T20:49:08.595 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-20T20:49:08.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-20T20:49:09.358 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-20T20:49:15.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-20T20:49:15.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:49:17.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-20T20:49:17.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:49:17.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-20T20:49:17.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:49:18.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-20T20:49:18.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:49:18.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-20T20:49:20.655 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-20T20:49:20.911 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-20T20:49:21.423 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-20T20:49:30.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-20T20:49:30.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:49:32.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-20T20:49:32.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:49:32.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-20T20:49:32.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:49:33.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-20T20:49:33.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:49:33.679 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-20T20:49:48.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-20T20:49:48.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:49:51.759 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-20T20:49:51.859 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-20T20:50:04.403 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-20T20:50:04.406 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-20T20:50:04.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-20T20:50:04.939 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-20T20:50:04.940 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-20T20:50:04.986 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-122-generic 2024-09-20T20:50:04.987 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T20:50:04.987 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T20:50:04.987 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T20:50:05.988 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-20T20:50:05.988 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T20:50:06.064 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-09-20T20:50:06.084 DEBUG:teuthology.parallel:result is None 2024-09-20T20:50:06.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-20T20:50:06.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:50:07.082 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-20T20:50:07.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-20T20:50:07.881 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-122-generic"... 2024-09-20T20:50:07.881 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-20T20:50:07.885 INFO:teuthology.orchestra.run.smithi139.stdout:5.15.0-122-generic 2024-09-20T20:50:07.886 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T20:50:07.886 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T20:50:07.886 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T20:50:08.886 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-20T20:50:08.886 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T20:50:09.003 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2024-09-20T20:50:09.033 DEBUG:teuthology.parallel:result is None 2024-09-20T20:50:09.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-20T20:50:09.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:50:19.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-20T20:50:19.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:50:19.840 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-20T20:50:20.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-20T20:50:20.398 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-122-generic"... 2024-09-20T20:50:20.398 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-09-20T20:50:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:5.15.0-122-generic 2024-09-20T20:50:20.445 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T20:50:20.446 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T20:50:20.446 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T20:50:21.446 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-20T20:50:21.446 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T20:50:21.524 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2024-09-20T20:50:21.555 DEBUG:teuthology.parallel:result is None 2024-09-20T20:50:25.139 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-20T20:50:46.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-20T20:50:46.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:50:46.498 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-20T20:50:47.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-20T20:50:47.070 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-122-generic"... 2024-09-20T20:50:47.070 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-09-20T20:50:47.117 INFO:teuthology.orchestra.run.smithi203.stdout:5.15.0-122-generic 2024-09-20T20:50:47.117 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T20:50:47.117 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T20:50:47.118 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T20:50:48.118 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-20T20:50:48.118 DEBUG:teuthology.orchestra.run.smithi203:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T20:50:48.189 INFO:teuthology.orchestra.run.smithi203.stdout:ttyS1 2024-09-20T20:50:48.207 DEBUG:teuthology.parallel:result is None 2024-09-20T20:50:48.207 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-20T20:50:48.218 INFO:teuthology.task.internal:Creating test directory... 2024-09-20T20:50:48.218 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T20:50:48.220 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T20:50:48.223 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T20:50:48.225 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T20:50:48.231 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-20T20:50:48.238 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-20T20:50:48.246 INFO:teuthology.task.internal:Creating archive directory... 2024-09-20T20:50:48.246 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T20:50:48.267 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T20:50:48.272 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T20:50:48.274 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T20:50:48.371 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-20T20:50:48.377 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-20T20:50:48.378 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T20:50:48.380 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T20:50:48.382 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T20:50:48.385 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T20:50:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:50:48.400 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:50:48.403 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:50:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:50:48.406 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:50:48.408 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:50:48.412 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:50:48.414 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:50:48.416 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-20T20:50:48.423 INFO:teuthology.task.internal:Configuring sudo... 2024-09-20T20:50:48.423 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T20:50:48.451 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T20:50:48.453 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T20:50:48.458 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T20:50:48.473 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-20T20:50:48.483 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-20T20:50:48.483 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T20:50:48.503 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T20:50:48.516 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T20:50:48.518 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T20:50:48.524 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T20:50:48.554 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T20:50:48.602 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T20:50:48.602 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T20:50:48.669 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T20:50:48.675 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T20:50:48.723 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T20:50:48.724 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T20:50:48.810 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T20:50:48.816 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T20:50:48.862 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T20:50:48.862 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T20:50:48.940 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T20:50:48.946 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T20:50:48.994 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T20:50:48.994 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T20:50:49.057 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-20T20:50:49.059 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-09-20T20:50:49.062 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-09-20T20:50:49.064 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-09-20T20:50:49.129 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-20T20:50:49.142 INFO:teuthology.task.internal:Starting timer... 2024-09-20T20:50:49.142 INFO:teuthology.run_tasks:Running task pcp... 2024-09-20T20:50:49.175 INFO:teuthology.run_tasks:Running task selinux... 2024-09-20T20:50:49.211 DEBUG:teuthology.task.selinux:Excluding smithi112: OS 'ubuntu' does not support SELinux 2024-09-20T20:50:49.211 DEBUG:teuthology.task.selinux:Excluding smithi139: OS 'ubuntu' does not support SELinux 2024-09-20T20:50:49.211 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2024-09-20T20:50:49.211 DEBUG:teuthology.task.selinux:Excluding smithi203: OS 'ubuntu' does not support SELinux 2024-09-20T20:50:49.212 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-20T20:50:49.212 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-20T20:50:49.212 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-20T20:50:49.212 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-20T20:50:49.220 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-20T20:50:49.231 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-20T20:50:49.232 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi139.front.sepia.ceph.com,smithi161.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-20T20:58:23.032 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-09-20T20:58:23.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-20T20:58:23.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:58:23.113 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-20T20:58:23.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-20T20:58:23.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-20T20:58:23.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:58:23.276 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-20T20:58:23.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-20T20:58:23.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-20T20:58:23.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:58:23.431 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-20T20:58:23.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-20T20:58:23.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-20T20:58:23.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:58:23.584 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-20T20:58:23.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-20T20:58:23.659 INFO:teuthology.run_tasks:Running task clock... 2024-09-20T20:58:23.669 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-20T20:58:23.669 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T20:58:23.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:58:23.672 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T20:58:23.672 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:58:23.674 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T20:58:23.675 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:58:23.677 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T20:58:23.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:58:23.700 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T20:58:23.700 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: Command line: ntpd -gq 2024-09-20T20:58:23.700 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: ---------------------------------------------------- 2024-09-20T20:58:23.700 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T20:58:23.700 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T20:58:23.700 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: corporation. Support and training for ntp-4 are 2024-09-20T20:58:23.700 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: available at https://www.nwtime.org/support 2024-09-20T20:58:23.700 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: ---------------------------------------------------- 2024-09-20T20:58:23.701 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: proto: precision = 0.043 usec (-24) 2024-09-20T20:58:23.702 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: basedate set to 2022-02-04 2024-09-20T20:58:23.702 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: gps base set to 2022-02-06 (week 2196) 2024-09-20T20:58:23.702 INFO:teuthology.orchestra.run.smithi112.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:58:23.702 INFO:teuthology.orchestra.run.smithi112.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:58:23.703 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:58:23.703 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:58:23.703 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T20:58:23.703 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T20:58:23.703 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T20:58:23.703 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: Listen normally on 3 enp3s0f1 172.21.15.112:123 2024-09-20T20:58:23.703 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: Listen normally on 4 lo [::1]:123 2024-09-20T20:58:23.704 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb69%5]:123 2024-09-20T20:58:23.704 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:23 ntpd[18483]: Listening on routing socket on fd #22 for interface updates 2024-09-20T20:58:23.704 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T20:58:23.704 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: Command line: ntpd -gq 2024-09-20T20:58:23.704 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: ---------------------------------------------------- 2024-09-20T20:58:23.705 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T20:58:23.705 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T20:58:23.705 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: corporation. Support and training for ntp-4 are 2024-09-20T20:58:23.705 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: available at https://www.nwtime.org/support 2024-09-20T20:58:23.705 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: ---------------------------------------------------- 2024-09-20T20:58:23.705 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: proto: precision = 0.061 usec (-24) 2024-09-20T20:58:23.705 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: basedate set to 2022-02-04 2024-09-20T20:58:23.705 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: gps base set to 2022-02-06 (week 2196) 2024-09-20T20:58:23.705 INFO:teuthology.orchestra.run.smithi139.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:58:23.706 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:58:23.706 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:58:23.706 INFO:teuthology.orchestra.run.smithi139.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:58:23.707 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T20:58:23.707 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T20:58:23.707 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T20:58:23.707 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: Listen normally on 3 enp3s0f1 172.21.15.139:123 2024-09-20T20:58:23.707 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: Listen normally on 4 lo [::1]:123 2024-09-20T20:58:23.707 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f59%5]:123 2024-09-20T20:58:23.707 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:23 ntpd[18487]: Listening on routing socket on fd #22 for interface updates 2024-09-20T20:58:23.708 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T20:58:23.708 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: Command line: ntpd -gq 2024-09-20T20:58:23.708 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: ---------------------------------------------------- 2024-09-20T20:58:23.708 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T20:58:23.709 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T20:58:23.709 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: corporation. Support and training for ntp-4 are 2024-09-20T20:58:23.709 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: available at https://www.nwtime.org/support 2024-09-20T20:58:23.709 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: ---------------------------------------------------- 2024-09-20T20:58:23.709 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: proto: precision = 0.059 usec (-24) 2024-09-20T20:58:23.709 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: basedate set to 2022-02-04 2024-09-20T20:58:23.709 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: gps base set to 2022-02-06 (week 2196) 2024-09-20T20:58:23.709 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:58:23.710 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:58:23.710 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:58:23.710 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:58:23.711 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T20:58:23.711 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T20:58:23.711 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T20:58:23.711 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2024-09-20T20:58:23.711 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: Listen normally on 4 lo [::1]:123 2024-09-20T20:58:23.711 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2024-09-20T20:58:23.711 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:23 ntpd[18530]: Listening on routing socket on fd #22 for interface updates 2024-09-20T20:58:23.724 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T20:58:23.724 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: Command line: ntpd -gq 2024-09-20T20:58:23.724 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: ---------------------------------------------------- 2024-09-20T20:58:23.724 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T20:58:23.725 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T20:58:23.725 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: corporation. Support and training for ntp-4 are 2024-09-20T20:58:23.725 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: available at https://www.nwtime.org/support 2024-09-20T20:58:23.725 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: ---------------------------------------------------- 2024-09-20T20:58:23.725 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: proto: precision = 0.044 usec (-24) 2024-09-20T20:58:23.725 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: basedate set to 2022-02-04 2024-09-20T20:58:23.725 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: gps base set to 2022-02-06 (week 2196) 2024-09-20T20:58:23.726 INFO:teuthology.orchestra.run.smithi203.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:58:23.726 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:58:23.726 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:58:23.726 INFO:teuthology.orchestra.run.smithi203.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:58:23.727 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T20:58:23.727 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T20:58:23.727 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T20:58:23.728 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: Listen normally on 3 enp3s0f1 172.21.15.203:123 2024-09-20T20:58:23.728 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: Listen normally on 4 lo [::1]:123 2024-09-20T20:58:23.728 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4a23%5]:123 2024-09-20T20:58:23.728 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:23 ntpd[18494]: Listening on routing socket on fd #22 for interface updates 2024-09-20T20:58:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:24 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:24 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:24 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:24 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:24 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:24.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:24 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:24.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:24 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:24 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:24 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:24.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:24 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:24 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:24 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:24 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:24 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:24 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:24 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:24 ntpd[18530]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:24.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:24 ntpd[18530]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:24.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:24.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:24.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:24.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:24.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:24.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:24 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:25.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:25 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:25.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:25 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:25.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:25 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:25.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:25 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:25.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:25 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:25.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:25 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:26.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:26 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:26.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:26 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:26 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:26.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:26 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:26.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:26 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:26 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:26 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:26 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:26 ntpd[18530]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:26.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:26 ntpd[18530]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:26.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:26.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:26 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:27 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:27 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:27 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:27 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:27 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:27 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:27 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:27 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:27.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:27.706 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:27.706 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.706 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.706 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:27.706 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:27 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:27.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.708 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.708 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:27.708 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:27.708 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.708 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.708 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:27.708 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:27 ntpd[18530]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:27.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:27 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:27 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:27 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:27.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:27 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:27.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:27 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:27.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:27 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:28.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:28.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:28.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:28.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:28 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:28.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:28 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:28 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:28 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:28 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:28 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:28.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:28 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:28.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:28 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:28 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:28 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:28 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:28 ntpd[18530]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:28.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:28 ntpd[18530]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:28.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:28.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:28 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:29.700 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:29 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:29 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:29 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:29 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:29 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:29.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:29 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:29.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:29 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:29.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:29.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:29.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.708 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:29.708 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:29 ntpd[18530]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:29.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:29 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:29 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:29 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:29.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:29 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:29.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:29 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:29.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:29 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:30.700 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:30 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:30.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:30 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:30.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:30 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:30.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:30 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:30.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:30 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:30.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:30 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:30.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:30 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:30.701 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:30 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:30.701 INFO:teuthology.orchestra.run.smithi112.stdout:20 Sep 20:58:30 ntpd[18483]: ntpd: time slew -0.000037 s 2024-09-20T20:58:30.701 INFO:teuthology.orchestra.run.smithi112.stdout:ntpd: time slew -0.000037s 2024-09-20T20:58:30.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:30 ntpd[18483]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T20:58:30.702 INFO:teuthology.orchestra.run.smithi112.stderr:20 Sep 20:58:30 ntpd[18483]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T20:58:30.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:30 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:30.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:30 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:30.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:30 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:30.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:30 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:30.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:30 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:30.704 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:30 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:30.704 INFO:teuthology.orchestra.run.smithi139.stdout:20 Sep 20:58:30 ntpd[18487]: ntpd: time slew -0.001263 s 2024-09-20T20:58:30.705 INFO:teuthology.orchestra.run.smithi139.stdout:ntpd: time slew -0.001263s 2024-09-20T20:58:30.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:30 ntpd[18487]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T20:58:30.705 INFO:teuthology.orchestra.run.smithi139.stderr:20 Sep 20:58:30 ntpd[18487]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T20:58:30.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:30 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:30.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:30 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:30.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:30 ntpd[18530]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:30.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:30 ntpd[18530]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:30.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:30 ntpd[18530]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:30.706 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:30 ntpd[18530]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:30.706 INFO:teuthology.orchestra.run.smithi161.stdout:20 Sep 20:58:30 ntpd[18530]: ntpd: time slew -0.000532 s 2024-09-20T20:58:30.707 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time slew -0.000532s 2024-09-20T20:58:30.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:30 ntpd[18530]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T20:58:30.707 INFO:teuthology.orchestra.run.smithi161.stderr:20 Sep 20:58:30 ntpd[18530]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T20:58:30.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:30 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:30.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:30 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:30.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:30 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:30.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:30 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:30.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:30 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:58:30.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:30 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:58:30.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:30 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:58:30.725 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:30 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:58:30.726 INFO:teuthology.orchestra.run.smithi203.stdout:20 Sep 20:58:30 ntpd[18494]: ntpd: time slew -0.000048 s 2024-09-20T20:58:30.726 INFO:teuthology.orchestra.run.smithi203.stdout:ntpd: time slew -0.000048s 2024-09-20T20:58:30.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:30 ntpd[18494]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T20:58:30.726 INFO:teuthology.orchestra.run.smithi203.stderr:20 Sep 20:58:30 ntpd[18494]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T20:58:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:58:30.751 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2024-09-20T20:58:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:58:30.753 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-20T20:58:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.764 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:58:30.764 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-09-20T20:58:30.764 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.765 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.765 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.765 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.774 INFO:teuthology.orchestra.run.smithi203.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:58:30.774 INFO:teuthology.orchestra.run.smithi203.stdout:============================================================================== 2024-09-20T20:58:30.774 INFO:teuthology.orchestra.run.smithi203.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.774 INFO:teuthology.orchestra.run.smithi203.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.774 INFO:teuthology.orchestra.run.smithi203.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.774 INFO:teuthology.orchestra.run.smithi203.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:58:30.775 INFO:teuthology.run_tasks:Running task install... 2024-09-20T20:58:30.784 DEBUG:teuthology.task.install:project ceph 2024-09-20T20:58:30.784 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}} 2024-09-20T20:58:30.784 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'} 2024-09-20T20:58:30.785 INFO:teuthology.task.install:Using flavor: default 2024-09-20T20:58:30.790 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-20T20:58:30.790 INFO:teuthology.task.install:extra packages: [] 2024-09-20T20:58:30.790 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-key list | grep Ceph 2024-09-20T20:58:30.791 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-key list | grep Ceph 2024-09-20T20:58:30.791 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-key list | grep Ceph 2024-09-20T20:58:30.791 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-key list | grep Ceph 2024-09-20T20:58:30.847 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T20:58:30.851 INFO:teuthology.orchestra.run.smithi139.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T20:58:30.860 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T20:58:30.873 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T20:58:30.873 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T20:58:30.874 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T20:58:30.874 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-20T20:58:30.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:58:30.879 INFO:teuthology.orchestra.run.smithi203.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T20:58:30.880 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T20:58:30.880 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T20:58:30.880 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T20:58:30.880 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-20T20:58:30.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:58:30.888 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T20:58:30.888 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T20:58:30.888 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T20:58:30.888 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-20T20:58:30.888 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:58:30.908 INFO:teuthology.orchestra.run.smithi203.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T20:58:30.908 INFO:teuthology.orchestra.run.smithi203.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T20:58:30.908 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T20:58:30.909 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-20T20:58:30.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:58:31.024 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T20:58:31.024 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:58:31.033 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T20:58:31.033 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:58:31.036 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T20:58:31.036 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:58:31.043 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T20:58:31.044 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:58:31.135 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T20:58:31.135 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T20:58:31.140 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T20:58:31.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T20:58:31.145 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T20:58:31.145 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T20:58:31.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-20T20:58:31.154 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-09-20T20:58:31.158 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T20:58:31.158 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T20:58:31.160 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-09-20T20:58:31.175 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get update 2024-09-20T20:58:31.316 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:58:31.323 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:58:31.326 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:58:31.329 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:58:31.330 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:58:31.342 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:58:31.343 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:58:31.344 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:58:31.359 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:58:31.361 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:58:31.369 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T20:58:31.374 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T20:58:31.383 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T20:58:31.389 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T20:58:31.396 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T20:58:31.396 INFO:teuthology.orchestra.run.smithi203.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T20:58:31.403 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T20:58:31.411 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T20:58:31.417 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T20:58:31.417 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T20:58:31.425 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T20:58:31.432 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T20:58:31.438 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T20:58:31.439 INFO:teuthology.orchestra.run.smithi203.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T20:58:31.446 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T20:58:31.455 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:58:31.458 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T20:58:31.460 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T20:58:31.464 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T20:58:31.467 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:58:31.473 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T20:58:31.488 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T20:58:31.537 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:58:31.549 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:58:31.618 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:58:31.628 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:58:31.662 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 28.3 kB in 0s (84.2 kB/s) 2024-09-20T20:58:31.677 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 28.3 kB in 0s (85.2 kB/s) 2024-09-20T20:58:31.756 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 28.3 kB in 0s (67.3 kB/s) 2024-09-20T20:58:31.767 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 28.3 kB in 0s (68.8 kB/s) 2024-09-20T20:58:32.696 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-20T20:58:32.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:58:32.713 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-20T20:58:32.730 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:58:32.733 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-20T20:58:32.748 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:58:32.764 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-20T20:58:32.783 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-20T20:58:32.792 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-20T20:58:32.800 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:58:32.813 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-20T20:58:32.852 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-20T20:58:32.950 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-20T20:58:32.950 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-20T20:58:33.011 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-20T20:58:33.012 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-20T20:58:33.033 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-09-20T20:58:33.034 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-09-20T20:58:33.046 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2024-09-20T20:58:33.046 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2024-09-20T20:58:33.133 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:58:33.133 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:58:33.133 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:58:33.133 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:58:33.133 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:58:33.134 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:58:33.134 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:58:33.135 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-20T20:58:33.135 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T20:58:33.135 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T20:58:33.135 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T20:58:33.135 INFO:teuthology.orchestra.run.smithi112.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T20:58:33.136 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T20:58:33.136 INFO:teuthology.orchestra.run.smithi112.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T20:58:33.136 INFO:teuthology.orchestra.run.smithi112.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T20:58:33.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T20:58:33.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T20:58:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T20:58:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet zip 2024-09-20T20:58:33.138 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-20T20:58:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T20:58:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T20:58:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T20:58:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T20:58:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T20:58:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T20:58:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T20:58:33.139 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-20T20:58:33.139 INFO:teuthology.orchestra.run.smithi112.stdout: btrfs-tools 2024-09-20T20:58:33.214 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:58:33.214 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:58:33.214 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:58:33.215 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:58:33.215 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:58:33.215 INFO:teuthology.orchestra.run.smithi139.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:58:33.215 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:58:33.216 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-09-20T20:58:33.216 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T20:58:33.217 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T20:58:33.217 INFO:teuthology.orchestra.run.smithi139.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T20:58:33.217 INFO:teuthology.orchestra.run.smithi139.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:58:33.218 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:58:33.219 INFO:teuthology.orchestra.run.smithi139.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:58:33.219 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T20:58:33.219 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T20:58:33.219 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T20:58:33.219 INFO:teuthology.orchestra.run.smithi139.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T20:58:33.219 INFO:teuthology.orchestra.run.smithi139.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T20:58:33.219 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T20:58:33.219 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T20:58:33.219 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet zip 2024-09-20T20:58:33.219 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-09-20T20:58:33.220 INFO:teuthology.orchestra.run.smithi139.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T20:58:33.220 INFO:teuthology.orchestra.run.smithi139.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T20:58:33.220 INFO:teuthology.orchestra.run.smithi139.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T20:58:33.220 INFO:teuthology.orchestra.run.smithi139.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T20:58:33.220 INFO:teuthology.orchestra.run.smithi139.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T20:58:33.220 INFO:teuthology.orchestra.run.smithi139.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T20:58:33.220 INFO:teuthology.orchestra.run.smithi139.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T20:58:33.220 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2024-09-20T20:58:33.220 INFO:teuthology.orchestra.run.smithi139.stdout: btrfs-tools 2024-09-20T20:58:33.234 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:58:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:58:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:58:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:58:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:58:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:58:33.235 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:58:33.235 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2024-09-20T20:58:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T20:58:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T20:58:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T20:58:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:58:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T20:58:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T20:58:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T20:58:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T20:58:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T20:58:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T20:58:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T20:58:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet zip 2024-09-20T20:58:33.238 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2024-09-20T20:58:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T20:58:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T20:58:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T20:58:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T20:58:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T20:58:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T20:58:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T20:58:33.239 INFO:teuthology.orchestra.run.smithi203.stdout:Recommended packages: 2024-09-20T20:58:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: btrfs-tools 2024-09-20T20:58:33.240 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-20T20:58:33.241 INFO:teuthology.orchestra.run.smithi112.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T20:58:33.241 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T20:58:33.241 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T20:58:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T20:58:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T20:58:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T20:58:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T20:58:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T20:58:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T20:58:33.244 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T20:58:33.244 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T20:58:33.244 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T20:58:33.244 INFO:teuthology.orchestra.run.smithi112.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T20:58:33.248 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:58:33.248 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:58:33.248 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:58:33.248 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:58:33.248 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:58:33.249 INFO:teuthology.orchestra.run.smithi161.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:58:33.249 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:58:33.249 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-09-20T20:58:33.250 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T20:58:33.251 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T20:58:33.251 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T20:58:33.251 INFO:teuthology.orchestra.run.smithi161.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T20:58:33.251 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T20:58:33.251 INFO:teuthology.orchestra.run.smithi161.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T20:58:33.251 INFO:teuthology.orchestra.run.smithi161.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T20:58:33.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T20:58:33.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T20:58:33.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T20:58:33.253 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T20:58:33.253 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet zip 2024-09-20T20:58:33.253 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-09-20T20:58:33.253 INFO:teuthology.orchestra.run.smithi161.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T20:58:33.253 INFO:teuthology.orchestra.run.smithi161.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T20:58:33.253 INFO:teuthology.orchestra.run.smithi161.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T20:58:33.253 INFO:teuthology.orchestra.run.smithi161.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T20:58:33.253 INFO:teuthology.orchestra.run.smithi161.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T20:58:33.253 INFO:teuthology.orchestra.run.smithi161.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T20:58:33.254 INFO:teuthology.orchestra.run.smithi161.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T20:58:33.254 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2024-09-20T20:58:33.254 INFO:teuthology.orchestra.run.smithi161.stdout: btrfs-tools 2024-09-20T20:58:33.320 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-09-20T20:58:33.320 INFO:teuthology.orchestra.run.smithi139.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T20:58:33.320 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T20:58:33.321 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T20:58:33.321 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T20:58:33.321 INFO:teuthology.orchestra.run.smithi139.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T20:58:33.321 INFO:teuthology.orchestra.run.smithi139.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T20:58:33.323 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T20:58:33.324 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T20:58:33.324 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T20:58:33.324 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T20:58:33.324 INFO:teuthology.orchestra.run.smithi139.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T20:58:33.324 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T20:58:33.325 INFO:teuthology.orchestra.run.smithi139.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T20:58:33.340 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2024-09-20T20:58:33.340 INFO:teuthology.orchestra.run.smithi203.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T20:58:33.340 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T20:58:33.340 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T20:58:33.341 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:58:33.342 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T20:58:33.343 INFO:teuthology.orchestra.run.smithi203.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T20:58:33.356 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-09-20T20:58:33.356 INFO:teuthology.orchestra.run.smithi161.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T20:58:33.356 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T20:58:33.356 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T20:58:33.357 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T20:58:33.357 INFO:teuthology.orchestra.run.smithi161.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T20:58:33.357 INFO:teuthology.orchestra.run.smithi161.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T20:58:33.357 INFO:teuthology.orchestra.run.smithi161.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T20:58:33.357 INFO:teuthology.orchestra.run.smithi161.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T20:58:33.358 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T20:58:33.359 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T20:58:33.359 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T20:58:33.359 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T20:58:33.359 INFO:teuthology.orchestra.run.smithi161.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T20:58:33.381 INFO:teuthology.orchestra.run.smithi139.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T20:58:33.381 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 181 MB of archives. 2024-09-20T20:58:33.381 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T20:58:33.381 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T20:58:33.382 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T20:58:33.382 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 181 MB of archives. 2024-09-20T20:58:33.382 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T20:58:33.382 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T20:58:33.414 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T20:58:33.414 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 181 MB of archives. 2024-09-20T20:58:33.414 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T20:58:33.415 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T20:58:33.428 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T20:58:33.463 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T20:58:33.469 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T20:58:33.472 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T20:58:33.488 INFO:teuthology.orchestra.run.smithi203.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T20:58:33.488 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 181 MB of archives. 2024-09-20T20:58:33.488 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T20:58:33.488 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T20:58:33.488 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T20:58:33.496 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T20:58:33.501 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T20:58:33.503 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T20:58:33.520 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T20:58:33.533 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T20:58:33.549 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T20:58:33.554 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T20:58:33.566 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T20:58:33.570 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T20:58:33.570 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T20:58:33.571 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T20:58:33.578 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T20:58:33.578 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T20:58:33.579 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T20:58:33.581 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T20:58:33.582 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T20:58:33.583 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T20:58:33.585 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T20:58:33.588 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T20:58:33.590 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T20:58:33.594 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T20:58:33.598 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T20:58:33.599 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T20:58:33.600 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T20:58:33.603 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T20:58:33.605 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T20:58:33.605 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T20:58:33.605 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T20:58:33.607 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T20:58:33.607 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T20:58:33.607 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T20:58:33.608 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T20:58:33.608 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T20:58:33.610 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T20:58:33.612 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T20:58:33.614 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T20:58:33.615 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T20:58:33.618 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T20:58:33.621 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T20:58:33.621 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T20:58:33.631 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T20:58:33.633 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T20:58:33.634 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T20:58:33.634 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T20:58:33.635 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T20:58:33.636 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T20:58:33.636 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T20:58:33.636 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T20:58:33.638 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T20:58:33.641 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T20:58:33.641 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T20:58:33.642 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T20:58:33.642 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T20:58:33.643 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T20:58:33.643 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T20:58:33.644 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T20:58:33.649 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T20:58:33.649 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T20:58:33.655 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T20:58:33.656 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T20:58:33.666 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T20:58:33.669 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T20:58:33.669 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T20:58:33.670 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T20:58:33.670 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T20:58:33.671 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T20:58:33.671 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T20:58:33.672 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T20:58:33.672 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T20:58:33.677 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T20:58:33.678 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T20:58:33.678 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T20:58:33.679 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T20:58:33.680 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T20:58:33.682 INFO:teuthology.orchestra.run.smithi139.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T20:58:33.682 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T20:58:33.683 INFO:teuthology.orchestra.run.smithi139.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T20:58:33.683 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T20:58:33.689 INFO:teuthology.orchestra.run.smithi139.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T20:58:33.689 INFO:teuthology.orchestra.run.smithi139.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T20:58:33.699 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T20:58:33.705 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T20:58:33.705 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T20:58:33.705 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T20:58:33.706 INFO:teuthology.orchestra.run.smithi139.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T20:58:33.706 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T20:58:33.707 INFO:teuthology.orchestra.run.smithi139.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T20:58:33.707 INFO:teuthology.orchestra.run.smithi139.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T20:58:33.708 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T20:58:33.709 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T20:58:33.710 INFO:teuthology.orchestra.run.smithi161.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T20:58:33.711 INFO:teuthology.orchestra.run.smithi139.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T20:58:33.716 INFO:teuthology.orchestra.run.smithi161.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T20:58:33.717 INFO:teuthology.orchestra.run.smithi161.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T20:58:33.733 INFO:teuthology.orchestra.run.smithi161.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T20:58:33.734 INFO:teuthology.orchestra.run.smithi161.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T20:58:33.735 INFO:teuthology.orchestra.run.smithi161.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T20:58:33.737 INFO:teuthology.orchestra.run.smithi161.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T20:58:33.747 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T20:58:33.764 INFO:teuthology.orchestra.run.smithi139.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T20:58:33.765 INFO:teuthology.orchestra.run.smithi139.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T20:58:33.767 INFO:teuthology.orchestra.run.smithi139.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T20:58:33.767 INFO:teuthology.orchestra.run.smithi139.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T20:58:33.768 INFO:teuthology.orchestra.run.smithi139.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T20:58:33.779 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T20:58:33.785 INFO:teuthology.orchestra.run.smithi139.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T20:58:33.787 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T20:58:33.787 INFO:teuthology.orchestra.run.smithi139.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T20:58:33.787 INFO:teuthology.orchestra.run.smithi139.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T20:58:33.788 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T20:58:33.790 INFO:teuthology.orchestra.run.smithi161.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T20:58:33.790 INFO:teuthology.orchestra.run.smithi139.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T20:58:33.791 INFO:teuthology.orchestra.run.smithi161.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T20:58:33.792 INFO:teuthology.orchestra.run.smithi161.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T20:58:33.792 INFO:teuthology.orchestra.run.smithi161.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T20:58:33.792 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T20:58:33.793 INFO:teuthology.orchestra.run.smithi161.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T20:58:33.794 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T20:58:33.802 INFO:teuthology.orchestra.run.smithi139.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T20:58:33.802 INFO:teuthology.orchestra.run.smithi139.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T20:58:33.803 INFO:teuthology.orchestra.run.smithi139.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T20:58:33.803 INFO:teuthology.orchestra.run.smithi139.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T20:58:33.803 INFO:teuthology.orchestra.run.smithi139.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T20:58:33.804 INFO:teuthology.orchestra.run.smithi139.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T20:58:33.804 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T20:58:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T20:58:33.813 INFO:teuthology.orchestra.run.smithi161.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T20:58:33.813 INFO:teuthology.orchestra.run.smithi161.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T20:58:33.817 INFO:teuthology.orchestra.run.smithi139.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T20:58:33.818 INFO:teuthology.orchestra.run.smithi139.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T20:58:33.821 INFO:teuthology.orchestra.run.smithi139.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T20:58:33.823 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T20:58:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T20:58:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T20:58:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T20:58:33.827 INFO:teuthology.orchestra.run.smithi161.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T20:58:33.828 INFO:teuthology.orchestra.run.smithi161.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T20:58:33.828 INFO:teuthology.orchestra.run.smithi161.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T20:58:33.829 INFO:teuthology.orchestra.run.smithi161.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T20:58:33.834 INFO:teuthology.orchestra.run.smithi139.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T20:58:33.836 INFO:teuthology.orchestra.run.smithi139.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T20:58:33.836 INFO:teuthology.orchestra.run.smithi139.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T20:58:33.839 INFO:teuthology.orchestra.run.smithi139.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T20:58:33.842 INFO:teuthology.orchestra.run.smithi139.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T20:58:33.842 INFO:teuthology.orchestra.run.smithi139.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T20:58:33.843 INFO:teuthology.orchestra.run.smithi139.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T20:58:33.848 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T20:58:33.851 INFO:teuthology.orchestra.run.smithi139.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T20:58:33.852 INFO:teuthology.orchestra.run.smithi139.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T20:58:33.854 INFO:teuthology.orchestra.run.smithi139.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T20:58:33.861 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T20:58:33.862 INFO:teuthology.orchestra.run.smithi161.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T20:58:33.862 INFO:teuthology.orchestra.run.smithi161.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T20:58:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T20:58:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T20:58:33.868 INFO:teuthology.orchestra.run.smithi139.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T20:58:33.868 INFO:teuthology.orchestra.run.smithi161.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T20:58:33.869 INFO:teuthology.orchestra.run.smithi139.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T20:58:33.869 INFO:teuthology.orchestra.run.smithi139.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T20:58:33.869 INFO:teuthology.orchestra.run.smithi161.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T20:58:33.870 INFO:teuthology.orchestra.run.smithi139.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T20:58:33.871 INFO:teuthology.orchestra.run.smithi139.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T20:58:33.872 INFO:teuthology.orchestra.run.smithi161.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T20:58:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T20:58:33.877 INFO:teuthology.orchestra.run.smithi139.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T20:58:33.877 INFO:teuthology.orchestra.run.smithi139.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T20:58:33.879 INFO:teuthology.orchestra.run.smithi161.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T20:58:33.885 INFO:teuthology.orchestra.run.smithi139.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T20:58:33.887 INFO:teuthology.orchestra.run.smithi139.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T20:58:33.888 INFO:teuthology.orchestra.run.smithi139.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T20:58:33.892 INFO:teuthology.orchestra.run.smithi161.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T20:58:33.896 INFO:teuthology.orchestra.run.smithi161.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T20:58:33.896 INFO:teuthology.orchestra.run.smithi161.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T20:58:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T20:58:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T20:58:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T20:58:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T20:58:33.902 INFO:teuthology.orchestra.run.smithi161.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T20:58:33.902 INFO:teuthology.orchestra.run.smithi161.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T20:58:33.912 INFO:teuthology.orchestra.run.smithi161.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T20:58:33.929 INFO:teuthology.orchestra.run.smithi161.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T20:58:33.930 INFO:teuthology.orchestra.run.smithi161.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T20:58:33.932 INFO:teuthology.orchestra.run.smithi161.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T20:58:33.932 INFO:teuthology.orchestra.run.smithi161.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T20:58:33.941 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T20:58:33.957 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T20:58:33.970 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T20:58:33.992 INFO:teuthology.orchestra.run.smithi139.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T20:58:34.008 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T20:58:34.034 INFO:teuthology.orchestra.run.smithi161.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T20:58:34.051 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T20:58:34.056 INFO:teuthology.orchestra.run.smithi139.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T20:58:34.063 INFO:teuthology.orchestra.run.smithi139.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T20:58:34.064 INFO:teuthology.orchestra.run.smithi139.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T20:58:34.068 INFO:teuthology.orchestra.run.smithi139.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T20:58:34.070 INFO:teuthology.orchestra.run.smithi139.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T20:58:34.073 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T20:58:34.080 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T20:58:34.082 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T20:58:34.085 INFO:teuthology.orchestra.run.smithi203.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T20:58:34.087 INFO:teuthology.orchestra.run.smithi203.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T20:58:34.100 INFO:teuthology.orchestra.run.smithi161.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T20:58:34.107 INFO:teuthology.orchestra.run.smithi161.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T20:58:34.109 INFO:teuthology.orchestra.run.smithi161.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T20:58:34.113 INFO:teuthology.orchestra.run.smithi161.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T20:58:34.115 INFO:teuthology.orchestra.run.smithi161.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T20:58:34.128 INFO:teuthology.orchestra.run.smithi139.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T20:58:34.146 INFO:teuthology.orchestra.run.smithi203.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T20:58:34.170 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T20:58:34.173 INFO:teuthology.orchestra.run.smithi161.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T20:58:34.181 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T20:58:34.198 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T20:58:34.201 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T20:58:34.210 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T20:58:34.219 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T20:58:34.220 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T20:58:34.221 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T20:58:34.239 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T20:58:34.242 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T20:58:34.243 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T20:58:34.247 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T20:58:34.252 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T20:58:34.281 INFO:teuthology.orchestra.run.smithi203.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T20:58:34.291 INFO:teuthology.orchestra.run.smithi203.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T20:58:34.321 INFO:teuthology.orchestra.run.smithi203.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T20:58:34.330 INFO:teuthology.orchestra.run.smithi203.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T20:58:34.331 INFO:teuthology.orchestra.run.smithi203.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T20:58:34.332 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T20:58:34.332 INFO:teuthology.orchestra.run.smithi203.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T20:58:34.336 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T20:58:34.340 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T20:58:34.343 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T20:58:34.344 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T20:58:34.345 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T20:58:34.347 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T20:58:34.347 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T20:58:34.348 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T20:58:34.350 INFO:teuthology.orchestra.run.smithi203.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T20:58:34.354 INFO:teuthology.orchestra.run.smithi203.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T20:58:34.358 INFO:teuthology.orchestra.run.smithi203.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T20:58:34.363 INFO:teuthology.orchestra.run.smithi203.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T20:58:34.414 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T20:58:34.430 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T20:58:34.430 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T20:58:34.431 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T20:58:34.436 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T20:58:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T20:58:34.443 INFO:teuthology.orchestra.run.smithi203.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T20:58:34.447 INFO:teuthology.orchestra.run.smithi203.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T20:58:34.452 INFO:teuthology.orchestra.run.smithi203.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T20:58:34.456 INFO:teuthology.orchestra.run.smithi203.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T20:58:34.457 INFO:teuthology.orchestra.run.smithi203.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T20:58:34.457 INFO:teuthology.orchestra.run.smithi203.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T20:58:34.460 INFO:teuthology.orchestra.run.smithi203.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T20:58:34.460 INFO:teuthology.orchestra.run.smithi203.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T20:58:34.461 INFO:teuthology.orchestra.run.smithi203.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T20:58:34.496 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T20:58:34.496 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T20:58:34.498 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T20:58:34.499 INFO:teuthology.orchestra.run.smithi112.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T20:58:34.526 INFO:teuthology.orchestra.run.smithi203.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T20:58:34.543 INFO:teuthology.orchestra.run.smithi203.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T20:58:34.544 INFO:teuthology.orchestra.run.smithi203.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T20:58:34.545 INFO:teuthology.orchestra.run.smithi203.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T20:58:34.550 INFO:teuthology.orchestra.run.smithi203.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T20:58:34.551 INFO:teuthology.orchestra.run.smithi203.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T20:58:34.577 INFO:teuthology.orchestra.run.smithi112.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T20:58:34.578 INFO:teuthology.orchestra.run.smithi203.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T20:58:34.579 INFO:teuthology.orchestra.run.smithi112.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T20:58:34.580 INFO:teuthology.orchestra.run.smithi112.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T20:58:34.581 INFO:teuthology.orchestra.run.smithi112.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T20:58:34.592 INFO:teuthology.orchestra.run.smithi112.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T20:58:34.596 INFO:teuthology.orchestra.run.smithi161.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T20:58:34.608 INFO:teuthology.orchestra.run.smithi203.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T20:58:34.609 INFO:teuthology.orchestra.run.smithi203.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T20:58:34.611 INFO:teuthology.orchestra.run.smithi203.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T20:58:34.612 INFO:teuthology.orchestra.run.smithi203.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T20:58:34.622 INFO:teuthology.orchestra.run.smithi203.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T20:58:34.626 INFO:teuthology.orchestra.run.smithi139.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T20:58:34.628 INFO:teuthology.orchestra.run.smithi139.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T20:58:34.632 INFO:teuthology.orchestra.run.smithi203.stdout:Get:45 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T20:58:34.638 INFO:teuthology.orchestra.run.smithi139.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T20:58:34.638 INFO:teuthology.orchestra.run.smithi161.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T20:58:34.649 INFO:teuthology.orchestra.run.smithi161.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T20:58:34.658 INFO:teuthology.orchestra.run.smithi112.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T20:58:34.659 INFO:teuthology.orchestra.run.smithi112.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T20:58:34.660 INFO:teuthology.orchestra.run.smithi112.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T20:58:34.662 INFO:teuthology.orchestra.run.smithi112.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T20:58:34.666 INFO:teuthology.orchestra.run.smithi112.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T20:58:34.689 INFO:teuthology.orchestra.run.smithi203.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T20:58:34.692 INFO:teuthology.orchestra.run.smithi203.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T20:58:34.693 INFO:teuthology.orchestra.run.smithi203.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T20:58:34.694 INFO:teuthology.orchestra.run.smithi203.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T20:58:34.705 INFO:teuthology.orchestra.run.smithi203.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T20:58:34.739 INFO:teuthology.orchestra.run.smithi112.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T20:58:34.741 INFO:teuthology.orchestra.run.smithi112.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T20:58:34.743 INFO:teuthology.orchestra.run.smithi112.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T20:58:34.748 INFO:teuthology.orchestra.run.smithi112.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T20:58:34.749 INFO:teuthology.orchestra.run.smithi112.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T20:58:34.771 INFO:teuthology.orchestra.run.smithi203.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T20:58:34.772 INFO:teuthology.orchestra.run.smithi203.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T20:58:34.773 INFO:teuthology.orchestra.run.smithi203.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T20:58:34.775 INFO:teuthology.orchestra.run.smithi203.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T20:58:34.779 INFO:teuthology.orchestra.run.smithi203.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T20:58:34.820 INFO:teuthology.orchestra.run.smithi112.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T20:58:34.825 INFO:teuthology.orchestra.run.smithi112.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T20:58:34.852 INFO:teuthology.orchestra.run.smithi203.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T20:58:34.855 INFO:teuthology.orchestra.run.smithi203.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T20:58:34.856 INFO:teuthology.orchestra.run.smithi203.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T20:58:34.861 INFO:teuthology.orchestra.run.smithi203.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T20:58:34.862 INFO:teuthology.orchestra.run.smithi203.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T20:58:34.934 INFO:teuthology.orchestra.run.smithi203.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T20:58:34.939 INFO:teuthology.orchestra.run.smithi203.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T20:58:34.987 INFO:teuthology.orchestra.run.smithi112.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T20:58:34.988 INFO:teuthology.orchestra.run.smithi112.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T20:58:34.991 INFO:teuthology.orchestra.run.smithi112.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T20:58:34.991 INFO:teuthology.orchestra.run.smithi112.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T20:58:34.993 INFO:teuthology.orchestra.run.smithi112.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T20:58:35.029 INFO:teuthology.orchestra.run.smithi112.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T20:58:35.032 INFO:teuthology.orchestra.run.smithi112.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T20:58:35.032 INFO:teuthology.orchestra.run.smithi112.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T20:58:35.089 INFO:teuthology.orchestra.run.smithi112.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T20:58:35.089 INFO:teuthology.orchestra.run.smithi112.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T20:58:35.102 INFO:teuthology.orchestra.run.smithi203.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T20:58:35.104 INFO:teuthology.orchestra.run.smithi203.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T20:58:35.106 INFO:teuthology.orchestra.run.smithi203.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T20:58:35.107 INFO:teuthology.orchestra.run.smithi203.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T20:58:35.109 INFO:teuthology.orchestra.run.smithi203.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T20:58:35.146 INFO:teuthology.orchestra.run.smithi203.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T20:58:35.149 INFO:teuthology.orchestra.run.smithi203.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T20:58:35.150 INFO:teuthology.orchestra.run.smithi203.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T20:58:35.152 INFO:teuthology.orchestra.run.smithi112.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T20:58:35.154 INFO:teuthology.orchestra.run.smithi112.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T20:58:35.154 INFO:teuthology.orchestra.run.smithi112.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T20:58:35.155 INFO:teuthology.orchestra.run.smithi112.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T20:58:35.156 INFO:teuthology.orchestra.run.smithi112.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T20:58:35.157 INFO:teuthology.orchestra.run.smithi112.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T20:58:35.163 INFO:teuthology.orchestra.run.smithi112.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T20:58:35.206 INFO:teuthology.orchestra.run.smithi203.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T20:58:35.207 INFO:teuthology.orchestra.run.smithi203.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T20:58:35.234 INFO:teuthology.orchestra.run.smithi112.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T20:58:35.237 INFO:teuthology.orchestra.run.smithi112.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T20:58:35.238 INFO:teuthology.orchestra.run.smithi112.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T20:58:35.269 INFO:teuthology.orchestra.run.smithi203.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T20:58:35.270 INFO:teuthology.orchestra.run.smithi203.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T20:58:35.270 INFO:teuthology.orchestra.run.smithi203.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T20:58:35.272 INFO:teuthology.orchestra.run.smithi203.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T20:58:35.272 INFO:teuthology.orchestra.run.smithi203.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T20:58:35.273 INFO:teuthology.orchestra.run.smithi203.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T20:58:35.280 INFO:teuthology.orchestra.run.smithi203.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T20:58:35.315 INFO:teuthology.orchestra.run.smithi112.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T20:58:35.321 INFO:teuthology.orchestra.run.smithi112.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T20:58:35.323 INFO:teuthology.orchestra.run.smithi112.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T20:58:35.325 INFO:teuthology.orchestra.run.smithi112.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T20:58:35.336 INFO:teuthology.orchestra.run.smithi112.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T20:58:35.337 INFO:teuthology.orchestra.run.smithi112.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T20:58:35.344 INFO:teuthology.orchestra.run.smithi112.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T20:58:35.351 INFO:teuthology.orchestra.run.smithi203.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T20:58:35.354 INFO:teuthology.orchestra.run.smithi203.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T20:58:35.355 INFO:teuthology.orchestra.run.smithi203.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T20:58:35.396 INFO:teuthology.orchestra.run.smithi112.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T20:58:35.398 INFO:teuthology.orchestra.run.smithi112.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T20:58:35.398 INFO:teuthology.orchestra.run.smithi112.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T20:58:35.432 INFO:teuthology.orchestra.run.smithi203.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T20:58:35.438 INFO:teuthology.orchestra.run.smithi203.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T20:58:35.440 INFO:teuthology.orchestra.run.smithi203.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T20:58:35.442 INFO:teuthology.orchestra.run.smithi203.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T20:58:35.453 INFO:teuthology.orchestra.run.smithi203.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T20:58:35.454 INFO:teuthology.orchestra.run.smithi203.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T20:58:35.462 INFO:teuthology.orchestra.run.smithi203.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T20:58:35.477 INFO:teuthology.orchestra.run.smithi112.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T20:58:35.479 INFO:teuthology.orchestra.run.smithi112.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T20:58:35.497 INFO:teuthology.orchestra.run.smithi112.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T20:58:35.497 INFO:teuthology.orchestra.run.smithi112.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T20:58:35.498 INFO:teuthology.orchestra.run.smithi112.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T20:58:35.503 INFO:teuthology.orchestra.run.smithi112.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T20:58:35.504 INFO:teuthology.orchestra.run.smithi112.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T20:58:35.513 INFO:teuthology.orchestra.run.smithi203.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T20:58:35.515 INFO:teuthology.orchestra.run.smithi203.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T20:58:35.516 INFO:teuthology.orchestra.run.smithi203.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T20:58:35.595 INFO:teuthology.orchestra.run.smithi203.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T20:58:35.597 INFO:teuthology.orchestra.run.smithi203.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T20:58:35.614 INFO:teuthology.orchestra.run.smithi203.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T20:58:35.615 INFO:teuthology.orchestra.run.smithi203.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T20:58:35.616 INFO:teuthology.orchestra.run.smithi203.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T20:58:35.621 INFO:teuthology.orchestra.run.smithi203.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T20:58:35.622 INFO:teuthology.orchestra.run.smithi203.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T20:58:35.778 INFO:teuthology.orchestra.run.smithi112.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T20:58:36.023 INFO:teuthology.orchestra.run.smithi112.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T20:58:36.047 INFO:teuthology.orchestra.run.smithi112.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T20:58:36.049 INFO:teuthology.orchestra.run.smithi112.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T20:58:36.126 INFO:teuthology.orchestra.run.smithi112.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T20:58:36.483 INFO:teuthology.orchestra.run.smithi161.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T20:58:36.484 INFO:teuthology.orchestra.run.smithi112.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T20:58:36.522 INFO:teuthology.orchestra.run.smithi139.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T20:58:36.536 INFO:teuthology.orchestra.run.smithi203.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T20:58:36.770 INFO:teuthology.orchestra.run.smithi161.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T20:58:36.775 INFO:teuthology.orchestra.run.smithi161.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T20:58:36.790 INFO:teuthology.orchestra.run.smithi161.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T20:58:36.809 INFO:teuthology.orchestra.run.smithi139.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T20:58:36.812 INFO:teuthology.orchestra.run.smithi203.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T20:58:36.817 INFO:teuthology.orchestra.run.smithi203.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T20:58:36.820 INFO:teuthology.orchestra.run.smithi203.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T20:58:36.847 INFO:teuthology.orchestra.run.smithi139.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T20:58:36.850 INFO:teuthology.orchestra.run.smithi139.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T20:58:36.910 INFO:teuthology.orchestra.run.smithi203.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T20:58:36.914 INFO:teuthology.orchestra.run.smithi161.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T20:58:36.955 INFO:teuthology.orchestra.run.smithi139.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T20:58:37.307 INFO:teuthology.orchestra.run.smithi161.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T20:58:37.352 INFO:teuthology.orchestra.run.smithi203.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T20:58:37.386 INFO:teuthology.orchestra.run.smithi139.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T20:58:37.855 INFO:teuthology.orchestra.run.smithi112.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T20:58:37.856 INFO:teuthology.orchestra.run.smithi112.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T20:58:37.873 INFO:teuthology.orchestra.run.smithi112.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T20:58:37.970 INFO:teuthology.orchestra.run.smithi112.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T20:58:38.015 INFO:teuthology.orchestra.run.smithi112.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T20:58:38.018 INFO:teuthology.orchestra.run.smithi112.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T20:58:38.249 INFO:teuthology.orchestra.run.smithi112.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T20:58:38.732 INFO:teuthology.orchestra.run.smithi112.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T20:58:38.732 INFO:teuthology.orchestra.run.smithi112.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T20:58:38.927 INFO:teuthology.orchestra.run.smithi203.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T20:58:38.928 INFO:teuthology.orchestra.run.smithi203.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T20:58:38.945 INFO:teuthology.orchestra.run.smithi203.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T20:58:38.961 INFO:teuthology.orchestra.run.smithi139.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T20:58:38.962 INFO:teuthology.orchestra.run.smithi139.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T20:58:38.979 INFO:teuthology.orchestra.run.smithi139.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T20:58:39.044 INFO:teuthology.orchestra.run.smithi203.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T20:58:39.061 INFO:teuthology.orchestra.run.smithi203.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T20:58:39.064 INFO:teuthology.orchestra.run.smithi203.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T20:58:39.068 INFO:teuthology.orchestra.run.smithi139.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T20:58:39.075 INFO:teuthology.orchestra.run.smithi161.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T20:58:39.076 INFO:teuthology.orchestra.run.smithi161.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T20:58:39.093 INFO:teuthology.orchestra.run.smithi161.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T20:58:39.096 INFO:teuthology.orchestra.run.smithi139.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T20:58:39.099 INFO:teuthology.orchestra.run.smithi139.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T20:58:39.205 INFO:teuthology.orchestra.run.smithi203.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T20:58:39.241 INFO:teuthology.orchestra.run.smithi139.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T20:58:39.262 INFO:teuthology.orchestra.run.smithi161.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T20:58:39.331 INFO:teuthology.orchestra.run.smithi161.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T20:58:39.334 INFO:teuthology.orchestra.run.smithi161.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T20:58:39.542 INFO:teuthology.orchestra.run.smithi161.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T20:58:39.711 INFO:teuthology.orchestra.run.smithi203.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T20:58:39.743 INFO:teuthology.orchestra.run.smithi203.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T20:58:39.784 INFO:teuthology.orchestra.run.smithi139.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T20:58:39.785 INFO:teuthology.orchestra.run.smithi139.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T20:58:40.202 INFO:teuthology.orchestra.run.smithi161.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T20:58:40.202 INFO:teuthology.orchestra.run.smithi161.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T20:58:42.372 INFO:teuthology.orchestra.run.smithi112.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T20:58:42.374 INFO:teuthology.orchestra.run.smithi112.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T20:58:42.375 INFO:teuthology.orchestra.run.smithi112.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T20:58:43.073 INFO:teuthology.orchestra.run.smithi112.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T20:58:43.083 INFO:teuthology.orchestra.run.smithi203.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T20:58:43.086 INFO:teuthology.orchestra.run.smithi203.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T20:58:43.087 INFO:teuthology.orchestra.run.smithi203.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T20:58:43.147 INFO:teuthology.orchestra.run.smithi139.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T20:58:43.149 INFO:teuthology.orchestra.run.smithi139.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T20:58:43.151 INFO:teuthology.orchestra.run.smithi139.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T20:58:43.541 INFO:teuthology.orchestra.run.smithi203.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T20:58:43.609 INFO:teuthology.orchestra.run.smithi139.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T20:58:43.645 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 181 MB in 10s (18.4 MB/s) 2024-09-20T20:58:43.823 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T20:58:43.916 INFO:teuthology.orchestra.run.smithi161.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T20:58:43.918 INFO:teuthology.orchestra.run.smithi161.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T20:58:43.919 INFO:teuthology.orchestra.run.smithi161.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T20:58:43.924 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T20:58:43.930 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T20:58:44.014 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:58:44.111 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 181 MB in 10s (17.8 MB/s) 2024-09-20T20:58:44.152 INFO:teuthology.orchestra.run.smithi161.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T20:58:44.178 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 181 MB in 10s (17.6 MB/s) 2024-09-20T20:58:44.249 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T20:58:44.343 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T20:58:44.347 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T20:58:44.353 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T20:58:44.416 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T20:58:44.439 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:58:44.443 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T20:58:44.443 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T20:58:44.449 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T20:58:44.483 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:58:44.533 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:58:44.724 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 181 MB in 11s (16.8 MB/s) 2024-09-20T20:58:44.759 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T20:58:44.786 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T20:58:44.818 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:58:44.819 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T20:58:44.845 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T20:58:44.846 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T20:58:44.871 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T20:58:44.886 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:58:44.887 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T20:58:44.911 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:58:44.988 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T20:58:44.993 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T20:58:45.078 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:58:45.138 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T20:58:45.164 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T20:58:45.204 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:58:45.215 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T20:58:45.241 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T20:58:45.281 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T20:58:45.282 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:58:45.308 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:45.356 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:45.498 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T20:58:45.524 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T20:58:45.573 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:58:45.650 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T20:58:45.676 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:45.724 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:45.726 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T20:58:45.726 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T20:58:45.752 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:45.753 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:45.784 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:45.802 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:45.934 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T20:58:45.960 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T20:58:46.000 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:58:46.086 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T20:58:46.112 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:46.120 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T20:58:46.147 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:46.171 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:46.187 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:46.430 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T20:58:46.456 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:46.479 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T20:58:46.488 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:46.505 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:46.532 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T20:58:46.559 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T20:58:46.561 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:46.598 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:58:46.723 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T20:58:46.750 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:46.790 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:46.849 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T20:58:46.875 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:46.893 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librados2. 2024-09-20T20:58:46.916 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:46.920 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:46.960 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:47.015 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T20:58:47.041 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:47.090 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:47.160 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T20:58:47.186 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T20:58:47.226 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:58:47.261 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T20:58:47.287 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T20:58:47.327 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:58:47.387 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librbd1. 2024-09-20T20:58:47.414 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:47.418 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T20:58:47.444 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:58:47.454 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:47.484 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:58:47.546 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librados2. 2024-09-20T20:58:47.573 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:47.613 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:47.671 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librados2. 2024-09-20T20:58:47.698 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:47.738 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:47.846 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T20:58:47.857 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T20:58:47.872 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T20:58:47.883 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:47.912 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:58:47.923 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:48.058 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librbd1. 2024-09-20T20:58:48.084 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:48.124 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:48.208 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librbd1. 2024-09-20T20:58:48.226 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rados. 2024-09-20T20:58:48.234 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:48.274 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:48.292 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:48.298 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librados2. 2024-09-20T20:58:48.324 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:48.373 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:48.568 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T20:58:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T20:58:48.594 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:58:48.595 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:48.628 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:48.635 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:48.694 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T20:58:48.720 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:48.752 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:48.867 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librbd1. 2024-09-20T20:58:48.872 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T20:58:48.888 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:48.893 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:48.929 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rados. 2024-09-20T20:58:48.931 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:48.934 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:48.956 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:48.996 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:49.013 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rados. 2024-09-20T20:58:49.039 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:49.079 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:49.234 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T20:58:49.260 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:58:49.291 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T20:58:49.300 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:49.306 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:58:49.340 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:49.362 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T20:58:49.388 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:49.407 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T20:58:49.428 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:49.434 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:58:49.474 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:49.568 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T20:58:49.595 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:49.620 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T20:58:49.635 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:49.646 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T20:58:49.686 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:58:49.726 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T20:58:49.731 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rados. 2024-09-20T20:58:49.741 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:49.757 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:49.784 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:49.806 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:49.954 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T20:58:49.981 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:58:50.021 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:50.071 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T20:58:50.093 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:58:50.129 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:50.192 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T20:58:50.218 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:58:50.267 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:50.333 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T20:58:50.359 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T20:58:50.399 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:58:50.449 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T20:58:50.475 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T20:58:50.515 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:58:50.569 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T20:58:50.596 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:50.635 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:50.640 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T20:58:50.666 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T20:58:50.698 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T20:58:50.727 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T20:58:50.754 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T20:58:50.794 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T20:58:50.818 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T20:58:50.844 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T20:58:50.885 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T20:58:50.926 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T20:58:50.946 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T20:58:50.951 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:50.973 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:58:50.992 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:51.022 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:51.055 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T20:58:51.070 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:51.103 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T20:58:51.105 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:51.119 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:51.153 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:51.320 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T20:58:51.346 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T20:58:51.358 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T20:58:51.384 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T20:58:51.386 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:58:51.424 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:58:51.576 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T20:58:51.602 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T20:58:51.606 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T20:58:51.632 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T20:58:51.642 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:58:51.690 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:58:51.698 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T20:58:51.724 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T20:58:51.764 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:58:51.936 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T20:58:51.951 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T20:58:51.968 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T20:58:51.983 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T20:58:51.994 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:58:52.026 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:58:52.069 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T20:58:52.075 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T20:58:52.096 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T20:58:52.101 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T20:58:52.133 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:58:52.143 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T20:58:52.306 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T20:58:52.312 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T20:58:52.321 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T20:58:52.327 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T20:58:52.356 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:58:52.362 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:58:52.446 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T20:58:52.453 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua5.1. 2024-09-20T20:58:52.461 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:52.479 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T20:58:52.513 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:52.520 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:58:52.676 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua5.1. 2024-09-20T20:58:52.699 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package lua5.1. 2024-09-20T20:58:52.702 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T20:58:52.725 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T20:58:52.742 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:58:52.765 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:58:52.823 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-any. 2024-09-20T20:58:52.849 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T20:58:52.857 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T20:58:52.884 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T20:58:52.890 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T20:58:52.924 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:58:53.063 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-any. 2024-09-20T20:58:53.089 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T20:58:53.093 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package lua-any. 2024-09-20T20:58:53.108 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T20:58:53.126 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package zip. 2024-09-20T20:58:53.129 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T20:58:53.141 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T20:58:53.152 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T20:58:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T20:58:53.201 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T20:58:53.217 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T20:58:53.260 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:58:53.362 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package zip. 2024-09-20T20:58:53.374 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package zip. 2024-09-20T20:58:53.378 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T20:58:53.400 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T20:58:53.412 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T20:58:53.429 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package unzip. 2024-09-20T20:58:53.432 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T20:58:53.444 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T20:58:53.487 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:58:53.579 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T20:58:53.594 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T20:58:53.645 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:58:53.716 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package unzip. 2024-09-20T20:58:53.719 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package unzip. 2024-09-20T20:58:53.742 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T20:58:53.745 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T20:58:53.782 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:58:53.785 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:58:53.874 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package luarocks. 2024-09-20T20:58:53.900 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T20:58:53.941 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:58:53.974 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua5.1. 2024-09-20T20:58:54.000 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T20:58:54.040 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:58:54.111 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package luarocks. 2024-09-20T20:58:54.137 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T20:58:54.177 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:58:54.181 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package luarocks. 2024-09-20T20:58:54.208 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T20:58:54.248 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:58:54.316 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librgw2. 2024-09-20T20:58:54.342 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:54.368 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua-any. 2024-09-20T20:58:54.382 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:54.384 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T20:58:54.443 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T20:58:54.585 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librgw2. 2024-09-20T20:58:54.612 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:54.631 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librgw2. 2024-09-20T20:58:54.652 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:54.658 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:54.695 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package zip. 2024-09-20T20:58:54.706 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:54.719 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T20:58:54.779 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T20:58:54.918 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T20:58:54.933 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:54.967 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:55.049 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package unzip. 2024-09-20T20:58:55.064 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T20:58:55.098 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:58:55.187 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T20:58:55.203 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:55.237 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:55.275 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T20:58:55.279 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T20:58:55.291 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:55.305 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T20:58:55.334 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:55.345 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:58:55.486 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package luarocks. 2024-09-20T20:58:55.512 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T20:58:55.534 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T20:58:55.552 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:58:55.560 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T20:58:55.617 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:58:55.704 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T20:58:55.730 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T20:58:55.770 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:58:55.840 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T20:58:55.867 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:55.940 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2. 2024-09-20T20:58:55.940 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T20:58:55.941 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:55.946 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:55.955 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:55.986 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:55.995 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:56.107 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T20:58:56.133 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:56.173 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:56.344 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-common. 2024-09-20T20:58:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:56.373 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-common. 2024-09-20T20:58:56.399 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:56.410 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:56.431 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:56.514 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T20:58:56.529 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:56.552 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-common. 2024-09-20T20:58:56.564 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:56.578 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:56.618 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:56.909 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T20:58:56.935 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T20:58:57.000 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:58:57.311 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T20:58:57.338 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:57.378 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:57.665 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-base. 2024-09-20T20:58:57.692 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:57.733 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:57.764 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common. 2024-09-20T20:58:57.791 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:57.822 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:57.836 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-base. 2024-09-20T20:58:57.863 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:57.911 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:58.074 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-base. 2024-09-20T20:58:58.100 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:58.150 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:58.286 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T20:58:58.313 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T20:58:58.353 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:58:58.423 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T20:58:58.439 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T20:58:58.473 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:58:58.631 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T20:58:58.657 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T20:58:58.697 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:58:58.737 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T20:58:58.751 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T20:58:58.763 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T20:58:58.778 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T20:58:58.803 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:58:58.818 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:58:59.017 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T20:58:59.044 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T20:58:59.074 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T20:58:59.083 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:58:59.101 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T20:58:59.132 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:58:59.146 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T20:58:59.172 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T20:58:59.211 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-base. 2024-09-20T20:58:59.212 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:58:59.238 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:58:59.288 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:58:59.345 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T20:58:59.371 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T20:58:59.403 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:58:59.435 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T20:58:59.461 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T20:58:59.501 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:58:59.515 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T20:58:59.541 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T20:58:59.581 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:58:59.731 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T20:58:59.758 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T20:58:59.797 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:58:59.804 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T20:58:59.831 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T20:58:59.871 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:58:59.876 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T20:58:59.902 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T20:58:59.907 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T20:58:59.934 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T20:58:59.942 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:58:59.982 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:59:00.100 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T20:59:00.127 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T20:59:00.183 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T20:59:00.184 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T20:59:00.203 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T20:59:00.209 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T20:59:00.219 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T20:59:00.253 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T20:59:00.274 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:59:00.352 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T20:59:00.378 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T20:59:00.427 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:59:00.461 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-portend. 2024-09-20T20:59:00.488 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T20:59:00.519 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T20:59:00.531 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-portend. 2024-09-20T20:59:00.544 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T20:59:00.557 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T20:59:00.570 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T20:59:00.597 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T20:59:00.610 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T20:59:00.798 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T20:59:00.805 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T20:59:00.824 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T20:59:00.831 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T20:59:00.864 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T20:59:00.871 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:59:00.901 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T20:59:00.914 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-portend. 2024-09-20T20:59:00.927 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T20:59:00.940 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T20:59:00.967 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T20:59:00.980 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T20:59:01.167 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T20:59:01.183 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T20:59:01.193 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T20:59:01.209 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T20:59:01.233 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:59:01.249 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:59:01.253 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T20:59:01.268 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T20:59:01.283 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T20:59:01.303 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:59:01.310 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T20:59:01.350 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T20:59:01.579 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T20:59:01.594 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T20:59:01.602 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T20:59:01.628 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T20:59:01.629 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T20:59:01.657 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T20:59:01.677 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:59:01.683 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T20:59:01.723 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T20:59:01.853 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T20:59:01.880 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T20:59:01.912 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:59:01.932 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T20:59:01.958 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T20:59:01.998 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T20:59:02.009 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T20:59:02.025 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T20:59:02.046 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T20:59:02.059 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T20:59:02.073 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T20:59:02.285 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T20:59:02.311 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T20:59:02.321 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T20:59:02.332 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T20:59:02.351 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:59:02.359 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T20:59:02.362 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T20:59:02.388 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T20:59:02.399 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T20:59:02.428 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:59:02.646 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-mako. 2024-09-20T20:59:02.666 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-portend. 2024-09-20T20:59:02.672 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T20:59:02.693 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T20:59:02.694 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T20:59:02.712 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:59:02.720 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T20:59:02.731 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-mako. 2024-09-20T20:59:02.732 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T20:59:02.757 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T20:59:02.760 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T20:59:02.797 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:59:03.016 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T20:59:03.022 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T20:59:03.035 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T20:59:03.042 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T20:59:03.048 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T20:59:03.062 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T20:59:03.074 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:59:03.080 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:59:03.102 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T20:59:03.143 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T20:59:03.169 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T20:59:03.209 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:59:03.366 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-mako. 2024-09-20T20:59:03.368 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T20:59:03.393 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T20:59:03.395 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T20:59:03.433 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:59:03.434 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:59:03.463 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T20:59:03.487 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T20:59:03.490 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T20:59:03.514 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T20:59:03.538 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:59:03.545 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:59:03.762 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webob. 2024-09-20T20:59:03.786 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T20:59:03.788 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T20:59:03.813 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T20:59:03.829 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:59:03.853 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:59:03.856 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webob. 2024-09-20T20:59:03.883 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T20:59:03.892 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T20:59:03.918 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T20:59:03.922 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:59:03.958 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T20:59:04.156 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T20:59:04.165 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T20:59:04.182 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T20:59:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T20:59:04.222 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:59:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:59:04.259 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T20:59:04.270 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T20:59:04.286 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T20:59:04.296 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T20:59:04.320 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:59:04.336 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T20:59:04.492 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-webob. 2024-09-20T20:59:04.507 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T20:59:04.542 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:59:04.543 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T20:59:04.569 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T20:59:04.603 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T20:59:04.610 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:59:04.630 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T20:59:04.639 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T20:59:04.666 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T20:59:04.670 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:59:04.714 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:59:04.871 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-paste. 2024-09-20T20:59:04.897 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T20:59:04.904 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T20:59:04.930 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T20:59:04.937 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:59:04.974 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:59:04.981 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-paste. 2024-09-20T20:59:04.984 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-mako. 2024-09-20T20:59:05.008 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T20:59:05.010 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T20:59:05.042 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:59:05.047 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:59:05.266 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T20:59:05.281 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T20:59:05.282 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T20:59:05.308 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T20:59:05.332 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:59:05.342 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T20:59:05.357 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:59:05.358 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T20:59:05.387 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T20:59:05.400 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:59:05.413 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T20:59:05.470 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:59:05.585 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T20:59:05.600 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T20:59:05.643 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:59:05.660 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-paste. 2024-09-20T20:59:05.686 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T20:59:05.703 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T20:59:05.726 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:59:05.730 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T20:59:05.769 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:59:05.773 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T20:59:05.799 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T20:59:05.839 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:59:05.947 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T20:59:05.972 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T20:59:06.013 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T20:59:06.055 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T20:59:06.073 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T20:59:06.081 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T20:59:06.100 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T20:59:06.113 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:59:06.134 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webob. 2024-09-20T20:59:06.139 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T20:59:06.160 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T20:59:06.192 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:59:06.333 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T20:59:06.359 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T20:59:06.399 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:59:06.400 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T20:59:06.426 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T20:59:06.450 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T20:59:06.466 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:59:06.477 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T20:59:06.487 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T20:59:06.513 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T20:59:06.517 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:59:06.556 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:59:07.580 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T20:59:07.604 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T20:59:07.607 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T20:59:07.631 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T20:59:07.646 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T20:59:07.670 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T20:59:07.740 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T20:59:07.767 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T20:59:07.807 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:59:07.938 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T20:59:07.939 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T20:59:07.941 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-idna. 2024-09-20T20:59:07.955 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T20:59:07.956 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T20:59:07.965 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T20:59:07.989 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:59:07.990 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:59:08.004 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T20:59:08.110 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-paste. 2024-09-20T20:59:08.136 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T20:59:08.176 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:59:08.299 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-idna. 2024-09-20T20:59:08.302 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T20:59:08.326 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T20:59:08.328 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T20:59:08.328 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T20:59:08.355 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T20:59:08.357 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:59:08.368 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:59:08.386 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T20:59:08.538 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T20:59:08.553 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T20:59:08.596 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:59:08.668 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T20:59:08.680 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests. 2024-09-20T20:59:08.695 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T20:59:08.706 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T20:59:08.714 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-idna. 2024-09-20T20:59:08.735 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:59:08.741 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T20:59:08.746 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:59:08.781 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:59:08.899 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T20:59:08.925 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T20:59:08.965 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:59:09.046 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-requests. 2024-09-20T20:59:09.058 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T20:59:09.073 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T20:59:09.084 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T20:59:09.113 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:59:09.118 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T20:59:09.124 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:59:09.144 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T20:59:09.184 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:59:09.243 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T20:59:09.259 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T20:59:09.293 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T20:59:09.411 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T20:59:09.424 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T20:59:09.426 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:09.451 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T20:59:09.469 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:09.490 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:59:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-requests. 2024-09-20T20:59:09.556 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T20:59:09.563 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T20:59:09.587 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:59:09.589 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T20:59:09.629 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:59:09.785 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T20:59:09.801 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:09.824 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T20:59:09.843 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:09.850 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T20:59:09.882 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:09.901 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T20:59:09.941 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:59:09.984 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T20:59:10.010 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T20:59:10.051 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T20:59:10.168 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T20:59:10.195 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T20:59:10.198 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T20:59:10.214 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:10.219 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T20:59:10.234 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:10.235 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:59:10.248 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:10.269 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:10.379 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-idna. 2024-09-20T20:59:10.405 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T20:59:10.445 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:59:10.526 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T20:59:10.537 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T20:59:10.553 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T20:59:10.564 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T20:59:10.592 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:59:10.604 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T20:59:10.624 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T20:59:10.650 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:10.699 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T20:59:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T20:59:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:59:10.895 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T20:59:10.922 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T20:59:10.949 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T20:59:10.961 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T20:59:10.975 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:11.015 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:11.019 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T20:59:11.046 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T20:59:11.085 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:59:11.193 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests. 2024-09-20T20:59:11.219 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T20:59:11.259 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:59:11.323 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T20:59:11.350 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:11.388 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T20:59:11.389 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:11.403 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T20:59:11.446 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T20:59:11.562 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T20:59:11.577 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T20:59:11.593 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T20:59:11.612 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:59:11.620 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:11.651 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:11.759 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T20:59:11.766 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T20:59:11.782 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:11.786 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:11.816 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:11.817 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:11.898 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T20:59:11.914 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:11.957 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:12.239 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T20:59:12.265 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:12.305 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:12.362 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T20:59:12.370 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T20:59:12.389 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:12.396 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:12.403 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T20:59:12.428 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:12.430 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:12.436 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:12.470 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:12.931 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T20:59:12.958 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T20:59:12.997 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:59:13.099 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T20:59:13.125 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:13.165 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:13.259 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T20:59:13.286 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T20:59:13.325 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T20:59:13.350 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph. 2024-09-20T20:59:13.376 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:13.416 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:13.557 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph. 2024-09-20T20:59:13.583 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:13.623 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:13.670 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T20:59:13.697 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:13.719 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T20:59:13.736 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:13.746 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:13.777 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:13.943 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T20:59:13.969 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:14.009 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:14.131 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T20:59:14.156 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T20:59:14.157 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:14.183 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:14.197 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:14.223 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:14.252 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph. 2024-09-20T20:59:14.267 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:14.302 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:14.337 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T20:59:14.364 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:14.395 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:14.592 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephadm. 2024-09-20T20:59:14.605 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T20:59:14.618 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:14.631 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:14.658 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:14.671 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:14.781 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephadm. 2024-09-20T20:59:14.785 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T20:59:14.808 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:14.811 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:14.843 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:14.848 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:14.969 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T20:59:14.996 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T20:59:15.025 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T20:59:15.036 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T20:59:15.052 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:15.091 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:15.176 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T20:59:15.202 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T20:59:15.242 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T20:59:15.355 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T20:59:15.382 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:59:15.421 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:15.470 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package cephadm. 2024-09-20T20:59:15.496 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:15.536 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:15.553 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T20:59:15.568 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:59:15.603 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:15.831 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T20:59:15.846 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph. 2024-09-20T20:59:15.858 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T20:59:15.862 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:15.897 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T20:59:15.904 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:16.224 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T20:59:16.235 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T20:59:16.250 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:16.251 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:59:16.290 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:16.293 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:16.435 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-babel. 2024-09-20T20:59:16.463 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:59:16.501 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:16.627 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T20:59:16.641 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-babel. 2024-09-20T20:59:16.653 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:16.668 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:59:16.707 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:16.718 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:16.838 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T20:59:16.864 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T20:59:16.904 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:59:17.035 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T20:59:17.062 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T20:59:17.090 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephadm. 2024-09-20T20:59:17.102 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:59:17.114 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:17.154 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:17.274 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T20:59:17.301 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:17.324 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-babel. 2024-09-20T20:59:17.341 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:17.351 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:59:17.390 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:17.463 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T20:59:17.474 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T20:59:17.490 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:17.500 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T20:59:17.529 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:17.540 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T20:59:17.702 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T20:59:17.729 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T20:59:17.735 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T20:59:17.762 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T20:59:17.769 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T20:59:17.802 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:59:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T20:59:17.876 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T20:59:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T20:59:17.903 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:59:17.941 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T20:59:17.943 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:18.013 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-routes. 2024-09-20T20:59:18.040 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T20:59:18.071 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:59:18.139 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T20:59:18.166 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:18.205 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T20:59:18.418 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:18.419 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-routes. 2024-09-20T20:59:18.445 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T20:59:18.458 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:18.485 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:59:18.542 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T20:59:18.568 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T20:59:18.608 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T20:59:18.830 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T20:59:18.857 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:18.887 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-routes. 2024-09-20T20:59:18.896 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:18.913 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T20:59:18.945 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:59:18.965 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-babel. 2024-09-20T20:59:18.992 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:59:19.031 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:19.290 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T20:59:19.317 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:19.351 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T20:59:19.356 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:19.378 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T20:59:19.417 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:59:19.738 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T20:59:19.754 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T20:59:19.787 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T20:59:19.796 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:59:19.814 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:19.854 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:20.190 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T20:59:20.217 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T20:59:20.252 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T20:59:20.256 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T20:59:20.279 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T20:59:20.285 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T20:59:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T20:59:20.326 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:59:20.351 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:59:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-routes. 2024-09-20T20:59:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T20:59:20.587 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T20:59:20.603 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T20:59:20.626 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:59:20.645 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:59:20.713 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T20:59:20.741 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T20:59:20.780 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:59:20.830 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T20:59:20.857 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T20:59:20.896 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:59:20.929 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T20:59:20.956 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:20.987 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:21.049 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T20:59:21.077 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T20:59:21.107 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:59:21.157 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T20:59:21.184 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T20:59:21.223 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:59:21.266 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T20:59:21.293 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T20:59:21.332 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:59:21.585 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T20:59:21.603 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T20:59:21.612 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T20:59:21.630 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T20:59:21.651 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:59:21.669 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:59:21.949 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T20:59:21.977 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:21.997 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T20:59:22.024 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T20:59:22.063 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:59:22.101 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:22.234 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T20:59:22.250 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T20:59:22.292 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:59:22.460 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T20:59:22.488 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:22.620 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:22.796 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T20:59:22.824 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T20:59:23.021 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:59:23.023 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T20:59:23.050 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:23.088 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T20:59:23.115 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T20:59:23.155 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T20:59:23.175 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:23.382 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T20:59:23.410 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T20:59:23.449 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:59:23.458 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T20:59:23.485 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T20:59:23.524 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:59:23.607 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T20:59:23.634 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T20:59:23.673 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T20:59:23.768 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T20:59:23.796 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T20:59:23.803 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T20:59:23.818 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T20:59:23.835 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:59:23.852 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:59:23.976 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T20:59:24.004 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T20:59:24.043 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:59:24.114 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T20:59:24.141 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T20:59:24.180 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T20:59:24.204 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T20:59:24.231 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T20:59:24.271 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T20:59:24.405 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T20:59:24.432 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T20:59:24.471 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:59:24.492 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T20:59:24.519 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T20:59:24.548 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T20:59:24.559 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T20:59:24.568 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T20:59:24.576 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T20:59:24.596 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:24.615 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:59:24.729 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:24.791 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T20:59:24.817 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T20:59:24.857 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T20:59:24.879 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T20:59:24.906 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T20:59:24.919 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T20:59:24.945 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:59:24.946 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T20:59:24.986 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:59:25.136 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T20:59:25.163 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T20:59:25.194 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T20:59:25.215 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T20:59:25.242 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T20:59:25.272 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T20:59:25.273 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T20:59:25.299 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T20:59:25.338 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T20:59:25.488 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T20:59:25.516 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T20:59:25.555 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:59:25.577 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T20:59:25.604 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T20:59:25.643 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:59:25.659 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T20:59:25.665 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T20:59:25.686 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T20:59:25.693 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T20:59:25.725 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T20:59:25.732 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T20:59:25.866 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T20:59:25.893 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T20:59:25.932 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T20:59:26.043 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T20:59:26.054 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T20:59:26.070 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T20:59:26.081 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T20:59:26.110 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:59:26.121 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:59:26.203 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T20:59:26.230 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T20:59:26.257 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T20:59:26.261 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:59:26.273 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:26.315 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:26.407 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T20:59:26.430 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T20:59:26.434 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T20:59:26.457 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T20:59:26.465 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T20:59:26.496 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:59:26.693 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T20:59:26.721 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T20:59:26.759 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:59:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T20:59:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T20:59:26.807 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T20:59:26.835 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T20:59:26.844 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:59:26.866 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T20:59:26.958 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T20:59:26.986 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:27.024 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:27.046 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T20:59:27.073 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:59:27.178 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T20:59:27.205 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T20:59:27.244 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T20:59:27.306 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:59:27.352 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T20:59:27.379 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T20:59:27.418 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:59:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T20:59:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:27.555 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T20:59:27.571 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T20:59:27.574 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package jq. 2024-09-20T20:59:27.575 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:27.601 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:59:27.605 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:59:27.640 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T20:59:27.696 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T20:59:27.724 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:59:27.754 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:59:27.861 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T20:59:27.888 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T20:59:27.994 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:59:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package socat. 2024-09-20T20:59:28.053 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T20:59:28.083 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T20:59:28.101 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:59:28.111 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T20:59:28.150 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T20:59:28.190 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package jq. 2024-09-20T20:59:28.218 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:59:28.257 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T20:59:28.331 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T20:59:28.359 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:59:28.362 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T20:59:28.379 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T20:59:28.398 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:59:28.412 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:59:28.470 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T20:59:28.497 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T20:59:28.536 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:59:28.667 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package jq. 2024-09-20T20:59:28.683 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:59:28.725 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T20:59:28.750 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-test. 2024-09-20T20:59:28.760 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package socat. 2024-09-20T20:59:28.766 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:28.787 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T20:59:28.799 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:28.826 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:59:28.953 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package socat. 2024-09-20T20:59:28.969 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T20:59:29.011 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:59:29.121 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T20:59:29.148 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T20:59:29.187 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:59:29.208 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T20:59:29.225 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:29.267 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:29.290 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T20:59:29.318 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T20:59:29.356 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:59:29.541 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-test. 2024-09-20T20:59:29.557 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:29.561 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T20:59:29.589 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T20:59:29.599 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:29.628 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:59:29.711 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-test. 2024-09-20T20:59:29.728 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:29.769 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:29.948 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T20:59:29.975 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:59:30.014 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:59:30.267 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package jq. 2024-09-20T20:59:30.283 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:59:30.325 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T20:59:30.578 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package socat. 2024-09-20T20:59:30.605 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T20:59:30.644 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:59:30.929 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T20:59:30.957 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:30.964 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T20:59:30.980 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T20:59:30.996 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:31.022 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:59:31.299 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T20:59:31.315 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:31.349 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:31.393 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test. 2024-09-20T20:59:31.421 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:31.459 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:31.611 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T20:59:31.627 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T20:59:31.669 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:59:31.954 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T20:59:31.978 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:31.982 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T20:59:32.009 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T20:59:32.012 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:32.048 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:59:32.107 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T20:59:32.135 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:32.174 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:32.299 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T20:59:32.315 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:32.348 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:32.411 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T20:59:32.438 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T20:59:32.470 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T20:59:32.477 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:59:32.486 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:32.545 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:32.643 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T20:59:32.670 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T20:59:32.701 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:59:32.806 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T20:59:32.822 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T20:59:32.864 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:59:32.890 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pkg-config. 2024-09-20T20:59:32.918 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T20:59:32.957 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:59:33.039 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T20:59:33.067 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T20:59:33.105 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:59:33.185 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T20:59:33.201 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T20:59:33.235 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:59:33.386 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T20:59:33.402 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T20:59:33.444 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:59:33.444 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T20:59:33.472 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T20:59:33.511 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:59:33.621 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T20:59:33.649 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T20:59:33.679 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T20:59:33.807 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T20:59:33.835 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T20:59:33.865 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package pkg-config. 2024-09-20T20:59:33.872 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T20:59:33.873 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:59:33.879 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T20:59:33.900 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:59:33.907 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:59:33.939 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:33.957 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T20:59:33.985 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T20:59:34.023 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T20:59:34.160 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T20:59:34.187 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T20:59:34.226 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:59:34.285 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T20:59:34.296 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package pkg-config. 2024-09-20T20:59:34.312 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:34.324 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T20:59:34.351 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:34.362 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:59:34.377 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T20:59:34.405 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T20:59:34.443 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:59:34.598 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T20:59:34.615 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T20:59:34.648 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:59:34.670 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T20:59:34.698 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T20:59:34.713 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T20:59:34.737 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:59:34.741 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T20:59:34.755 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T20:59:34.782 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T20:59:34.788 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T20:59:34.821 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T20:59:35.058 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T20:59:35.074 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T20:59:35.077 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T20:59:35.104 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T20:59:35.133 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:59:35.135 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T20:59:35.157 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T20:59:35.157 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-py. 2024-09-20T20:59:35.174 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T20:59:35.184 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T20:59:35.215 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T20:59:35.232 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T20:59:35.430 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T20:59:35.457 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T20:59:35.496 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T20:59:35.527 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T20:59:35.553 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T20:59:35.554 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T20:59:35.580 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T20:59:35.585 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:59:35.587 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T20:59:35.615 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T20:59:35.619 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:59:35.662 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:59:35.800 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T20:59:35.827 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T20:59:35.866 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:59:35.896 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T20:59:35.924 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T20:59:35.963 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T20:59:36.031 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T20:59:36.049 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T20:59:36.059 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package pkg-config. 2024-09-20T20:59:36.081 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:59:36.087 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T20:59:36.126 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:59:36.178 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T20:59:36.206 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T20:59:36.241 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-py. 2024-09-20T20:59:36.244 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T20:59:36.268 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T20:59:36.298 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T20:59:36.367 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-toml. 2024-09-20T20:59:36.395 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T20:59:36.401 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T20:59:36.429 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T20:59:36.433 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T20:59:36.470 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:59:36.581 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-py. 2024-09-20T20:59:36.609 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T20:59:36.610 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T20:59:36.638 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T20:59:36.656 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T20:59:36.668 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:59:36.720 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T20:59:36.748 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T20:59:36.786 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:59:36.890 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T20:59:36.917 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T20:59:36.956 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T20:59:36.976 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T20:59:37.004 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T20:59:37.043 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:59:37.139 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T20:59:37.140 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T20:59:37.157 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T20:59:37.167 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T20:59:37.198 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:59:37.205 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:59:37.259 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T20:59:37.287 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T20:59:37.327 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T20:59:37.458 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-toml. 2024-09-20T20:59:37.467 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T20:59:37.474 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T20:59:37.483 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T20:59:37.489 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T20:59:37.508 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T20:59:37.517 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T20:59:37.525 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:59:37.547 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:59:37.589 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T20:59:37.616 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T20:59:37.647 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:59:37.769 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T20:59:37.797 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T20:59:37.827 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:59:37.858 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-toml. 2024-09-20T20:59:37.886 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T20:59:37.924 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T20:59:37.959 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T20:59:37.986 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T20:59:38.025 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T20:59:38.189 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T20:59:38.217 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T20:59:38.236 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T20:59:38.255 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:59:38.264 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T20:59:38.302 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:59:38.522 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package radosgw. 2024-09-20T20:59:38.524 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T20:59:38.540 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T20:59:38.549 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:38.574 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:59:38.587 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:38.662 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-py. 2024-09-20T20:59:38.690 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T20:59:38.698 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T20:59:38.726 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T20:59:38.728 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T20:59:38.765 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:59:39.017 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T20:59:39.034 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T20:59:39.048 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T20:59:39.076 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T20:59:39.076 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:59:39.114 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:59:39.366 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T20:59:39.394 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:39.432 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:39.552 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T20:59:39.568 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T20:59:39.601 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:59:39.654 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package radosgw. 2024-09-20T20:59:39.681 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:39.720 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:39.728 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T20:59:39.780 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package radosgw. 2024-09-20T20:59:39.808 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:39.846 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:39.946 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-toml. 2024-09-20T20:59:39.974 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T20:59:39.979 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:59:40.012 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T20:59:40.105 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:59:40.315 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T20:59:40.343 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T20:59:40.367 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T20:59:40.382 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:59:40.498 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T20:59:40.514 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:40.547 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:40.641 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T20:59:40.657 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:40.699 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:40.715 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T20:59:40.727 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T20:59:40.754 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T20:59:40.793 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:59:40.869 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T20:59:41.013 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T20:59:41.071 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T20:59:41.087 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T20:59:41.128 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:59:41.129 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:59:41.142 INFO:teuthology.orchestra.run.smithi112.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T20:59:41.206 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:41.253 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:59:41.263 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:59:41.364 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:59:41.510 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T20:59:41.625 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T20:59:41.706 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user cephadm....done 2024-09-20T20:59:41.808 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw. 2024-09-20T20:59:41.819 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T20:59:41.837 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:41.846 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:59:41.866 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:41.957 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T20:59:42.139 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:59:42.239 INFO:teuthology.orchestra.run.smithi139.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T20:59:42.305 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:42.398 INFO:teuthology.orchestra.run.smithi203.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T20:59:42.399 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:59:42.458 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:42.516 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:59:42.644 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T20:59:42.660 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:59:42.711 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:42.759 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T20:59:42.830 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user cephadm....done 2024-09-20T20:59:42.967 INFO:teuthology.orchestra.run.smithi203.stdout:Adding system user cephadm....done 2024-09-20T20:59:42.994 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:59:43.024 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T20:59:43.027 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:59:43.090 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:59:43.153 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T20:59:43.271 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:59:43.274 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:59:43.341 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:59:43.400 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:59:43.463 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:59:43.530 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:59:43.592 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:59:43.648 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:59:43.664 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T20:59:43.719 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:59:43.832 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T20:59:43.899 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T20:59:43.978 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T20:59:43.994 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T20:59:44.092 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T20:59:44.167 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:59:44.238 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:59:44.293 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T20:59:44.359 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:59:44.364 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T20:59:44.440 INFO:teuthology.orchestra.run.smithi161.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T20:59:44.510 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:44.594 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:59:44.603 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:59:44.691 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:59:44.854 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:59:44.955 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T20:59:45.051 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T20:59:45.060 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user cephadm....done 2024-09-20T20:59:45.113 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:59:45.214 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T20:59:45.216 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:59:45.320 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T20:59:45.372 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:45.473 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:59:45.493 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:59:45.587 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:59:45.648 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:59:45.716 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:59:45.735 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:59:45.792 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:59:45.845 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:59:45.856 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:59:45.900 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:59:45.984 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:59:46.001 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:59:46.088 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T20:59:46.115 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:59:46.252 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:59:46.253 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:59:46.356 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:59:46.383 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:59:46.482 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T20:59:46.503 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:46.634 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:46.636 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T20:59:46.667 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T20:59:46.747 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:59:46.800 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:59:46.873 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T20:59:46.912 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:59:46.927 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:59:47.038 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:59:47.053 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:59:47.164 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:59:47.177 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T20:59:47.179 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:59:47.224 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:47.290 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:59:47.305 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:59:47.325 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T20:59:47.437 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T20:59:47.533 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:59:47.556 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:59:47.594 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:59:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:59:47.861 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:59:47.907 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T20:59:47.932 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T20:59:47.938 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T20:59:47.963 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T20:59:47.973 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:59:48.002 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:59:48.027 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:59:48.120 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T20:59:48.161 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T20:59:48.162 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T20:59:48.240 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:59:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:59:48.471 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:48.516 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:59:48.529 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:48.597 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T20:59:48.793 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:48.859 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T20:59:48.890 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:59:48.924 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:59:49.069 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:59:49.158 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:59:49.166 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:59:49.195 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:59:49.240 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:59:49.321 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:59:49.409 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:59:49.447 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:59:49.516 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:59:49.519 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:59:49.700 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T20:59:49.706 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:59:49.820 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T20:59:49.826 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T20:59:49.826 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:59:49.952 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:59:50.090 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T20:59:50.120 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T20:59:50.184 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:59:50.213 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T20:59:50.310 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T20:59:50.464 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:59:50.512 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:59:50.638 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:59:50.662 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:50.788 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:59:50.788 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T20:59:50.857 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:59:50.888 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:59:50.889 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:59:51.006 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:59:51.031 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:59:51.080 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:59:51.132 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:59:51.141 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:59:51.307 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T20:59:51.357 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:59:51.417 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T20:59:51.468 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:59:51.683 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T20:59:51.702 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:59:51.708 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T20:59:51.802 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T20:59:51.809 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:59:51.828 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:51.959 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:59:52.070 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:59:52.121 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:59:52.378 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:59:52.447 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:59:52.447 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:59:52.486 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:59:52.679 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:59:52.731 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:59:52.737 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:59:52.871 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:59:52.997 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:59:53.013 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:59:53.083 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:59:53.264 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:59:53.317 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:59:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T20:59:53.365 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:53.460 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:53.667 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:59:53.741 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T20:59:53.770 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:59:53.787 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:59:53.992 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:59:54.021 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:59:54.121 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:59:54.156 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T20:59:54.217 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:59:54.424 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:59:54.541 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:59:54.594 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:59:54.642 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:59:54.879 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:59:54.927 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:59:55.166 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:59:55.178 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T20:59:55.239 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:59:55.286 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:59:55.409 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:59:55.429 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:59:55.506 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:59:55.543 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T20:59:55.555 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:59:55.571 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:59:55.657 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:59:55.705 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T20:59:55.803 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:59:55.865 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:59:55.904 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:59:55.965 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:59:55.975 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:59:56.005 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:59:56.066 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:59:56.133 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T20:59:56.167 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:59:56.281 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:59:56.310 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:59:56.367 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T20:59:56.443 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:59:56.507 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T20:59:56.601 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:59:56.703 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T20:59:56.758 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:59:56.853 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T20:59:56.884 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:59:56.946 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:59:57.055 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:59:57.120 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:59:57.202 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:59:57.246 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T20:59:57.357 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:59:57.453 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T20:59:57.482 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:59:57.547 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:59:57.600 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T20:59:57.665 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:59:57.704 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T20:59:57.725 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:59:57.859 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T20:59:57.860 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T20:59:57.938 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:59:57.958 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:59:58.119 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:59:58.121 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:59:58.181 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T20:59:58.234 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:59:58.245 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:59:58.371 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:59:58.373 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T20:59:58.440 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:59:58.477 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:59:58.566 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T20:59:58.586 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:59:58.640 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:59:58.664 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:59:58.712 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:59:58.766 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T20:59:58.802 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T20:59:58.842 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:59:58.965 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T20:59:58.977 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:59:59.042 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:59:59.047 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:59:59.160 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:59:59.173 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:59:59.216 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:59:59.278 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:59:59.343 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:59:59.444 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:59:59.558 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:59:59.571 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:59:59.661 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:59:59.737 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:59:59.817 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T20:59:59.822 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:59:59.912 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T20:59:59.939 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:59:59.944 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T21:00:00.005 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T21:00:00.049 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T21:00:00.122 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T21:00:00.138 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T21:00:00.178 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T21:00:00.188 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T21:00:00.265 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T21:00:00.279 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T21:00:00.354 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T21:00:00.383 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T21:00:00.447 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T21:00:00.509 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T21:00:00.597 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T21:00:00.600 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T21:00:00.698 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T21:00:00.718 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T21:00:00.894 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T21:00:00.915 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T21:00:00.966 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T21:00:01.111 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T21:00:01.117 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T21:00:01.171 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T21:00:01.191 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T21:00:01.280 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T21:00:01.317 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T21:00:01.370 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T21:00:01.418 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T21:00:01.480 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T21:00:01.519 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T21:00:01.539 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T21:00:01.584 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T21:00:01.648 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T21:00:01.731 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T21:00:01.795 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T21:00:01.846 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T21:00:01.849 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T21:00:01.974 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T21:00:02.097 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T21:00:02.166 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T21:00:02.181 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T21:00:02.267 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T21:00:02.356 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T21:00:02.467 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T21:00:02.507 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T21:00:02.543 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T21:00:02.566 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T21:00:02.658 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T21:00:02.669 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T21:00:02.751 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T21:00:02.764 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T21:00:02.850 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T21:00:02.878 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T21:00:02.945 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T21:00:03.001 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T21:00:03.136 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T21:00:03.162 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T21:00:03.187 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T21:00:03.196 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T21:00:03.288 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:03.405 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:03.430 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T21:00:03.521 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T21:00:03.531 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T21:00:03.549 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T21:00:03.781 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T21:00:03.792 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T21:00:03.868 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:03.915 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T21:00:03.926 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T21:00:04.019 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T21:00:04.191 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T21:00:04.236 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T21:00:04.250 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T21:00:04.317 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T21:00:04.388 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:04.506 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:04.553 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T21:00:04.588 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T21:00:04.632 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:04.643 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T21:00:04.726 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:04.823 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:04.846 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T21:00:04.846 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T21:00:04.880 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T21:00:04.944 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T21:00:04.949 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T21:00:04.998 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:05.116 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:05.196 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T21:00:05.217 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T21:00:05.302 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:05.322 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T21:00:05.325 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:05.428 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:05.451 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:05.553 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:05.554 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T21:00:05.579 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:05.598 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T21:00:05.679 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:05.680 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T21:00:05.805 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T21:00:05.839 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:05.882 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T21:00:05.957 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:06.074 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:06.107 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:06.216 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:06.243 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T21:00:06.289 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T21:00:06.289 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T21:00:06.317 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:06.529 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T21:00:06.529 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T21:00:06.596 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T21:00:06.743 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:06.850 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:06.869 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:06.872 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T21:00:06.951 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:06.960 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:06.995 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:07.061 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:07.086 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:07.121 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T21:00:07.187 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:07.208 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T21:00:07.212 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:07.321 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:07.346 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T21:00:07.351 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:07.518 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:07.620 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T21:00:07.839 INFO:teuthology.orchestra.run.smithi112.stdout:Adding group ceph....done 2024-09-20T21:00:07.939 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.065 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.191 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T21:00:08.199 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user ceph....done 2024-09-20T21:00:08.360 INFO:teuthology.orchestra.run.smithi112.stdout:Setting system user ceph properties....done 2024-09-20T21:00:08.374 INFO:teuthology.orchestra.run.smithi112.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T21:00:08.391 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.476 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.512 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T21:00:08.516 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.600 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.619 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.643 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.726 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.753 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.769 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.850 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T21:00:08.852 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.895 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:08.949 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T21:00:08.949 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T21:00:08.978 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:09.096 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:09.429 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:09.445 INFO:teuthology.orchestra.run.smithi139.stdout:Adding group ceph....done 2024-09-20T21:00:09.572 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:09.591 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:09.664 INFO:teuthology.orchestra.run.smithi203.stdout:Adding group ceph....done 2024-09-20T21:00:09.698 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:09.700 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:09.755 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user ceph....done 2024-09-20T21:00:09.824 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T21:00:09.933 INFO:teuthology.orchestra.run.smithi139.stdout:Setting system user ceph properties....done 2024-09-20T21:00:09.947 INFO:teuthology.orchestra.run.smithi139.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T21:00:10.040 INFO:teuthology.orchestra.run.smithi203.stdout:Adding system user ceph....done 2024-09-20T21:00:10.083 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T21:00:10.155 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T21:00:10.155 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T21:00:10.192 INFO:teuthology.orchestra.run.smithi203.stdout:Setting system user ceph properties....done 2024-09-20T21:00:10.212 INFO:teuthology.orchestra.run.smithi203.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T21:00:10.354 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T21:00:10.370 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T21:00:10.619 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:10.656 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T21:00:10.804 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:10.930 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:10.945 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T21:00:11.011 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:11.114 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:11.121 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:11.240 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:11.247 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:11.355 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T21:00:11.355 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T21:00:11.372 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:11.404 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:11.507 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:11.657 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T21:00:11.658 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T21:00:11.699 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T21:00:11.700 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T21:00:11.790 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:12.050 INFO:teuthology.orchestra.run.smithi161.stdout:Adding group ceph....done 2024-09-20T21:00:12.122 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:12.131 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T21:00:12.142 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:12.344 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T21:00:12.344 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T21:00:12.468 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user ceph....done 2024-09-20T21:00:12.483 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T21:00:12.608 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:12.637 INFO:teuthology.orchestra.run.smithi161.stdout:Setting system user ceph properties....done 2024-09-20T21:00:12.649 INFO:teuthology.orchestra.run.smithi161.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T21:00:12.785 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T21:00:12.815 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:12.828 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T21:00:12.828 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T21:00:12.968 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:13.086 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T21:00:13.086 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T21:00:13.097 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T21:00:13.200 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T21:00:13.200 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T21:00:13.285 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:13.500 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T21:00:13.500 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T21:00:13.550 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:13.558 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:13.670 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:13.676 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:13.709 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:13.827 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:13.873 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T21:00:13.873 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T21:00:13.961 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:14.023 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T21:00:14.023 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T21:00:14.142 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T21:00:14.143 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T21:00:14.241 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T21:00:14.241 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T21:00:14.372 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:14.541 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:14.595 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:14.660 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T21:00:14.660 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T21:00:14.679 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:14.683 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:14.805 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:14.809 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:14.930 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T21:00:14.960 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:15.016 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:15.148 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:15.249 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:15.324 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T21:00:15.384 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:15.388 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:15.509 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T21:00:15.587 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T21:00:15.587 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T21:00:15.591 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T21:00:15.591 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T21:00:15.604 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T21:00:15.604 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T21:00:15.754 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T21:00:16.035 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:16.075 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:16.115 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:16.169 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:16.234 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:16.295 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:16.347 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T21:00:16.347 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T21:00:16.352 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:16.447 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:16.478 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:16.766 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T21:00:16.825 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T21:00:16.859 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T21:00:16.915 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T21:00:16.933 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T21:00:17.039 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T21:00:17.039 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T21:00:17.067 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T21:00:17.078 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T21:00:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T21:00:17.483 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-20T21:00:17.501 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:17.580 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-20T21:00:17.610 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:17.736 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:17.778 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-20T21:00:17.779 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-20T21:00:17.931 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T21:00:17.932 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T21:00:17.963 INFO:teuthology.orchestra.run.smithi112.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-20T21:00:17.963 INFO:teuthology.orchestra.run.smithi112.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-20T21:00:17.963 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T21:00:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T21:00:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T21:00:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T21:00:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T21:00:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T21:00:17.964 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T21:00:17.965 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-20T21:00:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-20T21:00:17.967 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-20T21:00:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: bison-doc flex-doc libssl-doc 2024-09-20T21:00:17.997 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-20T21:00:17.999 INFO:teuthology.orchestra.run.smithi112.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-20T21:00:18.000 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2024-09-20T21:00:18.000 INFO:teuthology.orchestra.run.smithi112.stdout: libssl3 libuuid1 uuid-dev 2024-09-20T21:00:18.178 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T21:00:18.180 INFO:teuthology.orchestra.run.smithi112.stdout:3 upgraded, 7 newly installed, 0 to remove and 329 not upgraded. 2024-09-20T21:00:18.180 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 5,494 kB of archives. 2024-09-20T21:00:18.180 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-20T21:00:18.180 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-20T21:00:18.184 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T21:00:18.454 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:18.605 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:18.653 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-20T21:00:18.756 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:18.843 INFO:teuthology.orchestra.run.smithi139.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T21:00:18.846 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-20T21:00:18.852 INFO:teuthology.orchestra.run.smithi203.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T21:00:18.855 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-20T21:00:18.907 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-20T21:00:18.907 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T21:00:18.909 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-20T21:00:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-20T21:00:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-20T21:00:18.943 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-20T21:00:18.944 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-20T21:00:18.946 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-20T21:00:18.946 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-20T21:00:18.947 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-20T21:00:18.958 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-09-20T21:00:19.122 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-20T21:00:19.123 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-20T21:00:19.178 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2024-09-20T21:00:19.179 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2024-09-20T21:00:19.260 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T21:00:19.326 INFO:teuthology.orchestra.run.smithi139.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-20T21:00:19.326 INFO:teuthology.orchestra.run.smithi139.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-20T21:00:19.326 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T21:00:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T21:00:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T21:00:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T21:00:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T21:00:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T21:00:19.327 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T21:00:19.328 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-09-20T21:00:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-20T21:00:19.330 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-09-20T21:00:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: bison-doc flex-doc libssl-doc 2024-09-20T21:00:19.359 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-09-20T21:00:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:Preconfiguring packages ... 2024-09-20T21:00:19.361 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T21:00:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-20T21:00:19.362 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2024-09-20T21:00:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: libssl3 libuuid1 uuid-dev 2024-09-20T21:00:19.373 INFO:teuthology.orchestra.run.smithi203.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-20T21:00:19.373 INFO:teuthology.orchestra.run.smithi203.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-20T21:00:19.373 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T21:00:19.373 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T21:00:19.373 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T21:00:19.373 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T21:00:19.374 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T21:00:19.374 INFO:teuthology.orchestra.run.smithi203.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T21:00:19.374 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T21:00:19.375 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2024-09-20T21:00:19.376 INFO:teuthology.orchestra.run.smithi203.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-20T21:00:19.377 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2024-09-20T21:00:19.377 INFO:teuthology.orchestra.run.smithi203.stdout: bison-doc flex-doc libssl-doc 2024-09-20T21:00:19.405 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2024-09-20T21:00:19.407 INFO:teuthology.orchestra.run.smithi203.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-20T21:00:19.408 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages will be upgraded: 2024-09-20T21:00:19.408 INFO:teuthology.orchestra.run.smithi203.stdout: libssl3 libuuid1 uuid-dev 2024-09-20T21:00:19.412 INFO:teuthology.orchestra.run.smithi139.stdout:3 upgraded, 7 newly installed, 0 to remove and 329 not upgraded. 2024-09-20T21:00:19.412 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 5,494 kB of archives. 2024-09-20T21:00:19.413 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-20T21:00:19.413 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-20T21:00:19.512 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-20T21:00:19.513 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T21:00:19.572 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-20T21:00:19.573 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-20T21:00:19.574 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-20T21:00:19.587 INFO:teuthology.orchestra.run.smithi203.stdout:3 upgraded, 7 newly installed, 0 to remove and 329 not upgraded. 2024-09-20T21:00:19.588 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 5,494 kB of archives. 2024-09-20T21:00:19.588 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-20T21:00:19.588 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-20T21:00:19.588 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-20T21:00:19.588 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-20T21:00:19.590 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-20T21:00:19.590 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-20T21:00:19.590 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-20T21:00:19.620 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 5,494 kB in 1s (5,436 kB/s) 2024-09-20T21:00:19.759 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package flex. 2024-09-20T21:00:19.861 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-20T21:00:19.867 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:19.907 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-20T21:00:19.945 INFO:teuthology.orchestra.run.smithi139.stdout:Preconfiguring packages ... 2024-09-20T21:00:20.044 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 5,494 kB in 0s (21.9 MB/s) 2024-09-20T21:00:20.062 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-20T21:00:20.173 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package flex. 2024-09-20T21:00:20.270 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-20T21:00:20.275 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:20.317 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-20T21:00:20.319 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-20T21:00:20.320 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-20T21:00:20.330 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-20T21:00:20.354 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-20T21:00:20.355 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-20T21:00:20.357 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-20T21:00:20.357 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-20T21:00:20.358 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-20T21:00:20.491 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T21:00:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T21:00:20.663 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-20T21:00:20.758 INFO:teuthology.orchestra.run.smithi203.stdout:Preconfiguring packages ... 2024-09-20T21:00:20.862 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 5,494 kB in 1s (5,423 kB/s) 2024-09-20T21:00:21.009 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package flex. 2024-09-20T21:00:21.066 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:21.105 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-20T21:00:21.111 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:21.157 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-20T21:00:21.210 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T21:00:21.212 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-20T21:00:21.269 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-20T21:00:21.351 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T21:00:21.480 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-09-20T21:00:21.481 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-09-20T21:00:21.523 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-20T21:00:21.617 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T21:00:21.623 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T21:00:21.675 INFO:teuthology.orchestra.run.smithi161.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-20T21:00:21.675 INFO:teuthology.orchestra.run.smithi161.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-20T21:00:21.675 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T21:00:21.675 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T21:00:21.675 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T21:00:21.675 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T21:00:21.676 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T21:00:21.676 INFO:teuthology.orchestra.run.smithi161.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T21:00:21.676 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T21:00:21.676 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-09-20T21:00:21.677 INFO:teuthology.orchestra.run.smithi161.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-20T21:00:21.678 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-09-20T21:00:21.679 INFO:teuthology.orchestra.run.smithi161.stdout: bison-doc flex-doc libssl-doc 2024-09-20T21:00:21.682 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T21:00:21.707 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-09-20T21:00:21.708 INFO:teuthology.orchestra.run.smithi161.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-20T21:00:21.709 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2024-09-20T21:00:21.710 INFO:teuthology.orchestra.run.smithi161.stdout: libssl3 libuuid1 uuid-dev 2024-09-20T21:00:21.760 INFO:teuthology.orchestra.run.smithi161.stdout:3 upgraded, 7 newly installed, 0 to remove and 329 not upgraded. 2024-09-20T21:00:21.760 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 5,494 kB of archives. 2024-09-20T21:00:21.760 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-20T21:00:21.761 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-20T21:00:21.762 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T21:00:21.830 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-20T21:00:21.861 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-20T21:00:21.920 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-20T21:00:21.921 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-20T21:00:21.921 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-20T21:00:21.935 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-20T21:00:21.936 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-20T21:00:21.937 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-20T21:00:21.937 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-20T21:00:21.938 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-20T21:00:21.970 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:22.155 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T21:00:22.258 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:22.278 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T21:00:22.296 INFO:teuthology.orchestra.run.smithi161.stdout:Preconfiguring packages ... 2024-09-20T21:00:22.402 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 5,494 kB in 0s (22.0 MB/s) 2024-09-20T21:00:22.488 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T21:00:22.494 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T21:00:22.537 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package flex. 2024-09-20T21:00:22.580 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T21:00:22.607 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T21:00:22.640 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-20T21:00:22.646 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:22.710 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-20T21:00:22.765 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T21:00:22.771 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T21:00:22.913 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T21:00:22.953 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package bison. 2024-09-20T21:00:23.025 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T21:00:23.055 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T21:00:23.060 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-20T21:00:23.105 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T21:00:23.156 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T21:00:23.321 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T21:00:23.352 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T21:00:23.422 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-20T21:00:23.427 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T21:00:23.438 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-20T21:00:23.481 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T21:00:23.492 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T21:00:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-20T21:00:23.693 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-20T21:00:23.709 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-20T21:00:23.751 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T21:00:23.771 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T21:00:23.848 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package bison. 2024-09-20T21:00:23.928 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:23.953 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T21:00:23.959 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-20T21:00:24.008 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T21:00:24.088 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-20T21:00:24.103 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package bison. 2024-09-20T21:00:24.115 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:24.154 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:24.181 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T21:00:24.186 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-20T21:00:24.222 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T21:00:24.333 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-20T21:00:24.362 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-20T21:00:24.400 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T21:00:24.432 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-20T21:00:24.459 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:24.475 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T21:00:24.481 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T21:00:24.499 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:24.564 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-20T21:00:24.580 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-20T21:00:24.614 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T21:00:24.615 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T21:00:24.646 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-20T21:00:24.674 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-20T21:00:24.712 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T21:00:24.743 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-20T21:00:24.759 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T21:00:24.793 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:24.999 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-20T21:00:25.015 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:25.048 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:25.254 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-20T21:00:25.293 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-20T21:00:25.321 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:25.356 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T21:00:25.359 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:25.369 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-20T21:00:25.396 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-20T21:00:25.444 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T21:00:25.482 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T21:00:25.510 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T21:00:25.608 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:25.620 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-20T21:00:25.640 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T21:00:25.645 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T21:00:25.687 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:25.751 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T21:00:25.789 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-20T21:00:25.817 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:25.856 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:25.877 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:25.978 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T21:00:26.003 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T21:00:26.091 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-20T21:00:26.100 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-20T21:00:26.116 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:26.150 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:26.154 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:26.215 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-20T21:00:26.273 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T21:00:26.316 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package bison. 2024-09-20T21:00:26.341 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T21:00:26.352 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-20T21:00:26.369 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T21:00:26.399 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T21:00:26.410 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:26.418 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T21:00:26.423 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-20T21:00:26.451 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T21:00:26.476 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T21:00:26.568 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:26.694 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T21:00:26.793 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-20T21:00:26.821 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:26.821 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-20T21:00:26.860 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T21:00:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-20T21:00:26.930 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T21:00:27.010 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-20T21:00:27.023 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T21:00:27.065 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:27.130 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-20T21:00:27.141 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T21:00:27.158 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-20T21:00:27.191 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T21:00:27.197 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T21:00:27.250 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:27.343 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T21:00:27.351 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T21:00:27.477 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:27.533 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-20T21:00:27.561 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:27.600 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:27.603 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T21:00:27.609 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T21:00:27.693 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-20T21:00:27.763 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:27.844 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-20T21:00:27.860 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-20T21:00:27.902 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:27.907 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T21:00:28.058 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T21:00:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T21:00:28.104 DEBUG:teuthology.parallel:result is None 2024-09-20T21:00:28.122 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-20T21:00:28.149 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T21:00:28.188 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:28.485 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T21:00:28.683 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-20T21:00:28.809 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T21:00:28.936 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T21:00:28.994 INFO:teuthology.orchestra.run.smithi139.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T21:00:28.998 DEBUG:teuthology.parallel:result is None 2024-09-20T21:00:29.055 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T21:00:29.181 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T21:00:29.242 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T21:00:29.307 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:29.434 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T21:00:29.522 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-20T21:00:29.593 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T21:00:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T21:00:29.740 INFO:teuthology.orchestra.run.smithi203.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T21:00:29.745 DEBUG:teuthology.parallel:result is None 2024-09-20T21:00:29.863 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T21:00:31.148 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T21:00:31.644 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T21:00:31.648 DEBUG:teuthology.parallel:result is None 2024-09-20T21:00:31.648 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T21:00:31.785 DEBUG:teuthology.orchestra.run.smithi112:> dpkg-query -W -f '${Version}' ceph 2024-09-20T21:00:31.804 INFO:teuthology.orchestra.run.smithi112.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T21:00:31.804 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T21:00:31.804 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T21:00:31.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T21:00:31.941 DEBUG:teuthology.orchestra.run.smithi139:> dpkg-query -W -f '${Version}' ceph 2024-09-20T21:00:31.960 INFO:teuthology.orchestra.run.smithi139.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T21:00:31.960 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T21:00:31.960 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T21:00:31.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T21:00:32.096 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-query -W -f '${Version}' ceph 2024-09-20T21:00:32.115 INFO:teuthology.orchestra.run.smithi161.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T21:00:32.115 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T21:00:32.116 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T21:00:32.117 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T21:00:32.251 DEBUG:teuthology.orchestra.run.smithi203:> dpkg-query -W -f '${Version}' ceph 2024-09-20T21:00:32.271 INFO:teuthology.orchestra.run.smithi203.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T21:00:32.271 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T21:00:32.271 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T21:00:32.272 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-20T21:00:32.272 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:32.272 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T21:00:32.287 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T21:00:32.287 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T21:00:32.301 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T21:00:32.301 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T21:00:32.315 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T21:00:32.315 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T21:00:32.329 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-20T21:00:32.329 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:32.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T21:00:32.341 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T21:00:32.396 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T21:00:32.396 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T21:00:32.409 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T21:00:32.463 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T21:00:32.463 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T21:00:32.477 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T21:00:32.530 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T21:00:32.530 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T21:00:32.544 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T21:00:32.600 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-20T21:00:32.601 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:32.601 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T21:00:32.615 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T21:00:32.668 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T21:00:32.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T21:00:32.681 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T21:00:32.735 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T21:00:32.735 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T21:00:32.748 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T21:00:32.801 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T21:00:32.801 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T21:00:32.815 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T21:00:32.872 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-20T21:00:32.873 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:32.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T21:00:32.886 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T21:00:32.940 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T21:00:32.941 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T21:00:32.954 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T21:00:33.007 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T21:00:33.007 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T21:00:33.020 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T21:00:33.073 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T21:00:33.073 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T21:00:33.086 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T21:00:33.140 INFO:teuthology.run_tasks:Running task ceph... 2024-09-20T21:00:33.214 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-20T21:00:33.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-09-20T21:00:33.218 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2024-09-20T21:00:33.220 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2024-09-20T21:00:33.222 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /var/log/ceph 2024-09-20T21:00:33.234 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-20T21:00:33.234 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-20T21:00:33.275 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-20T21:00:33.277 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-20T21:00:33.279 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-20T21:00:33.291 INFO:tasks.ceph:Creating extra log directories... 2024-09-20T21:00:33.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-20T21:00:33.330 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-20T21:00:33.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-20T21:00:33.335 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-20T21:00:33.356 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-20T21:00:33.356 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-20T21:00:33.357 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7912591', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ed8ee0f26ef720e6504cefa8be1a2d0872192de7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 8245, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'sleep_before_teardown': 0, 'subset': '3/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ed8ee0f26ef720e6504cefa8be1a2d0872192de7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ed8ee0f26ef720e6504cefa8be1a2d0872192de7', 'targets': {'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBnuWX41arIUNYpjKuEOHDCpfkYg1pWFNvdaWnaUha71E2ok3odGMGUgfKtvzTB8spgmQfXO9a28M1jYAxWZw4w=', 'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMonTRw5qRu0szQLKxrt31wrjDdKiqw2AK5XqdwewrvfPP3pu5O96y9yvUFw4ejgEb4atKcnedHaeXSNMV7V0M8=', 'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9uZZwQfOCWU4I6SXe8EwJqjdSKI/VeibC3NTyroiVu6CNaYBb4wCqxg2Bm40jDi2SG+xckkstzcIzSUV1z354=', 'smithi203.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDK39ftOs8qbeP57ncCklKXMRUh5yZA6gtj7NBZgkYm0EpmwYz4F4E0Ks46XM/23755edz2/bb5KutmQ4ArEm4g='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-19_21:32:06', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-20T21:00:33.357 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-20T21:00:33.386 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-20T21:00:33.389 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-20T21:00:33.392 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-20T21:00:33.397 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-09-20T21:00:33.434 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2024-09-20T21:00:33.437 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2024-09-20T21:00:33.439 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/run/ceph 2024-09-20T21:00:33.453 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T21:00:33.453 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T21:00:33.496 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T21:00:33.496 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-09-20T21:00:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T21:00:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:33.545 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-09-20T21:00:33.545 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:33.545 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-20 20:54:51.414477647 +0000 2024-09-20T21:00:33.545 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-20 20:54:51.162479899 +0000 2024-09-20T21:00:33.545 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-20 20:54:51.162479899 +0000 2024-09-20T21:00:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-20T21:00:33.545 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T21:00:33.603 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-20T21:00:33.603 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-20T21:00:33.603 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000449033 s, 1.1 MB/s 2024-09-20T21:00:33.604 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T21:00:33.654 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-09-20T21:00:33.700 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T21:00:33.700 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:33.700 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-09-20T21:00:33.700 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:33.700 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-20 20:54:51.638475647 +0000 2024-09-20T21:00:33.700 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-20 20:54:51.634475682 +0000 2024-09-20T21:00:33.700 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-20 20:54:51.634475682 +0000 2024-09-20T21:00:33.700 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-20T21:00:33.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T21:00:33.758 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-20T21:00:33.758 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-20T21:00:33.758 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000439486 s, 1.2 MB/s 2024-09-20T21:00:33.759 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T21:00:33.809 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-09-20T21:00:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T21:00:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:33.857 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-09-20T21:00:33.857 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:33.857 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-20 20:54:52.362469180 +0000 2024-09-20T21:00:33.857 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-20 20:54:52.110471431 +0000 2024-09-20T21:00:33.857 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-20 20:54:52.110471431 +0000 2024-09-20T21:00:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-20T21:00:33.857 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T21:00:33.911 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-20T21:00:33.911 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-20T21:00:33.911 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000427092 s, 1.2 MB/s 2024-09-20T21:00:33.912 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T21:00:33.961 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-09-20T21:00:34.008 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T21:00:34.008 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:34.008 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-09-20T21:00:34.008 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:34.008 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-20 20:54:52.874464606 +0000 2024-09-20T21:00:34.008 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-20 20:54:52.602467037 +0000 2024-09-20T21:00:34.008 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-20 20:54:52.602467037 +0000 2024-09-20T21:00:34.008 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-20T21:00:34.009 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T21:00:34.062 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-20T21:00:34.062 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-20T21:00:34.062 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000274524 s, 1.9 MB/s 2024-09-20T21:00:34.063 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T21:00:34.110 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-20T21:00:34.110 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T21:00:34.110 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T21:00:34.116 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T21:00:34.116 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-09-20T21:00:34.162 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T21:00:34.162 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:34.162 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-09-20T21:00:34.162 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:34.162 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-20 20:54:51.444632559 +0000 2024-09-20T21:00:34.162 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-20 20:54:51.172634988 +0000 2024-09-20T21:00:34.163 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-20 20:54:51.172634988 +0000 2024-09-20T21:00:34.163 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-09-20T21:00:34.163 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T21:00:34.217 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-20T21:00:34.217 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-20T21:00:34.217 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000453207 s, 1.1 MB/s 2024-09-20T21:00:34.218 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T21:00:34.267 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-09-20T21:00:34.314 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T21:00:34.314 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:34.314 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-09-20T21:00:34.314 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:34.314 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-20 20:54:51.920628308 +0000 2024-09-20T21:00:34.314 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-20 20:54:51.680630451 +0000 2024-09-20T21:00:34.314 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-20 20:54:51.680630451 +0000 2024-09-20T21:00:34.314 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-09-20T21:00:34.315 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T21:00:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-20T21:00:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-20T21:00:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000426394 s, 1.2 MB/s 2024-09-20T21:00:34.369 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T21:00:34.419 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-09-20T21:00:34.466 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T21:00:34.466 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:34.466 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-09-20T21:00:34.466 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:34.466 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-20 20:54:52.360624378 +0000 2024-09-20T21:00:34.466 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-20 20:54:52.140626343 +0000 2024-09-20T21:00:34.466 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-20 20:54:52.140626343 +0000 2024-09-20T21:00:34.466 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-09-20T21:00:34.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T21:00:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-20T21:00:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-20T21:00:34.521 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000423914 s, 1.2 MB/s 2024-09-20T21:00:34.522 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T21:00:34.575 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-09-20T21:00:34.621 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T21:00:34.622 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:34.622 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-09-20T21:00:34.622 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:34.622 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-20 20:54:52.884619697 +0000 2024-09-20T21:00:34.622 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-20 20:54:52.620622054 +0000 2024-09-20T21:00:34.622 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-20 20:54:52.620622054 +0000 2024-09-20T21:00:34.622 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-09-20T21:00:34.622 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T21:00:34.675 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-20T21:00:34.675 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-20T21:00:34.675 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000326752 s, 1.6 MB/s 2024-09-20T21:00:34.677 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T21:00:34.723 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-20T21:00:34.723 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T21:00:34.723 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T21:00:34.729 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T21:00:34.729 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-09-20T21:00:34.778 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T21:00:34.778 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:34.778 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-09-20T21:00:34.778 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:34.778 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-20 20:54:51.177375361 +0000 2024-09-20T21:00:34.778 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-20 20:54:51.173375397 +0000 2024-09-20T21:00:34.778 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-20 20:54:51.173375397 +0000 2024-09-20T21:00:34.778 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: - 2024-09-20T21:00:34.779 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T21:00:34.831 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-20T21:00:34.832 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-20T21:00:34.832 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000367915 s, 1.4 MB/s 2024-09-20T21:00:34.833 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T21:00:34.883 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-09-20T21:00:34.929 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T21:00:34.929 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:34.929 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-09-20T21:00:34.929 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:34.929 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-20 20:54:51.865369216 +0000 2024-09-20T21:00:34.929 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-20 20:54:51.633371288 +0000 2024-09-20T21:00:34.929 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-20 20:54:51.633371288 +0000 2024-09-20T21:00:34.929 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: - 2024-09-20T21:00:34.930 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T21:00:34.982 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-20T21:00:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-20T21:00:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000335579 s, 1.5 MB/s 2024-09-20T21:00:34.984 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T21:00:35.031 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-09-20T21:00:35.077 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T21:00:35.077 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:35.077 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-09-20T21:00:35.077 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:35.077 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-20 20:54:52.329365071 +0000 2024-09-20T21:00:35.077 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-20 20:54:52.109367036 +0000 2024-09-20T21:00:35.077 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-20 20:54:52.109367036 +0000 2024-09-20T21:00:35.078 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: - 2024-09-20T21:00:35.078 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T21:00:35.136 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-20T21:00:35.136 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-20T21:00:35.136 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000404772 s, 1.3 MB/s 2024-09-20T21:00:35.137 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T21:00:35.186 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-09-20T21:00:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T21:00:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T21:00:35.233 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-20T21:00:35.233 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T21:00:35.233 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-20 20:54:52.821360677 +0000 2024-09-20T21:00:35.233 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-20 20:54:52.553363071 +0000 2024-09-20T21:00:35.233 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-20 20:54:52.553363071 +0000 2024-09-20T21:00:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: - 2024-09-20T21:00:35.234 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T21:00:35.287 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-20T21:00:35.287 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-20T21:00:35.287 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000389533 s, 1.3 MB/s 2024-09-20T21:00:35.288 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T21:00:35.338 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-20T21:00:35.338 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-20T21:00:35.338 INFO:tasks.ceph:Generating config... 2024-09-20T21:00:35.340 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-09-20T21:00:35.340 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-20T21:00:35.340 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-20T21:00:35.340 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-20T21:00:35.340 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-20T21:00:35.340 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-20T21:00:35.340 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-20T21:00:35.340 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2024-09-20T21:00:35.340 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-20T21:00:35.340 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-20T21:00:35.340 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-20T21:00:35.341 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-20T21:00:35.341 INFO:tasks.ceph:Setting up mon.a... 2024-09-20T21:00:35.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-20T21:00:35.375 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.keyring 2024-09-20T21:00:35.391 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-20T21:00:35.467 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-20T21:00:35.521 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.112'), ('mon.b', '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]'), ('mon.c', '[v2:172.21.15.112:3302,v1:172.21.15.112:6791]')] 2024-09-20T21:00:35.521 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790],[v2:172.21.15.112:3302,v1:172.21.15.112:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-09-20T21:00:35.522 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:35.522 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-20T21:00:35.570 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.112 --addv b '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]' --addv c '[v2:172.21.15.112:3302,v1:172.21.15.112:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-20T21:00:35.655 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-20T21:00:35.655 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: generated fsid 095c2509-1828-40cb-9515-44c079c52d3b 2024-09-20T21:00:35.655 INFO:teuthology.orchestra.run.smithi112.stdout:setting min_mon_release = quincy 2024-09-20T21:00:35.656 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 0 2024-09-20T21:00:35.656 INFO:teuthology.orchestra.run.smithi112.stdout:fsid 095c2509-1828-40cb-9515-44c079c52d3b 2024-09-20T21:00:35.656 INFO:teuthology.orchestra.run.smithi112.stdout:last_changed 2024-09-20T21:00:35.657339+0000 2024-09-20T21:00:35.656 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-20T21:00:35.657339+0000 2024-09-20T21:00:35.656 INFO:teuthology.orchestra.run.smithi112.stdout:min_mon_release 17 (quincy) 2024-09-20T21:00:35.656 INFO:teuthology.orchestra.run.smithi112.stdout:election_strategy: 1 2024-09-20T21:00:35.656 INFO:teuthology.orchestra.run.smithi112.stdout:0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.a 2024-09-20T21:00:35.656 INFO:teuthology.orchestra.run.smithi112.stdout:1: [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] mon.b 2024-09-20T21:00:35.656 INFO:teuthology.orchestra.run.smithi112.stdout:2: [v2:172.21.15.112:3302/0,v1:172.21.15.112:6791/0] mon.c 2024-09-20T21:00:35.656 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-20T21:00:35.657 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-20T21:00:35.705 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 095c2509-1828-40cb-9515-44c079c52d3b... 2024-09-20T21:00:35.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-20T21:00:35.751 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-20T21:00:35.753 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-20T21:00:35.755 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-20T21:00:35.779 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-20T21:00:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-20T21:00:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-20T21:00:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-20T21:00:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-20T21:00:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-20T21:00:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790],[v2:172.21.15.112:3302,v1:172.21.15.112:6791]" 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 095c2509-1828-40cb-9515-44c079c52d3b 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-20T21:00:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-20T21:00:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore compression algorithm = lz4 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore compression mode = aggressive 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 1/20 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 1/20 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 4/10 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-20T21:00:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: osd blocked scrub grace period = 3600 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: osd max markdown count = 1000 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-20T21:00:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-20T21:00:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-20T21:00:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-20T21:00:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-20T21:00:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-20T21:00:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-20T21:00:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-20T21:00:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-20T21:00:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-20T21:00:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:35.790 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-20T21:00:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-20T21:00:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-20T21:00:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-20T21:00:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-20T21:00:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-20T21:00:35.791 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-20T21:00:35.791 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-20T21:00:35.791 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-20T21:00:35.791 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-20T21:00:35.791 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-20T21:00:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-20T21:00:35.792 INFO:teuthology.orchestra.run.smithi203.stdout:[global] 2024-09-20T21:00:35.792 INFO:teuthology.orchestra.run.smithi203.stdout: chdir = "" 2024-09-20T21:00:35.792 INFO:teuthology.orchestra.run.smithi203.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-20T21:00:35.792 INFO:teuthology.orchestra.run.smithi203.stdout: auth supported = cephx 2024-09-20T21:00:35.792 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.792 INFO:teuthology.orchestra.run.smithi203.stdout: filestore xattr use omap = true 2024-09-20T21:00:35.792 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.792 INFO:teuthology.orchestra.run.smithi203.stdout: mon clock drift allowed = 1.000 2024-09-20T21:00:35.792 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: osd crush chooseleaf type = 0 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: auth debug = true 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on old message = true 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on bug = true 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: mon pg warn max object skew = 0 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: # disable pg_autoscaler by default for new pools 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default size = 2 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.793 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow primary affinity = true 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow pg remap = true 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on legacy crush tunables = false 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on crush straw calc version zero = false 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on no sortbitwise = false 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on osd down out interval zero = false 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on too few osds = false 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: mon_allow_pool_size_one = true 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: osd default data pool replay window = 5 2024-09-20T21:00:35.794 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: mon allow pool delete = true 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: mon cluster log file level = debug 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: debug asserts on shutdown = true 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: mon health detail to clog = false 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: mon host = "172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790],[v2:172.21.15.112:3302,v1:172.21.15.112:6791]" 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: fsid = 095c2509-1828-40cb-9515-44c079c52d3b 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout:[osd] 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: osd journal size = 100 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub load threshold = 5.0 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub max interval = 600 2024-09-20T21:00:35.795 INFO:teuthology.orchestra.run.smithi203.stdout: osd mclock profile = high_recovery_ops 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: osd recover clone overlap = true 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: osd recovery max chunk = 1048576 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug shutdown = true 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug op order = true 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug verify stray on activate = true 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug trim objects = true 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: osd open classes on start = true 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug pg log writeout = true 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: osd deep scrub update digest min age = 30 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.796 INFO:teuthology.orchestra.run.smithi203.stdout: osd map max advance = 10 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: journal zero on create = true 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: filestore ondisk finisher threads = 3 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: filestore apply finisher threads = 3 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: bdev debug aio = true 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug misdirected ops = true 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore block size = 96636764160 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore compression algorithm = lz4 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore compression mode = aggressive 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore fsck on mount = True 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluefs = 1/20 2024-09-20T21:00:35.797 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluestore = 1/20 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: debug osd = 20 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: debug rocksdb = 4/10 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd backfillfull_ratio = 0.85 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd full ratio = 0.9 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd nearfull ratio = 0.8 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: osd blocked scrub grace period = 3600 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: osd failsafe full ratio = 0.95 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: osd max markdown count = 1000 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: osd objectstore = bluestore 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr] 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-09-20T21:00:35.798 INFO:teuthology.orchestra.run.smithi203.stdout: debug mgr = 20 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: mgr/telemetry/nag = false 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout:[mon] 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: debug paxos = 20 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: mon data avail warn = 5 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: mon mgr mkfs grace = 240 2024-09-20T21:00:35.799 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd reporter subtree level = osd 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd prime pg temp = true 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: auth mon ticket ttl = 660 # 11m 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: auth service ticket ttl = 240 # 4m 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: # don't complain about insecure global_id in the test suite 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: # 1m isn't quite enough 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: mon_down_mkfs_grace = 2m 2024-09-20T21:00:35.800 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_filestore_osds = false 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout:[client] 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout: rgw cache enabled = true 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable ops log = true 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable usage log = true 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.a] 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.b] 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.c] 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.a] 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout:[client.0] 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi203.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-20T21:00:35.801 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2024-09-20T21:00:35.802 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2024-09-20T21:00:35.803 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790],[v2:172.21.15.112:3302,v1:172.21.15.112:6791]" 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 095c2509-1828-40cb-9515-44c079c52d3b 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.805 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug trim objects = true 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2024-09-20T21:00:35.806 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore compression algorithm = lz4 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore compression mode = aggressive 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2024-09-20T21:00:35.807 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: osd blocked scrub grace period = 3600 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: osd max markdown count = 1000 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2024-09-20T21:00:35.808 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2024-09-20T21:00:35.809 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-20T21:00:35.810 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2024-09-20T21:00:35.811 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2024-09-20T21:00:35.812 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2024-09-20T21:00:35.812 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2024-09-20T21:00:35.812 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2024-09-20T21:00:35.812 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-20T21:00:35.813 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2024-09-20T21:00:35.813 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2024-09-20T21:00:35.813 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-20T21:00:35.813 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2024-09-20T21:00:35.813 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.813 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2024-09-20T21:00:35.813 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.813 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2024-09-20T21:00:35.813 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.813 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.814 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.815 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790],[v2:172.21.15.112:3302,v1:172.21.15.112:6791]" 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 095c2509-1828-40cb-9515-44c079c52d3b 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.816 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug trim objects = true 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2024-09-20T21:00:35.817 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2024-09-20T21:00:35.818 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore compression algorithm = lz4 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore compression mode = aggressive 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 1/20 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 1/20 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 4/10 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: osd blocked scrub grace period = 3600 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2024-09-20T21:00:35.819 INFO:teuthology.orchestra.run.smithi139.stdout: osd max markdown count = 1000 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2024-09-20T21:00:35.820 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2024-09-20T21:00:35.821 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2024-09-20T21:00:35.822 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2024-09-20T21:00:35.823 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-20T21:00:35.823 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-20T21:00:35.823 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2024-09-20T21:00:35.823 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2024-09-20T21:00:35.823 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2024-09-20T21:00:35.823 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2024-09-20T21:00:35.823 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-09-20T21:00:35.823 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-20T21:00:35.824 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-20T21:00:35.825 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-20T21:00:35.905 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-20T21:00:35.905 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:35.905 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-20T21:00:35.911 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:35.911 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-20T21:00:35.958 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-09-20T21:00:35.958 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:35.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-20T21:00:35.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-20T21:00:36.022 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:36.022 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-20T21:00:36.069 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2024-09-20T21:00:36.069 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T21:00:36.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-20T21:00:36.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-20T21:00:36.092 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T21:00:36.093 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-20T21:00:36.140 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2024-09-20T21:00:36.140 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T21:00:36.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-20T21:00:36.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-20T21:00:36.163 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T21:00:36.163 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-20T21:00:36.210 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi203.front.sepia.ceph.com 2024-09-20T21:00:36.210 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T21:00:36.210 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-20T21:00:36.210 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-20T21:00:36.233 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T21:00:36.233 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-20T21:00:36.281 INFO:tasks.ceph:Setting up mon nodes... 2024-09-20T21:00:36.281 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-20T21:00:36.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-20T21:00:36.327 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-20T21:00:36.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-20T21:00:36.369 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-20T21:00:36.372 INFO:tasks.ceph:Setting up mds nodes... 2024-09-20T21:00:36.372 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-20T21:00:36.451 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-20T21:00:36.454 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-20T21:00:36.508 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-20T21:00:36.508 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-20T21:00:36.580 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-20T21:00:36.591 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-20T21:00:36.591 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-20T21:00:36.591 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-20T21:00:36.604 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-20T21:00:36.604 INFO:tasks.ceph:role: osd.0 2024-09-20T21:00:36.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-20T21:00:36.605 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-20T21:00:36.667 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-20T21:00:36.667 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-20T21:00:36.667 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-20T21:00:36.667 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-20T21:00:36.667 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-20T21:00:36.667 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-20T21:00:36.667 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-20T21:00:36.667 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-20T21:00:36.667 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-20T21:00:36.667 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-20T21:00:37.122 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-20T21:00:37.124 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-20T21:00:37.124 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-20T21:00:37.213 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-20T21:00:37.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T21:00:37.223 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-09-20T21:00:37.223 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-20T21:00:37.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-20T21:00:37.347+0000 7f8c1e6027c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-20T21:00:37.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-20T21:00:37.351+0000 7f8c1e6027c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-20T21:00:37.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-20T21:00:37.351+0000 7f8c1e6027c0 -1 bdev(0x55cfd3b4f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-20T21:00:37.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-20T21:00:37.351+0000 7f8c1e6027c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-20T21:00:40.518 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T21:00:40.532 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-20T21:00:40.546 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-20T21:00:40.546 INFO:tasks.ceph:role: osd.1 2024-09-20T21:00:40.546 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2024-09-20T21:00:40.546 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-20T21:00:40.610 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-20T21:00:40.610 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-20T21:00:40.610 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-20T21:00:40.610 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-20T21:00:40.610 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-20T21:00:40.610 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-09-20T21:00:40.610 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-20T21:00:40.610 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-20T21:00:40.611 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-20T21:00:40.611 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-20T21:00:41.062 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-09-20T21:00:41.065 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-09-20T21:00:41.065 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-20T21:00:41.156 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-20T21:00:41.164 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-09-20T21:00:41.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T21:00:41.165 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-20T21:00:41.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-20T21:00:41.269+0000 7f5c68d0a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-20T21:00:41.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-20T21:00:41.273+0000 7f5c68d0a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-20T21:00:41.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-20T21:00:41.273+0000 7f5c68d0a7c0 -1 bdev(0x55bce796f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-20T21:00:41.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-20T21:00:41.273+0000 7f5c68d0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-20T21:00:44.421 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T21:00:44.435 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-20T21:00:44.450 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-20T21:00:44.450 INFO:tasks.ceph:role: osd.2 2024-09-20T21:00:44.450 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-20T21:00:44.450 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-20T21:00:44.512 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-20T21:00:44.512 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-20T21:00:44.513 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-20T21:00:44.513 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-20T21:00:44.513 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-20T21:00:44.513 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-09-20T21:00:44.513 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-20T21:00:44.513 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-20T21:00:44.513 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-20T21:00:44.513 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-20T21:00:44.997 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-09-20T21:00:44.999 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-09-20T21:00:44.999 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-20T21:00:45.148 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-20T21:00:45.159 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: /sbin/restorecon: command not found 2024-09-20T21:00:45.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T21:00:45.160 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-20T21:00:45.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-20T21:00:45.269+0000 7f5bc2ac97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-20T21:00:45.277 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-20T21:00:45.277+0000 7f5bc2ac97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-20T21:00:45.277 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-20T21:00:45.277+0000 7f5bc2ac97c0 -1 bdev(0x55d27d087800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-20T21:00:45.277 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-20T21:00:45.277+0000 7f5bc2ac97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-20T21:00:48.510 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T21:00:48.524 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-20T21:00:48.524 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:48.524 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-20T21:00:48.538 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:48.538 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-20T21:00:48.592 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:48.592 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-20T21:00:48.645 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T21:00:48.645 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-20T21:00:48.659 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T21:00:48.659 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-20T21:00:48.674 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T21:00:48.674 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-20T21:00:48.687 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-20T21:00:48.688 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-20T21:00:48.693 INFO:tasks.ceph:Adding keys to all mons... 2024-09-20T21:00:48.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-20T21:00:48.747 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-09-20T21:00:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB04u1mQB6cExAAWE9d1Y4uuUDwyCO/3dEUzw== 2024-09-20T21:00:48.747 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2024-09-20T21:00:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB04u1m6uEpFhAA+KwZQrET9SkYt6H4Drmb8w== 2024-09-20T21:00:48.748 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-20T21:00:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB04u1m8wMDGxAAYb5n98nT9alGn0fJUoBG2g== 2024-09-20T21:00:48.748 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-09-20T21:00:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB14u1mcVbdFBAAixoKEOJy2EgCwa+oyZ4qXQ== 2024-09-20T21:00:48.748 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-09-20T21:00:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB54u1mnWozEBAA9LdJGtDQO13aVbGMBeuQTw== 2024-09-20T21:00:48.748 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-09-20T21:00:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB94u1mG3o4EBAAXGD+3KbKz9e0/x9gmQIhWA== 2024-09-20T21:00:48.748 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-20T21:00:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB04u1mCcm+IhAALbzkmRRgDYrw5jF1Cy4KUA== 2024-09-20T21:00:48.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-20T21:00:48.837 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-20T21:00:48.881 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-20T21:00:48.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-20T21:00:49.044 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-20T21:00:49.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-20T21:00:49.207 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-20T21:00:49.291 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-20T21:00:49.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-20T21:00:49.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-20T21:00:49.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-20T21:00:49.464 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-20T21:00:49.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-20T21:00:49.607 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-20T21:00:49.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-20T21:00:49.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-20T21:00:49.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-20T21:00:49.810 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-20T21:00:49.856 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-20T21:00:49.856 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-20T21:00:49.856 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-20T21:00:49.898 INFO:tasks.ceph.mon.a:Started 2024-09-20T21:00:49.898 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-20T21:00:49.898 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-20T21:00:49.900 INFO:tasks.ceph.mon.b:Started 2024-09-20T21:00:49.900 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-20T21:00:49.900 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-20T21:00:49.902 INFO:tasks.ceph.mon.c:Started 2024-09-20T21:00:49.902 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-20T21:00:49.903 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-20T21:00:49.903 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-20T21:00:49.905 INFO:tasks.ceph.mgr.x:Started 2024-09-20T21:00:49.905 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-20T21:00:49.905 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-20T21:00:49.907 INFO:tasks.ceph.mgr.y:Started 2024-09-20T21:00:49.907 INFO:tasks.ceph:Setting crush tunables to default 2024-09-20T21:00:49.907 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd crush tunables default 2024-09-20T21:00:50.398 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2024-09-20T21:00:50.420 INFO:tasks.ceph:check_enable_crimson: False 2024-09-20T21:00:50.421 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-20T21:00:50.421 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-20T21:00:50.421 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-20T21:00:50.435 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-20T21:00:50.435 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-20T21:00:50.449 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-20T21:00:50.449 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-20T21:00:50.464 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 238496db-6b3e-463e-90eb-e476e93f06e3 0 2024-09-20T21:00:50.518 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:50.518+0000 7f9a9bdc6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T21:00:50.725 INFO:teuthology.orchestra.run.smithi203.stdout:0 2024-09-20T21:00:50.734 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:50.734+0000 7fcca4754180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T21:00:50.744 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 5e46dfeb-5456-40e0-b0a3-d85993becaef 1 2024-09-20T21:00:50.943 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-09-20T21:00:50.959 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new f5e294ac-6f79-4615-93d7-8870379d28e4 2 2024-09-20T21:00:51.001 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:51.002+0000 7f9a9bdc6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T21:00:51.136 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:51.134+0000 7fcca4754180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T21:00:51.161 INFO:teuthology.orchestra.run.smithi203.stdout:2 2024-09-20T21:00:51.178 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-20T21:00:51.178 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-20T21:00:51.181 INFO:tasks.ceph.osd.0:Started 2024-09-20T21:00:51.181 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-20T21:00:51.181 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-20T21:00:51.183 INFO:tasks.ceph.osd.1:Started 2024-09-20T21:00:51.183 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-20T21:00:51.184 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-20T21:00:51.186 INFO:tasks.ceph.osd.2:Started 2024-09-20T21:00:51.186 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:00:51.200 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:51.202+0000 7f9a9bdc6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T21:00:51.278 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:51.278+0000 7fcca4754180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T21:00:51.368 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:00:51.368 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:00:51.161270+0000","last_up_change":"0.000000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:00:51.384 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-20T21:00:51.384 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-20T21:00:51.687 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-20T21:00:51.786 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:51.786+0000 7f9a9bdc6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T21:00:51.786 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:51.786+0000 7fcca4754180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T21:00:51.843 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:51.842+0000 7fcca4754180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T21:00:51.851 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:51.850+0000 7f9a9bdc6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T21:00:51.881 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-20T21:00:51.881 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":5,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:00:51.161270+0000","last_up_change":"0.000000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:00:51.896 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-20T21:00:51.900 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:51.898+0000 7fcca4754180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T21:00:51.905 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:51.906+0000 7f9a9bdc6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T21:00:51.978 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:51.978+0000 7fcca4754180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T21:00:51.985 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:51.986+0000 7f9a9bdc6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T21:00:52.031 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:52.030+0000 7fcca4754180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T21:00:52.038 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:52.038+0000 7f9a9bdc6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T21:00:52.108 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:52.110+0000 7fcca4754180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T21:00:52.117 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:52.118+0000 7f9a9bdc6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T21:00:52.162 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:52.162+0000 7fcca4754180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T21:00:52.168 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:52.166+0000 7f9a9bdc6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T21:00:52.261 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:00:52.259+0000 7f19c81ac7c0 -1 Falling back to public interface 2024-09-20T21:00:52.271 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:00:52.269+0000 7fccc92e67c0 -1 Falling back to public interface 2024-09-20T21:00:52.282 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:00:52.281+0000 7f895dd287c0 -1 Falling back to public interface 2024-09-20T21:00:52.317 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:52.314+0000 7fcca4754180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T21:00:52.318 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:52.318+0000 7f9a9bdc6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T21:00:52.379 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:52.378+0000 7fcca4754180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T21:00:52.381 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:52.382+0000 7f9a9bdc6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T21:00:52.994 INFO:tasks.ceph.mgr.y.smithi112.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-20T21:00:52.995 INFO:tasks.ceph.mgr.y.smithi112.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-20T21:00:52.995 INFO:tasks.ceph.mgr.y.smithi112.stderr: from numpy import show_config as show_numpy_config 2024-09-20T21:00:52.995 INFO:tasks.ceph.mgr.x.smithi112.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-20T21:00:52.995 INFO:tasks.ceph.mgr.x.smithi112.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-20T21:00:52.995 INFO:tasks.ceph.mgr.x.smithi112.stderr: from numpy import show_config as show_numpy_config 2024-09-20T21:00:53.038 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:53.038+0000 7fcca4754180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T21:00:53.043 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:53.042+0000 7f9a9bdc6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T21:00:53.175 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:53.174+0000 7fcca4754180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T21:00:53.204 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:53.202+0000 7f9a9bdc6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T21:00:53.327 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:53.326+0000 7fcca4754180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T21:00:53.327 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:53.326+0000 7f9a9bdc6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T21:00:53.391 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:53.390+0000 7fcca4754180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T21:00:53.391 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:53.390+0000 7f9a9bdc6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T21:00:53.528 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:53.526+0000 7fcca4754180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T21:00:53.528 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:53.530+0000 7f9a9bdc6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T21:00:54.145 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:54.146+0000 7fcca4754180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T21:00:54.145 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:54.146+0000 7f9a9bdc6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T21:00:54.222 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:54.222+0000 7fcca4754180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T21:00:54.222 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:54.222+0000 7f9a9bdc6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T21:00:54.409 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:54.410+0000 7f9a9bdc6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T21:00:54.410 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:54.410+0000 7fcca4754180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T21:00:54.484 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:54.482+0000 7fcca4754180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T21:00:54.484 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:54.482+0000 7f9a9bdc6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T21:00:54.778 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:54.778+0000 7fcca4754180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T21:00:54.778 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:54.778+0000 7f9a9bdc6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T21:00:54.841 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-20T21:00:54.842+0000 7fcca4754180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T21:00:54.841 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:54.842+0000 7f9a9bdc6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T21:00:55.871 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:55.870+0000 7f9a42900640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-20T21:00:55.873 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:00:55.874+0000 7f9a42900640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-20T21:00:56.087 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:00:56.083+0000 7f19c81ac7c0 -1 osd.0 0 log_to_monitors true 2024-09-20T21:00:56.113 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:00:56.113+0000 7fccc92e67c0 -1 osd.1 0 log_to_monitors true 2024-09-20T21:00:56.151 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:00:56.149+0000 7f895dd287c0 -1 osd.2 0 log_to_monitors true 2024-09-20T21:00:58.200 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-20T21:00:58.496 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-20T21:00:58.496 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":7,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:00:57.916132+0000","last_up_change":"0.000000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:00:58.514 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-20T21:00:58.720 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:00:58.717+0000 7f8959cd1640 -1 osd.2 0 waiting for initial osdmap 2024-09-20T21:00:58.737 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:00:58.737+0000 7f8951b06640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T21:00:58.878 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:00:58.823+0000 7f19c4155640 -1 osd.0 0 waiting for initial osdmap 2024-09-20T21:00:58.878 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:00:58.843+0000 7f19bbf8a640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T21:00:58.878 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:00:58.781+0000 7fccc528f640 -1 osd.1 0 waiting for initial osdmap 2024-09-20T21:00:58.878 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:00:58.805+0000 7fccbd0c4640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T21:01:04.817 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-20T21:01:05.116 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-20T21:01:05.116 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":11,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:01:02.962953+0000","last_up_change":"2024-09-20T21:00:59.725541+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6801","nonce":2769075992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6803","nonce":2769075992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6807","nonce":2769075992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6805","nonce":2769075992}]},"public_addr":"172.21.15.161:6801/2769075992","cluster_addr":"172.21.15.161:6803/2769075992","heartbeat_back_addr":"172.21.15.161:6807/2769075992","heartbeat_front_addr":"172.21.15.161:6805/2769075992","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:01:05.134 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-20T21:01:05.134 INFO:tasks.ceph:Creating RBD pool 2024-09-20T21:01:05.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-20T21:01:05.983 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'rbd' created 2024-09-20T21:01:06.009 DEBUG:teuthology.orchestra.run.smithi112:> rbd --cluster ceph pool init rbd 2024-09-20T21:01:09.040 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-20T21:01:09.041 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-20T21:01:09.041 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-20T21:01:09.043 INFO:tasks.ceph.mds.a:Started 2024-09-20T21:01:09.044 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-20T21:01:09.044 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T21:01:09.131 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-20T21:01:09.372 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:09.372 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":2,"btime":"2024-09-20T21:01:09:155790+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6803/1727517517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1727517517},{"type":"v1","addr":"172.21.15.112:6803","nonce":1727517517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-20T21:01:09.373 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 2 2024-09-20T21:01:09.391 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-20T21:01:09.689 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:09.689 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-20T21:01:09.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:09.689 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-20T21:01:09.689 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-20T21:01:09.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:09.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:09.690 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 2, 2024-09-20T21:01:09.690 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": "rbd" 2024-09-20T21:01:09.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:09.690 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-20T21:01:09.707 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-20T21:01:09.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-20T21:01:10.172 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-20T21:01:10.192 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-20T21:01:11.193 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-20T21:01:11.217 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-20T21:01:12.191 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 3 and data pool 4 2024-09-20T21:01:12.216 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:01:12.508 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:12.509 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:01:11.549596+0000","last_up_change":"2024-09-20T21:00:59.725541+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T21:01:05.455429+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T21:01:10.047761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T21:01:10.524533+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6801","nonce":2769075992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6803","nonce":2769075992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6807","nonce":2769075992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6805","nonce":2769075992}]},"public_addr":"172.21.15.161:6801/2769075992","cluster_addr":"172.21.15.161:6803/2769075992","heartbeat_back_addr":"172.21.15.161:6807/2769075992","heartbeat_front_addr":"172.21.15.161:6805/2769075992","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:01:12.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:01:12.828 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:12.828 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:01:11.549596+0000","last_up_change":"2024-09-20T21:00:59.725541+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T21:01:05.455429+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T21:01:10.047761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T21:01:10.524533+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6801","nonce":2769075992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6803","nonce":2769075992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6807","nonce":2769075992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6805","nonce":2769075992}]},"public_addr":"172.21.15.161:6801/2769075992","cluster_addr":"172.21.15.161:6803/2769075992","heartbeat_back_addr":"172.21.15.161:6807/2769075992","heartbeat_front_addr":"172.21.15.161:6805/2769075992","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:01:12.847 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-20T21:01:13.222 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-20T21:01:13.222 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-20T21:01:14.159 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-20T21:01:14.158+0000 7f3336f57640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-20T21:01:14.230 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-20T21:01:14.231 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T21:01:14.558 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:14.559 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"btime":"2024-09-20T21:01:14:206337+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T21:01:11.549887+0000","modified":"2024-09-20T21:01:13.564207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.112:6803/1727517517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1727517517},{"type":"v1","addr":"172.21.15.112:6803","nonce":1727517517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-20T21:01:14.559 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 5 2024-09-20T21:01:14.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:01:14.858 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:14.858 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":19,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:01:13.199354+0000","last_up_change":"2024-09-20T21:00:59.725541+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T21:01:05.455429+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T21:01:10.047761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T21:01:10.524533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6801","nonce":2769075992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6803","nonce":2769075992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6807","nonce":2769075992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6805","nonce":2769075992}]},"public_addr":"172.21.15.161:6801/2769075992","cluster_addr":"172.21.15.161:6803/2769075992","heartbeat_back_addr":"172.21.15.161:6807/2769075992","heartbeat_front_addr":"172.21.15.161:6805/2769075992","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:01:14.874 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-20T21:01:14.875 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:01:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:15.163 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:01:15.178 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-20T21:01:14.982380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90076,"kb_used_data":672,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025444,"statfs":{"total":289910292480,"available":289818054656,"internally_reserved":0,"allocated":688128,"data_stored":1362612,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4788,"internal_metadata":91483468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.125264"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214311+0000","last_change":"2024-09-20T21:01:12.240709+0000","last_active":"2024-09-20T21:01:13.214311+0000","last_peered":"2024-09-20T21:01:13.214311+0000","last_clean":"2024-09-20T21:01:13.214311+0000","last_became_active":"2024-09-20T21:01:12.239599+0000","last_became_peered":"2024-09-20T21:01:12.239599+0000","last_unstale":"2024-09-20T21:01:13.214311+0000","last_undegraded":"2024-09-20T21:01:13.214311+0000","last_fullsized":"2024-09-20T21:01:13.214311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213490+0000","last_change":"2024-09-20T21:01:12.236761+0000","last_active":"2024-09-20T21:01:13.213490+0000","last_peered":"2024-09-20T21:01:13.213490+0000","last_clean":"2024-09-20T21:01:13.213490+0000","last_became_active":"2024-09-20T21:01:12.235613+0000","last_became_peered":"2024-09-20T21:01:12.235613+0000","last_unstale":"2024-09-20T21:01:13.213490+0000","last_undegraded":"2024-09-20T21:01:13.213490+0000","last_fullsized":"2024-09-20T21:01:13.213490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124520+0000","last_change":"2024-09-20T21:01:12.228562+0000","last_active":"2024-09-20T21:01:14.124520+0000","last_peered":"2024-09-20T21:01:14.124520+0000","last_clean":"2024-09-20T21:01:14.124520+0000","last_became_active":"2024-09-20T21:01:12.224894+0000","last_became_peered":"2024-09-20T21:01:12.224894+0000","last_unstale":"2024-09-20T21:01:14.124520+0000","last_undegraded":"2024-09-20T21:01:14.124520+0000","last_fullsized":"2024-09-20T21:01:14.124520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.657192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123465+0000","last_change":"2024-09-20T21:01:12.227789+0000","last_active":"2024-09-20T21:01:14.123465+0000","last_peered":"2024-09-20T21:01:14.123465+0000","last_clean":"2024-09-20T21:01:14.123465+0000","last_became_active":"2024-09-20T21:01:12.225718+0000","last_became_peered":"2024-09-20T21:01:12.225718+0000","last_unstale":"2024-09-20T21:01:14.123465+0000","last_undegraded":"2024-09-20T21:01:14.123465+0000","last_fullsized":"2024-09-20T21:01:14.123465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:15.226852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213450+0000","last_change":"2024-09-20T21:01:12.232080+0000","last_active":"2024-09-20T21:01:13.213450+0000","last_peered":"2024-09-20T21:01:13.213450+0000","last_clean":"2024-09-20T21:01:13.213450+0000","last_became_active":"2024-09-20T21:01:12.231429+0000","last_became_peered":"2024-09-20T21:01:12.231429+0000","last_unstale":"2024-09-20T21:01:13.213450+0000","last_undegraded":"2024-09-20T21:01:13.213450+0000","last_fullsized":"2024-09-20T21:01:13.213450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122213+0000","last_change":"2024-09-20T21:01:12.231871+0000","last_active":"2024-09-20T21:01:14.122213+0000","last_peered":"2024-09-20T21:01:14.122213+0000","last_clean":"2024-09-20T21:01:14.122213+0000","last_became_active":"2024-09-20T21:01:12.229463+0000","last_became_peered":"2024-09-20T21:01:12.229463+0000","last_unstale":"2024-09-20T21:01:14.122213+0000","last_undegraded":"2024-09-20T21:01:14.122213+0000","last_fullsized":"2024-09-20T21:01:14.122213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122268+0000","last_change":"2024-09-20T21:01:12.226969+0000","last_active":"2024-09-20T21:01:14.122268+0000","last_peered":"2024-09-20T21:01:14.122268+0000","last_clean":"2024-09-20T21:01:14.122268+0000","last_became_active":"2024-09-20T21:01:12.225800+0000","last_became_peered":"2024-09-20T21:01:12.225800+0000","last_unstale":"2024-09-20T21:01:14.122268+0000","last_undegraded":"2024-09-20T21:01:14.122268+0000","last_fullsized":"2024-09-20T21:01:14.122268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.121876+0000","last_change":"2024-09-20T21:01:12.217357+0000","last_active":"2024-09-20T21:01:14.121876+0000","last_peered":"2024-09-20T21:01:14.121876+0000","last_clean":"2024-09-20T21:01:14.121876+0000","last_became_active":"2024-09-20T21:01:12.213483+0000","last_became_peered":"2024-09-20T21:01:12.213483+0000","last_unstale":"2024-09-20T21:01:14.121876+0000","last_undegraded":"2024-09-20T21:01:14.121876+0000","last_fullsized":"2024-09-20T21:01:14.121876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200770+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:01:14.200770+0000","last_peered":"2024-09-20T21:01:14.200770+0000","last_clean":"2024-09-20T21:01:14.200770+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:01:14.200770+0000","last_undegraded":"2024-09-20T21:01:14.200770+0000","last_fullsized":"2024-09-20T21:01:14.200770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213647+0000","last_change":"2024-09-20T21:01:12.240432+0000","last_active":"2024-09-20T21:01:13.213647+0000","last_peered":"2024-09-20T21:01:13.213647+0000","last_clean":"2024-09-20T21:01:13.213647+0000","last_became_active":"2024-09-20T21:01:12.238826+0000","last_became_peered":"2024-09-20T21:01:12.238826+0000","last_unstale":"2024-09-20T21:01:13.213647+0000","last_undegraded":"2024-09-20T21:01:13.213647+0000","last_fullsized":"2024-09-20T21:01:13.213647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123974+0000","last_change":"2024-09-20T21:01:12.213062+0000","last_active":"2024-09-20T21:01:14.123974+0000","last_peered":"2024-09-20T21:01:14.123974+0000","last_clean":"2024-09-20T21:01:14.123974+0000","last_became_active":"2024-09-20T21:01:12.211953+0000","last_became_peered":"2024-09-20T21:01:12.211953+0000","last_unstale":"2024-09-20T21:01:14.123974+0000","last_undegraded":"2024-09-20T21:01:14.123974+0000","last_fullsized":"2024-09-20T21:01:14.123974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.052874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212638+0000","last_change":"2024-09-20T21:01:12.229580+0000","last_active":"2024-09-20T21:01:13.212638+0000","last_peered":"2024-09-20T21:01:13.212638+0000","last_clean":"2024-09-20T21:01:13.212638+0000","last_became_active":"2024-09-20T21:01:12.226915+0000","last_became_peered":"2024-09-20T21:01:12.226915+0000","last_unstale":"2024-09-20T21:01:13.212638+0000","last_undegraded":"2024-09-20T21:01:13.212638+0000","last_fullsized":"2024-09-20T21:01:13.212638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.985765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212841+0000","last_change":"2024-09-20T21:01:12.230410+0000","last_active":"2024-09-20T21:01:13.212841+0000","last_peered":"2024-09-20T21:01:13.212841+0000","last_clean":"2024-09-20T21:01:13.212841+0000","last_became_active":"2024-09-20T21:01:12.229859+0000","last_became_peered":"2024-09-20T21:01:12.229859+0000","last_unstale":"2024-09-20T21:01:13.212841+0000","last_undegraded":"2024-09-20T21:01:13.212841+0000","last_fullsized":"2024-09-20T21:01:13.212841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122301+0000","last_change":"2024-09-20T21:01:12.220376+0000","last_active":"2024-09-20T21:01:14.122301+0000","last_peered":"2024-09-20T21:01:14.122301+0000","last_clean":"2024-09-20T21:01:14.122301+0000","last_became_active":"2024-09-20T21:01:12.219338+0000","last_became_peered":"2024-09-20T21:01:12.219338+0000","last_unstale":"2024-09-20T21:01:14.122301+0000","last_undegraded":"2024-09-20T21:01:14.122301+0000","last_fullsized":"2024-09-20T21:01:14.122301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122306+0000","last_change":"2024-09-20T21:01:12.218884+0000","last_active":"2024-09-20T21:01:14.122306+0000","last_peered":"2024-09-20T21:01:14.122306+0000","last_clean":"2024-09-20T21:01:14.122306+0000","last_became_active":"2024-09-20T21:01:12.218225+0000","last_became_peered":"2024-09-20T21:01:12.218225+0000","last_unstale":"2024-09-20T21:01:14.122306+0000","last_undegraded":"2024-09-20T21:01:14.122306+0000","last_fullsized":"2024-09-20T21:01:14.122306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.121878+0000","last_change":"2024-09-20T21:01:12.214974+0000","last_active":"2024-09-20T21:01:14.121878+0000","last_peered":"2024-09-20T21:01:14.121878+0000","last_clean":"2024-09-20T21:01:14.121878+0000","last_became_active":"2024-09-20T21:01:12.212149+0000","last_became_peered":"2024-09-20T21:01:12.212149+0000","last_unstale":"2024-09-20T21:01:14.121878+0000","last_undegraded":"2024-09-20T21:01:14.121878+0000","last_fullsized":"2024-09-20T21:01:14.121878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201894+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:01:14.201894+0000","last_peered":"2024-09-20T21:01:14.201894+0000","last_clean":"2024-09-20T21:01:14.201894+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:01:14.201894+0000","last_undegraded":"2024-09-20T21:01:14.201894+0000","last_fullsized":"2024-09-20T21:01:14.201894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214150+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:01:13.214150+0000","last_peered":"2024-09-20T21:01:13.214150+0000","last_clean":"2024-09-20T21:01:13.214150+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:01:13.214150+0000","last_undegraded":"2024-09-20T21:01:13.214150+0000","last_fullsized":"2024-09-20T21:01:13.214150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200522+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:01:14.200522+0000","last_peered":"2024-09-20T21:01:14.200522+0000","last_clean":"2024-09-20T21:01:14.200522+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:01:14.200522+0000","last_undegraded":"2024-09-20T21:01:14.200522+0000","last_fullsized":"2024-09-20T21:01:14.200522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123547+0000","last_change":"2024-09-20T21:01:12.212785+0000","last_active":"2024-09-20T21:01:14.123547+0000","last_peered":"2024-09-20T21:01:14.123547+0000","last_clean":"2024-09-20T21:01:14.123547+0000","last_became_active":"2024-09-20T21:01:12.211844+0000","last_became_peered":"2024-09-20T21:01:12.211844+0000","last_unstale":"2024-09-20T21:01:14.123547+0000","last_undegraded":"2024-09-20T21:01:14.123547+0000","last_fullsized":"2024-09-20T21:01:14.123547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:38.821473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123510+0000","last_change":"2024-09-20T21:01:12.210710+0000","last_active":"2024-09-20T21:01:14.123510+0000","last_peered":"2024-09-20T21:01:14.123510+0000","last_clean":"2024-09-20T21:01:14.123510+0000","last_became_active":"2024-09-20T21:01:12.209676+0000","last_became_peered":"2024-09-20T21:01:12.209676+0000","last_unstale":"2024-09-20T21:01:14.123510+0000","last_undegraded":"2024-09-20T21:01:14.123510+0000","last_fullsized":"2024-09-20T21:01:14.123510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:48.442304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213498+0000","last_change":"2024-09-20T21:01:12.230375+0000","last_active":"2024-09-20T21:01:13.213498+0000","last_peered":"2024-09-20T21:01:13.213498+0000","last_clean":"2024-09-20T21:01:13.213498+0000","last_became_active":"2024-09-20T21:01:12.228679+0000","last_became_peered":"2024-09-20T21:01:12.228679+0000","last_unstale":"2024-09-20T21:01:13.213498+0000","last_undegraded":"2024-09-20T21:01:13.213498+0000","last_fullsized":"2024-09-20T21:01:13.213498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199168+0000","last_change":"2024-09-20T21:01:12.214484+0000","last_active":"2024-09-20T21:01:14.199168+0000","last_peered":"2024-09-20T21:01:14.199168+0000","last_clean":"2024-09-20T21:01:14.199168+0000","last_became_active":"2024-09-20T21:01:12.212293+0000","last_became_peered":"2024-09-20T21:01:12.212293+0000","last_unstale":"2024-09-20T21:01:14.199168+0000","last_undegraded":"2024-09-20T21:01:14.199168+0000","last_fullsized":"2024-09-20T21:01:14.199168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212124+0000","last_change":"2024-09-20T21:01:12.229114+0000","last_active":"2024-09-20T21:01:13.212124+0000","last_peered":"2024-09-20T21:01:13.212124+0000","last_clean":"2024-09-20T21:01:13.212124+0000","last_became_active":"2024-09-20T21:01:12.227812+0000","last_became_peered":"2024-09-20T21:01:12.227812+0000","last_unstale":"2024-09-20T21:01:13.212124+0000","last_undegraded":"2024-09-20T21:01:13.212124+0000","last_fullsized":"2024-09-20T21:01:13.212124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:02.638461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214589+0000","last_change":"2024-09-20T21:01:12.237926+0000","last_active":"2024-09-20T21:01:13.214589+0000","last_peered":"2024-09-20T21:01:13.214589+0000","last_clean":"2024-09-20T21:01:13.214589+0000","last_became_active":"2024-09-20T21:01:12.234061+0000","last_became_peered":"2024-09-20T21:01:12.234061+0000","last_unstale":"2024-09-20T21:01:13.214589+0000","last_undegraded":"2024-09-20T21:01:13.214589+0000","last_fullsized":"2024-09-20T21:01:13.214589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201638+0000","last_change":"2024-09-20T21:01:12.214728+0000","last_active":"2024-09-20T21:01:14.201638+0000","last_peered":"2024-09-20T21:01:14.201638+0000","last_clean":"2024-09-20T21:01:14.201638+0000","last_became_active":"2024-09-20T21:01:12.213159+0000","last_became_peered":"2024-09-20T21:01:12.213159+0000","last_unstale":"2024-09-20T21:01:14.201638+0000","last_undegraded":"2024-09-20T21:01:14.201638+0000","last_fullsized":"2024-09-20T21:01:14.201638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124525+0000","last_change":"2024-09-20T21:01:12.227975+0000","last_active":"2024-09-20T21:01:14.124525+0000","last_peered":"2024-09-20T21:01:14.124525+0000","last_clean":"2024-09-20T21:01:14.124525+0000","last_became_active":"2024-09-20T21:01:12.223433+0000","last_became_peered":"2024-09-20T21:01:12.223433+0000","last_unstale":"2024-09-20T21:01:14.124525+0000","last_undegraded":"2024-09-20T21:01:14.124525+0000","last_fullsized":"2024-09-20T21:01:14.124525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:32.017817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213358+0000","last_change":"2024-09-20T21:01:12.227425+0000","last_active":"2024-09-20T21:01:13.213358+0000","last_peered":"2024-09-20T21:01:13.213358+0000","last_clean":"2024-09-20T21:01:13.213358+0000","last_became_active":"2024-09-20T21:01:12.226625+0000","last_became_peered":"2024-09-20T21:01:12.226625+0000","last_unstale":"2024-09-20T21:01:13.213358+0000","last_undegraded":"2024-09-20T21:01:13.213358+0000","last_fullsized":"2024-09-20T21:01:13.213358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200909+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:01:14.200909+0000","last_peered":"2024-09-20T21:01:14.200909+0000","last_clean":"2024-09-20T21:01:14.200909+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:01:14.200909+0000","last_undegraded":"2024-09-20T21:01:14.200909+0000","last_fullsized":"2024-09-20T21:01:14.200909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213141+0000","last_change":"2024-09-20T21:01:12.230684+0000","last_active":"2024-09-20T21:01:13.213141+0000","last_peered":"2024-09-20T21:01:13.213141+0000","last_clean":"2024-09-20T21:01:13.213141+0000","last_became_active":"2024-09-20T21:01:12.229915+0000","last_became_peered":"2024-09-20T21:01:12.229915+0000","last_unstale":"2024-09-20T21:01:13.213141+0000","last_undegraded":"2024-09-20T21:01:13.213141+0000","last_fullsized":"2024-09-20T21:01:13.213141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199024+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:01:14.199024+0000","last_peered":"2024-09-20T21:01:14.199024+0000","last_clean":"2024-09-20T21:01:14.199024+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:01:14.199024+0000","last_undegraded":"2024-09-20T21:01:14.199024+0000","last_fullsized":"2024-09-20T21:01:14.199024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122415+0000","last_change":"2024-09-20T21:01:12.215773+0000","last_active":"2024-09-20T21:01:14.122415+0000","last_peered":"2024-09-20T21:01:14.122415+0000","last_clean":"2024-09-20T21:01:14.122415+0000","last_became_active":"2024-09-20T21:01:12.212199+0000","last_became_peered":"2024-09-20T21:01:12.212199+0000","last_unstale":"2024-09-20T21:01:14.122415+0000","last_undegraded":"2024-09-20T21:01:14.122415+0000","last_fullsized":"2024-09-20T21:01:14.122415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213925+0000","last_change":"2024-09-20T21:01:12.232814+0000","last_active":"2024-09-20T21:01:13.213925+0000","last_peered":"2024-09-20T21:01:13.213925+0000","last_clean":"2024-09-20T21:01:13.213925+0000","last_became_active":"2024-09-20T21:01:12.232026+0000","last_became_peered":"2024-09-20T21:01:12.232026+0000","last_unstale":"2024-09-20T21:01:13.213925+0000","last_undegraded":"2024-09-20T21:01:13.213925+0000","last_fullsized":"2024-09-20T21:01:13.213925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123899+0000","last_change":"2024-09-20T21:01:11.216956+0000","last_active":"2024-09-20T21:01:14.123899+0000","last_peered":"2024-09-20T21:01:14.123899+0000","last_clean":"2024-09-20T21:01:14.123899+0000","last_became_active":"2024-09-20T21:01:11.216462+0000","last_became_peered":"2024-09-20T21:01:11.216462+0000","last_unstale":"2024-09-20T21:01:14.123899+0000","last_undegraded":"2024-09-20T21:01:14.123899+0000","last_fullsized":"2024-09-20T21:01:14.123899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213710+0000","last_change":"2024-09-20T21:01:12.230727+0000","last_active":"2024-09-20T21:01:13.213710+0000","last_peered":"2024-09-20T21:01:13.213710+0000","last_clean":"2024-09-20T21:01:13.213710+0000","last_became_active":"2024-09-20T21:01:12.229987+0000","last_became_peered":"2024-09-20T21:01:12.229987+0000","last_unstale":"2024-09-20T21:01:13.213710+0000","last_undegraded":"2024-09-20T21:01:13.213710+0000","last_fullsized":"2024-09-20T21:01:13.213710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199555+0000","last_change":"2024-09-20T21:01:11.220335+0000","last_active":"2024-09-20T21:01:14.199555+0000","last_peered":"2024-09-20T21:01:14.199555+0000","last_clean":"2024-09-20T21:01:14.199555+0000","last_became_active":"2024-09-20T21:01:11.219506+0000","last_became_peered":"2024-09-20T21:01:11.219506+0000","last_unstale":"2024-09-20T21:01:14.199555+0000","last_undegraded":"2024-09-20T21:01:14.199555+0000","last_fullsized":"2024-09-20T21:01:14.199555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:16:05.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.202043+0000","last_change":"2024-09-20T21:01:12.214329+0000","last_active":"2024-09-20T21:01:14.202043+0000","last_peered":"2024-09-20T21:01:14.202043+0000","last_clean":"2024-09-20T21:01:14.202043+0000","last_became_active":"2024-09-20T21:01:12.212104+0000","last_became_peered":"2024-09-20T21:01:12.212104+0000","last_unstale":"2024-09-20T21:01:14.202043+0000","last_undegraded":"2024-09-20T21:01:14.202043+0000","last_fullsized":"2024-09-20T21:01:14.202043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212170+0000","last_change":"2024-09-20T21:01:11.213590+0000","last_active":"2024-09-20T21:01:13.212170+0000","last_peered":"2024-09-20T21:01:13.212170+0000","last_clean":"2024-09-20T21:01:13.212170+0000","last_became_active":"2024-09-20T21:01:11.212919+0000","last_became_peered":"2024-09-20T21:01:11.212919+0000","last_unstale":"2024-09-20T21:01:13.212170+0000","last_undegraded":"2024-09-20T21:01:13.212170+0000","last_fullsized":"2024-09-20T21:01:13.212170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.040754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201236+0000","last_change":"2024-09-20T21:01:12.214556+0000","last_active":"2024-09-20T21:01:14.201236+0000","last_peered":"2024-09-20T21:01:14.201236+0000","last_clean":"2024-09-20T21:01:14.201236+0000","last_became_active":"2024-09-20T21:01:12.212508+0000","last_became_peered":"2024-09-20T21:01:12.212508+0000","last_unstale":"2024-09-20T21:01:14.201236+0000","last_undegraded":"2024-09-20T21:01:14.201236+0000","last_fullsized":"2024-09-20T21:01:14.201236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122423+0000","last_change":"2024-09-20T21:01:11.224946+0000","last_active":"2024-09-20T21:01:14.122423+0000","last_peered":"2024-09-20T21:01:14.122423+0000","last_clean":"2024-09-20T21:01:14.122423+0000","last_became_active":"2024-09-20T21:01:11.224026+0000","last_became_peered":"2024-09-20T21:01:11.224026+0000","last_unstale":"2024-09-20T21:01:14.122423+0000","last_undegraded":"2024-09-20T21:01:14.122423+0000","last_fullsized":"2024-09-20T21:01:14.122423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124768+0000","last_change":"2024-09-20T21:01:11.221253+0000","last_active":"2024-09-20T21:01:14.124768+0000","last_peered":"2024-09-20T21:01:14.124768+0000","last_clean":"2024-09-20T21:01:14.124768+0000","last_became_active":"2024-09-20T21:01:11.220476+0000","last_became_peered":"2024-09-20T21:01:11.220476+0000","last_unstale":"2024-09-20T21:01:14.124768+0000","last_undegraded":"2024-09-20T21:01:14.124768+0000","last_fullsized":"2024-09-20T21:01:14.124768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.211746+0000","last_change":"2024-09-20T21:01:12.229503+0000","last_active":"2024-09-20T21:01:13.211746+0000","last_peered":"2024-09-20T21:01:13.211746+0000","last_clean":"2024-09-20T21:01:13.211746+0000","last_became_active":"2024-09-20T21:01:12.228540+0000","last_became_peered":"2024-09-20T21:01:12.228540+0000","last_unstale":"2024-09-20T21:01:13.211746+0000","last_undegraded":"2024-09-20T21:01:13.211746+0000","last_fullsized":"2024-09-20T21:01:13.211746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:13.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214449+0000","last_change":"2024-09-20T21:01:11.214247+0000","last_active":"2024-09-20T21:01:13.214449+0000","last_peered":"2024-09-20T21:01:13.214449+0000","last_clean":"2024-09-20T21:01:13.214449+0000","last_became_active":"2024-09-20T21:01:11.212760+0000","last_became_peered":"2024-09-20T21:01:11.212760+0000","last_unstale":"2024-09-20T21:01:13.214449+0000","last_undegraded":"2024-09-20T21:01:13.214449+0000","last_fullsized":"2024-09-20T21:01:13.214449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:20.108703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.211910+0000","last_change":"2024-09-20T21:01:12.238294+0000","last_active":"2024-09-20T21:01:13.211910+0000","last_peered":"2024-09-20T21:01:13.211910+0000","last_clean":"2024-09-20T21:01:13.211910+0000","last_became_active":"2024-09-20T21:01:12.237461+0000","last_became_peered":"2024-09-20T21:01:12.237461+0000","last_unstale":"2024-09-20T21:01:13.211910+0000","last_undegraded":"2024-09-20T21:01:13.211910+0000","last_fullsized":"2024-09-20T21:01:13.211910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:11.215425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.125136+0000","last_change":"2024-09-20T21:01:11.221716+0000","last_active":"2024-09-20T21:01:14.125136+0000","last_peered":"2024-09-20T21:01:14.125136+0000","last_clean":"2024-09-20T21:01:14.125136+0000","last_became_active":"2024-09-20T21:01:11.220620+0000","last_became_peered":"2024-09-20T21:01:11.220620+0000","last_unstale":"2024-09-20T21:01:14.125136+0000","last_undegraded":"2024-09-20T21:01:14.125136+0000","last_fullsized":"2024-09-20T21:01:14.125136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:13.593747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123197+0000","last_change":"2024-09-20T21:01:12.210785+0000","last_active":"2024-09-20T21:01:14.123197+0000","last_peered":"2024-09-20T21:01:14.123197+0000","last_clean":"2024-09-20T21:01:14.123197+0000","last_became_active":"2024-09-20T21:01:12.209489+0000","last_became_peered":"2024-09-20T21:01:12.209489+0000","last_unstale":"2024-09-20T21:01:14.123197+0000","last_undegraded":"2024-09-20T21:01:14.123197+0000","last_fullsized":"2024-09-20T21:01:14.123197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124280+0000","last_change":"2024-09-20T21:01:11.217199+0000","last_active":"2024-09-20T21:01:14.124280+0000","last_peered":"2024-09-20T21:01:14.124280+0000","last_clean":"2024-09-20T21:01:14.124280+0000","last_became_active":"2024-09-20T21:01:11.216370+0000","last_became_peered":"2024-09-20T21:01:11.216370+0000","last_unstale":"2024-09-20T21:01:14.124280+0000","last_undegraded":"2024-09-20T21:01:14.124280+0000","last_fullsized":"2024-09-20T21:01:14.124280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200309+0000","last_change":"2024-09-20T21:01:12.220592+0000","last_active":"2024-09-20T21:01:14.200309+0000","last_peered":"2024-09-20T21:01:14.200309+0000","last_clean":"2024-09-20T21:01:14.200309+0000","last_became_active":"2024-09-20T21:01:12.219682+0000","last_became_peered":"2024-09-20T21:01:12.219682+0000","last_unstale":"2024-09-20T21:01:14.200309+0000","last_undegraded":"2024-09-20T21:01:14.200309+0000","last_fullsized":"2024-09-20T21:01:14.200309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200717+0000","last_change":"2024-09-20T21:01:11.220548+0000","last_active":"2024-09-20T21:01:14.200717+0000","last_peered":"2024-09-20T21:01:14.200717+0000","last_clean":"2024-09-20T21:01:14.200717+0000","last_became_active":"2024-09-20T21:01:11.219847+0000","last_became_peered":"2024-09-20T21:01:11.219847+0000","last_unstale":"2024-09-20T21:01:14.200717+0000","last_undegraded":"2024-09-20T21:01:14.200717+0000","last_fullsized":"2024-09-20T21:01:14.200717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123890+0000","last_change":"2024-09-20T21:01:12.211812+0000","last_active":"2024-09-20T21:01:14.123890+0000","last_peered":"2024-09-20T21:01:14.123890+0000","last_clean":"2024-09-20T21:01:14.123890+0000","last_became_active":"2024-09-20T21:01:12.209826+0000","last_became_peered":"2024-09-20T21:01:12.209826+0000","last_unstale":"2024-09-20T21:01:14.123890+0000","last_undegraded":"2024-09-20T21:01:14.123890+0000","last_fullsized":"2024-09-20T21:01:14.123890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:46:41.210017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124551+0000","last_change":"2024-09-20T21:01:11.219106+0000","last_active":"2024-09-20T21:01:14.124551+0000","last_peered":"2024-09-20T21:01:14.124551+0000","last_clean":"2024-09-20T21:01:14.124551+0000","last_became_active":"2024-09-20T21:01:11.218259+0000","last_became_peered":"2024-09-20T21:01:11.218259+0000","last_unstale":"2024-09-20T21:01:14.124551+0000","last_undegraded":"2024-09-20T21:01:14.124551+0000","last_fullsized":"2024-09-20T21:01:14.124551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124978+0000","last_change":"2024-09-20T21:01:12.225987+0000","last_active":"2024-09-20T21:01:14.124978+0000","last_peered":"2024-09-20T21:01:14.124978+0000","last_clean":"2024-09-20T21:01:14.124978+0000","last_became_active":"2024-09-20T21:01:12.222916+0000","last_became_peered":"2024-09-20T21:01:12.222916+0000","last_unstale":"2024-09-20T21:01:14.124978+0000","last_undegraded":"2024-09-20T21:01:14.124978+0000","last_fullsized":"2024-09-20T21:01:14.124978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:16.681572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213152+0000","last_change":"2024-09-20T21:01:11.213371+0000","last_active":"2024-09-20T21:01:13.213152+0000","last_peered":"2024-09-20T21:01:13.213152+0000","last_clean":"2024-09-20T21:01:13.213152+0000","last_became_active":"2024-09-20T21:01:11.212385+0000","last_became_peered":"2024-09-20T21:01:11.212385+0000","last_unstale":"2024-09-20T21:01:13.213152+0000","last_undegraded":"2024-09-20T21:01:13.213152+0000","last_fullsized":"2024-09-20T21:01:13.213152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:56.734999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124036+0000","last_change":"2024-09-20T21:01:12.202841+0000","last_active":"2024-09-20T21:01:14.124036+0000","last_peered":"2024-09-20T21:01:14.124036+0000","last_clean":"2024-09-20T21:01:14.124036+0000","last_became_active":"2024-09-20T21:01:12.201016+0000","last_became_peered":"2024-09-20T21:01:12.201016+0000","last_unstale":"2024-09-20T21:01:14.124036+0000","last_undegraded":"2024-09-20T21:01:14.124036+0000","last_fullsized":"2024-09-20T21:01:14.124036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:55.984268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212340+0000","last_change":"2024-09-20T21:01:11.220785+0000","last_active":"2024-09-20T21:01:13.212340+0000","last_peered":"2024-09-20T21:01:13.212340+0000","last_clean":"2024-09-20T21:01:13.212340+0000","last_became_active":"2024-09-20T21:01:11.220111+0000","last_became_peered":"2024-09-20T21:01:11.220111+0000","last_unstale":"2024-09-20T21:01:13.212340+0000","last_undegraded":"2024-09-20T21:01:13.212340+0000","last_fullsized":"2024-09-20T21:01:13.212340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.621763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201099+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:01:14.201099+0000","last_peered":"2024-09-20T21:01:14.201099+0000","last_clean":"2024-09-20T21:01:14.201099+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:01:14.201099+0000","last_undegraded":"2024-09-20T21:01:14.201099+0000","last_fullsized":"2024-09-20T21:01:14.201099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":224,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123095+0000","last_change":"2024-09-20T21:01:02.293432+0000","last_active":"2024-09-20T21:01:14.123095+0000","last_peered":"2024-09-20T21:01:14.123095+0000","last_clean":"2024-09-20T21:01:14.123095+0000","last_became_active":"2024-09-20T21:01:02.291361+0000","last_became_peered":"2024-09-20T21:01:02.291361+0000","last_unstale":"2024-09-20T21:01:14.123095+0000","last_undegraded":"2024-09-20T21:01:14.123095+0000","last_fullsized":"2024-09-20T21:01:14.123095+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:52.935898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124386+0000","last_change":"2024-09-20T21:01:09.031119+0000","last_active":"2024-09-20T21:01:14.124386+0000","last_peered":"2024-09-20T21:01:14.124386+0000","last_clean":"2024-09-20T21:01:14.124386+0000","last_became_active":"2024-09-20T21:01:06.994429+0000","last_became_peered":"2024-09-20T21:01:06.994429+0000","last_unstale":"2024-09-20T21:01:14.124386+0000","last_undegraded":"2024-09-20T21:01:14.124386+0000","last_fullsized":"2024-09-20T21:01:14.124386+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:47.585068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025064900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199836+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:01:14.199836+0000","last_peered":"2024-09-20T21:01:14.199836+0000","last_clean":"2024-09-20T21:01:14.199836+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:01:14.199836+0000","last_undegraded":"2024-09-20T21:01:14.199836+0000","last_fullsized":"2024-09-20T21:01:14.199836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.125031+0000","last_change":"2024-09-20T21:01:12.224024+0000","last_active":"2024-09-20T21:01:14.125031+0000","last_peered":"2024-09-20T21:01:14.125031+0000","last_clean":"2024-09-20T21:01:14.125031+0000","last_became_active":"2024-09-20T21:01:12.222433+0000","last_became_peered":"2024-09-20T21:01:12.222433+0000","last_unstale":"2024-09-20T21:01:14.125031+0000","last_undegraded":"2024-09-20T21:01:14.125031+0000","last_fullsized":"2024-09-20T21:01:14.125031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:23.486608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122691+0000","last_change":"2024-09-20T21:01:09.029382+0000","last_active":"2024-09-20T21:01:14.122691+0000","last_peered":"2024-09-20T21:01:14.122691+0000","last_clean":"2024-09-20T21:01:14.122691+0000","last_became_active":"2024-09-20T21:01:06.997340+0000","last_became_peered":"2024-09-20T21:01:06.997340+0000","last_unstale":"2024-09-20T21:01:14.122691+0000","last_undegraded":"2024-09-20T21:01:14.122691+0000","last_fullsized":"2024-09-20T21:01:14.122691+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:25:22.179131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081948399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200224+0000","last_change":"2024-09-20T21:01:11.220462+0000","last_active":"2024-09-20T21:01:14.200224+0000","last_peered":"2024-09-20T21:01:14.200224+0000","last_clean":"2024-09-20T21:01:14.200224+0000","last_became_active":"2024-09-20T21:01:11.219778+0000","last_became_peered":"2024-09-20T21:01:11.219778+0000","last_unstale":"2024-09-20T21:01:14.200224+0000","last_undegraded":"2024-09-20T21:01:14.200224+0000","last_fullsized":"2024-09-20T21:01:14.200224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:08.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214544+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:01:13.214544+0000","last_peered":"2024-09-20T21:01:13.214544+0000","last_clean":"2024-09-20T21:01:13.214544+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:01:13.214544+0000","last_undegraded":"2024-09-20T21:01:13.214544+0000","last_fullsized":"2024-09-20T21:01:13.214544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200370+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:01:14.200370+0000","last_peered":"2024-09-20T21:01:14.200370+0000","last_clean":"2024-09-20T21:01:14.200370+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:01:14.200370+0000","last_undegraded":"2024-09-20T21:01:14.200370+0000","last_fullsized":"2024-09-20T21:01:14.200370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213846+0000","last_change":"2024-09-20T21:01:11.217295+0000","last_active":"2024-09-20T21:01:13.213846+0000","last_peered":"2024-09-20T21:01:13.213846+0000","last_clean":"2024-09-20T21:01:13.213846+0000","last_became_active":"2024-09-20T21:01:11.216350+0000","last_became_peered":"2024-09-20T21:01:11.216350+0000","last_unstale":"2024-09-20T21:01:13.213846+0000","last_undegraded":"2024-09-20T21:01:13.213846+0000","last_fullsized":"2024-09-20T21:01:13.213846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:59.661622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201362+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:01:14.201362+0000","last_peered":"2024-09-20T21:01:14.201362+0000","last_clean":"2024-09-20T21:01:14.201362+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:01:14.201362+0000","last_undegraded":"2024-09-20T21:01:14.201362+0000","last_fullsized":"2024-09-20T21:01:14.201362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123352+0000","last_change":"2024-09-20T21:01:09.030841+0000","last_active":"2024-09-20T21:01:14.123352+0000","last_peered":"2024-09-20T21:01:14.123352+0000","last_clean":"2024-09-20T21:01:14.123352+0000","last_became_active":"2024-09-20T21:01:06.994033+0000","last_became_peered":"2024-09-20T21:01:06.994033+0000","last_unstale":"2024-09-20T21:01:14.123352+0000","last_undegraded":"2024-09-20T21:01:14.123352+0000","last_fullsized":"2024-09-20T21:01:14.123352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:57.919077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022137329999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124182+0000","last_change":"2024-09-20T21:01:11.217114+0000","last_active":"2024-09-20T21:01:14.124182+0000","last_peered":"2024-09-20T21:01:14.124182+0000","last_clean":"2024-09-20T21:01:14.124182+0000","last_became_active":"2024-09-20T21:01:11.215974+0000","last_became_peered":"2024-09-20T21:01:11.215974+0000","last_unstale":"2024-09-20T21:01:14.124182+0000","last_undegraded":"2024-09-20T21:01:14.124182+0000","last_fullsized":"2024-09-20T21:01:14.124182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200880+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:01:14.200880+0000","last_peered":"2024-09-20T21:01:14.200880+0000","last_clean":"2024-09-20T21:01:14.200880+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:01:14.200880+0000","last_undegraded":"2024-09-20T21:01:14.200880+0000","last_fullsized":"2024-09-20T21:01:14.200880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.125164+0000","last_change":"2024-09-20T21:01:11.217713+0000","last_active":"2024-09-20T21:01:14.125164+0000","last_peered":"2024-09-20T21:01:14.125164+0000","last_clean":"2024-09-20T21:01:14.125164+0000","last_became_active":"2024-09-20T21:01:11.215699+0000","last_became_peered":"2024-09-20T21:01:11.215699+0000","last_unstale":"2024-09-20T21:01:14.125164+0000","last_undegraded":"2024-09-20T21:01:14.125164+0000","last_fullsized":"2024-09-20T21:01:14.125164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:06.986446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201259+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:01:14.201259+0000","last_peered":"2024-09-20T21:01:14.201259+0000","last_clean":"2024-09-20T21:01:14.201259+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:01:14.201259+0000","last_undegraded":"2024-09-20T21:01:14.201259+0000","last_fullsized":"2024-09-20T21:01:14.201259+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212682+0000","last_change":"2024-09-20T21:01:12.227746+0000","last_active":"2024-09-20T21:01:13.212682+0000","last_peered":"2024-09-20T21:01:13.212682+0000","last_clean":"2024-09-20T21:01:13.212682+0000","last_became_active":"2024-09-20T21:01:12.226860+0000","last_became_peered":"2024-09-20T21:01:12.226860+0000","last_unstale":"2024-09-20T21:01:13.212682+0000","last_undegraded":"2024-09-20T21:01:13.212682+0000","last_fullsized":"2024-09-20T21:01:13.212682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:02.144980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201156+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:01:14.201156+0000","last_peered":"2024-09-20T21:01:14.201156+0000","last_clean":"2024-09-20T21:01:14.201156+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:01:14.201156+0000","last_undegraded":"2024-09-20T21:01:14.201156+0000","last_fullsized":"2024-09-20T21:01:14.201156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214353+0000","last_change":"2024-09-20T21:01:09.385616+0000","last_active":"2024-09-20T21:01:13.214353+0000","last_peered":"2024-09-20T21:01:13.214353+0000","last_clean":"2024-09-20T21:01:13.214353+0000","last_became_active":"2024-09-20T21:01:07.000811+0000","last_became_peered":"2024-09-20T21:01:07.000811+0000","last_unstale":"2024-09-20T21:01:13.214353+0000","last_undegraded":"2024-09-20T21:01:13.214353+0000","last_fullsized":"2024-09-20T21:01:13.214353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:03.917240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077098100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212840+0000","last_change":"2024-09-20T21:01:12.227533+0000","last_active":"2024-09-20T21:01:13.212840+0000","last_peered":"2024-09-20T21:01:13.212840+0000","last_clean":"2024-09-20T21:01:13.212840+0000","last_became_active":"2024-09-20T21:01:12.226676+0000","last_became_peered":"2024-09-20T21:01:12.226676+0000","last_unstale":"2024-09-20T21:01:13.212840+0000","last_undegraded":"2024-09-20T21:01:13.212840+0000","last_fullsized":"2024-09-20T21:01:13.212840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201745+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:01:14.201745+0000","last_peered":"2024-09-20T21:01:14.201745+0000","last_clean":"2024-09-20T21:01:14.201745+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:01:14.201745+0000","last_undegraded":"2024-09-20T21:01:14.201745+0000","last_fullsized":"2024-09-20T21:01:14.201745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.202521+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:01:14.202521+0000","last_peered":"2024-09-20T21:01:14.202521+0000","last_clean":"2024-09-20T21:01:14.202521+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:01:14.202521+0000","last_undegraded":"2024-09-20T21:01:14.202521+0000","last_fullsized":"2024-09-20T21:01:14.202521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199393+0000","last_change":"2024-09-20T21:01:12.227354+0000","last_active":"2024-09-20T21:01:14.199393+0000","last_peered":"2024-09-20T21:01:14.199393+0000","last_clean":"2024-09-20T21:01:14.199393+0000","last_became_active":"2024-09-20T21:01:12.226078+0000","last_became_peered":"2024-09-20T21:01:12.226078+0000","last_unstale":"2024-09-20T21:01:14.199393+0000","last_undegraded":"2024-09-20T21:01:14.199393+0000","last_fullsized":"2024-09-20T21:01:14.199393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.205378+0000","last_change":"2024-09-20T21:01:11.220479+0000","last_active":"2024-09-20T21:01:14.205378+0000","last_peered":"2024-09-20T21:01:14.205378+0000","last_clean":"2024-09-20T21:01:14.205378+0000","last_became_active":"2024-09-20T21:01:11.219658+0000","last_became_peered":"2024-09-20T21:01:11.219658+0000","last_unstale":"2024-09-20T21:01:14.205378+0000","last_undegraded":"2024-09-20T21:01:14.205378+0000","last_fullsized":"2024-09-20T21:01:14.205378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124793+0000","last_change":"2024-09-20T21:01:09.029413+0000","last_active":"2024-09-20T21:01:14.124793+0000","last_peered":"2024-09-20T21:01:14.124793+0000","last_clean":"2024-09-20T21:01:14.124793+0000","last_became_active":"2024-09-20T21:01:06.997186+0000","last_became_peered":"2024-09-20T21:01:06.997186+0000","last_unstale":"2024-09-20T21:01:14.124793+0000","last_undegraded":"2024-09-20T21:01:14.124793+0000","last_fullsized":"2024-09-20T21:01:14.124793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:09:55.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.211937+0000","last_change":"2024-09-20T21:01:12.228307+0000","last_active":"2024-09-20T21:01:13.211937+0000","last_peered":"2024-09-20T21:01:13.211937+0000","last_clean":"2024-09-20T21:01:13.211937+0000","last_became_active":"2024-09-20T21:01:12.226322+0000","last_became_peered":"2024-09-20T21:01:12.226322+0000","last_unstale":"2024-09-20T21:01:13.211937+0000","last_undegraded":"2024-09-20T21:01:13.211937+0000","last_fullsized":"2024-09-20T21:01:13.211937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:52.194070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124559+0000","last_change":"2024-09-20T21:01:12.220324+0000","last_active":"2024-09-20T21:01:14.124559+0000","last_peered":"2024-09-20T21:01:14.124559+0000","last_clean":"2024-09-20T21:01:14.124559+0000","last_became_active":"2024-09-20T21:01:12.219327+0000","last_became_peered":"2024-09-20T21:01:12.219327+0000","last_unstale":"2024-09-20T21:01:14.124559+0000","last_undegraded":"2024-09-20T21:01:14.124559+0000","last_fullsized":"2024-09-20T21:01:14.124559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:56.030003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124171+0000","last_change":"2024-09-20T21:01:11.221231+0000","last_active":"2024-09-20T21:01:14.124171+0000","last_peered":"2024-09-20T21:01:14.124171+0000","last_clean":"2024-09-20T21:01:14.124171+0000","last_became_active":"2024-09-20T21:01:11.220426+0000","last_became_peered":"2024-09-20T21:01:11.220426+0000","last_unstale":"2024-09-20T21:01:14.124171+0000","last_undegraded":"2024-09-20T21:01:14.124171+0000","last_fullsized":"2024-09-20T21:01:14.124171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199268+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:01:14.199268+0000","last_peered":"2024-09-20T21:01:14.199268+0000","last_clean":"2024-09-20T21:01:14.199268+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:01:14.199268+0000","last_undegraded":"2024-09-20T21:01:14.199268+0000","last_fullsized":"2024-09-20T21:01:14.199268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214207+0000","last_change":"2024-09-20T21:01:11.220027+0000","last_active":"2024-09-20T21:01:13.214207+0000","last_peered":"2024-09-20T21:01:13.214207+0000","last_clean":"2024-09-20T21:01:13.214207+0000","last_became_active":"2024-09-20T21:01:11.218551+0000","last_became_peered":"2024-09-20T21:01:11.218551+0000","last_unstale":"2024-09-20T21:01:13.214207+0000","last_undegraded":"2024-09-20T21:01:13.214207+0000","last_fullsized":"2024-09-20T21:01:13.214207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:47:59.918561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124358+0000","last_change":"2024-09-20T21:01:11.218922+0000","last_active":"2024-09-20T21:01:14.124358+0000","last_peered":"2024-09-20T21:01:14.124358+0000","last_clean":"2024-09-20T21:01:14.124358+0000","last_became_active":"2024-09-20T21:01:11.218028+0000","last_became_peered":"2024-09-20T21:01:11.218028+0000","last_unstale":"2024-09-20T21:01:14.124358+0000","last_undegraded":"2024-09-20T21:01:14.124358+0000","last_fullsized":"2024-09-20T21:01:14.124358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199534+0000","last_change":"2024-09-20T21:01:12.211553+0000","last_active":"2024-09-20T21:01:14.199534+0000","last_peered":"2024-09-20T21:01:14.199534+0000","last_clean":"2024-09-20T21:01:14.199534+0000","last_became_active":"2024-09-20T21:01:12.210101+0000","last_became_peered":"2024-09-20T21:01:12.210101+0000","last_unstale":"2024-09-20T21:01:14.199534+0000","last_undegraded":"2024-09-20T21:01:14.199534+0000","last_fullsized":"2024-09-20T21:01:14.199534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201601+0000","last_change":"2024-09-20T21:01:11.221867+0000","last_active":"2024-09-20T21:01:14.201601+0000","last_peered":"2024-09-20T21:01:14.201601+0000","last_clean":"2024-09-20T21:01:14.201601+0000","last_became_active":"2024-09-20T21:01:11.220980+0000","last_became_peered":"2024-09-20T21:01:11.220980+0000","last_unstale":"2024-09-20T21:01:14.201601+0000","last_undegraded":"2024-09-20T21:01:14.201601+0000","last_fullsized":"2024-09-20T21:01:14.201601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199627+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:01:14.199627+0000","last_peered":"2024-09-20T21:01:14.199627+0000","last_clean":"2024-09-20T21:01:14.199627+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:01:14.199627+0000","last_undegraded":"2024-09-20T21:01:14.199627+0000","last_fullsized":"2024-09-20T21:01:14.199627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214582+0000","last_change":"2024-09-20T21:01:12.236819+0000","last_active":"2024-09-20T21:01:13.214582+0000","last_peered":"2024-09-20T21:01:13.214582+0000","last_clean":"2024-09-20T21:01:13.214582+0000","last_became_active":"2024-09-20T21:01:12.233922+0000","last_became_peered":"2024-09-20T21:01:12.233922+0000","last_unstale":"2024-09-20T21:01:13.214582+0000","last_undegraded":"2024-09-20T21:01:13.214582+0000","last_fullsized":"2024-09-20T21:01:13.214582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199708+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:01:14.199708+0000","last_peered":"2024-09-20T21:01:14.199708+0000","last_clean":"2024-09-20T21:01:14.199708+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:01:14.199708+0000","last_undegraded":"2024-09-20T21:01:14.199708+0000","last_fullsized":"2024-09-20T21:01:14.199708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201257+0000","last_change":"2024-09-20T21:01:12.227395+0000","last_active":"2024-09-20T21:01:14.201257+0000","last_peered":"2024-09-20T21:01:14.201257+0000","last_clean":"2024-09-20T21:01:14.201257+0000","last_became_active":"2024-09-20T21:01:12.226122+0000","last_became_peered":"2024-09-20T21:01:12.226122+0000","last_unstale":"2024-09-20T21:01:14.201257+0000","last_undegraded":"2024-09-20T21:01:14.201257+0000","last_fullsized":"2024-09-20T21:01:14.201257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199924+0000","last_change":"2024-09-20T21:01:11.220367+0000","last_active":"2024-09-20T21:01:14.199924+0000","last_peered":"2024-09-20T21:01:14.199924+0000","last_clean":"2024-09-20T21:01:14.199924+0000","last_became_active":"2024-09-20T21:01:11.219090+0000","last_became_peered":"2024-09-20T21:01:11.219090+0000","last_unstale":"2024-09-20T21:01:14.199924+0000","last_undegraded":"2024-09-20T21:01:14.199924+0000","last_fullsized":"2024-09-20T21:01:14.199924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213645+0000","last_change":"2024-09-20T21:01:12.238895+0000","last_active":"2024-09-20T21:01:13.213645+0000","last_peered":"2024-09-20T21:01:13.213645+0000","last_clean":"2024-09-20T21:01:13.213645+0000","last_became_active":"2024-09-20T21:01:12.235481+0000","last_became_peered":"2024-09-20T21:01:12.235481+0000","last_unstale":"2024-09-20T21:01:13.213645+0000","last_undegraded":"2024-09-20T21:01:13.213645+0000","last_fullsized":"2024-09-20T21:01:13.213645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213441+0000","last_change":"2024-09-20T21:01:11.217493+0000","last_active":"2024-09-20T21:01:13.213441+0000","last_peered":"2024-09-20T21:01:13.213441+0000","last_clean":"2024-09-20T21:01:13.213441+0000","last_became_active":"2024-09-20T21:01:11.216073+0000","last_became_peered":"2024-09-20T21:01:11.216073+0000","last_unstale":"2024-09-20T21:01:13.213441+0000","last_undegraded":"2024-09-20T21:01:13.213441+0000","last_fullsized":"2024-09-20T21:01:13.213441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:23:30.512126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212929+0000","last_change":"2024-09-20T21:01:12.232371+0000","last_active":"2024-09-20T21:01:13.212929+0000","last_peered":"2024-09-20T21:01:13.212929+0000","last_clean":"2024-09-20T21:01:13.212929+0000","last_became_active":"2024-09-20T21:01:12.231450+0000","last_became_peered":"2024-09-20T21:01:12.231450+0000","last_unstale":"2024-09-20T21:01:13.212929+0000","last_undegraded":"2024-09-20T21:01:13.212929+0000","last_fullsized":"2024-09-20T21:01:13.212929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213202+0000","last_change":"2024-09-20T21:01:11.218440+0000","last_active":"2024-09-20T21:01:13.213202+0000","last_peered":"2024-09-20T21:01:13.213202+0000","last_clean":"2024-09-20T21:01:13.213202+0000","last_became_active":"2024-09-20T21:01:11.217722+0000","last_became_peered":"2024-09-20T21:01:11.217722+0000","last_unstale":"2024-09-20T21:01:13.213202+0000","last_undegraded":"2024-09-20T21:01:13.213202+0000","last_fullsized":"2024-09-20T21:01:13.213202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:11:02.101254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122468+0000","last_change":"2024-09-20T21:01:12.212994+0000","last_active":"2024-09-20T21:01:14.122468+0000","last_peered":"2024-09-20T21:01:14.122468+0000","last_clean":"2024-09-20T21:01:14.122468+0000","last_became_active":"2024-09-20T21:01:12.211080+0000","last_became_peered":"2024-09-20T21:01:12.211080+0000","last_unstale":"2024-09-20T21:01:14.122468+0000","last_undegraded":"2024-09-20T21:01:14.122468+0000","last_fullsized":"2024-09-20T21:01:14.122468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123828+0000","last_change":"2024-09-20T21:01:11.217211+0000","last_active":"2024-09-20T21:01:14.123828+0000","last_peered":"2024-09-20T21:01:14.123828+0000","last_clean":"2024-09-20T21:01:14.123828+0000","last_became_active":"2024-09-20T21:01:11.216428+0000","last_became_peered":"2024-09-20T21:01:11.216428+0000","last_unstale":"2024-09-20T21:01:14.123828+0000","last_undegraded":"2024-09-20T21:01:14.123828+0000","last_fullsized":"2024-09-20T21:01:14.123828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123054+0000","last_change":"2024-09-20T21:01:12.214965+0000","last_active":"2024-09-20T21:01:14.123054+0000","last_peered":"2024-09-20T21:01:14.123054+0000","last_clean":"2024-09-20T21:01:14.123054+0000","last_became_active":"2024-09-20T21:01:12.211534+0000","last_became_peered":"2024-09-20T21:01:12.211534+0000","last_unstale":"2024-09-20T21:01:14.123054+0000","last_undegraded":"2024-09-20T21:01:14.123054+0000","last_fullsized":"2024-09-20T21:01:14.123054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214039+0000","last_change":"2024-09-20T21:01:11.220332+0000","last_active":"2024-09-20T21:01:13.214039+0000","last_peered":"2024-09-20T21:01:13.214039+0000","last_clean":"2024-09-20T21:01:13.214039+0000","last_became_active":"2024-09-20T21:01:11.219022+0000","last_became_peered":"2024-09-20T21:01:11.219022+0000","last_unstale":"2024-09-20T21:01:13.214039+0000","last_undegraded":"2024-09-20T21:01:13.214039+0000","last_fullsized":"2024-09-20T21:01:13.214039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.928114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212865+0000","last_change":"2024-09-20T21:01:12.238819+0000","last_active":"2024-09-20T21:01:13.212865+0000","last_peered":"2024-09-20T21:01:13.212865+0000","last_clean":"2024-09-20T21:01:13.212865+0000","last_became_active":"2024-09-20T21:01:12.237939+0000","last_became_peered":"2024-09-20T21:01:12.237939+0000","last_unstale":"2024-09-20T21:01:13.212865+0000","last_undegraded":"2024-09-20T21:01:13.212865+0000","last_fullsized":"2024-09-20T21:01:13.212865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201776+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:01:14.201776+0000","last_peered":"2024-09-20T21:01:14.201776+0000","last_clean":"2024-09-20T21:01:14.201776+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:01:14.201776+0000","last_undegraded":"2024-09-20T21:01:14.201776+0000","last_fullsized":"2024-09-20T21:01:14.201776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123061+0000","last_change":"2024-09-20T21:01:12.213562+0000","last_active":"2024-09-20T21:01:14.123061+0000","last_peered":"2024-09-20T21:01:14.123061+0000","last_clean":"2024-09-20T21:01:14.123061+0000","last_became_active":"2024-09-20T21:01:12.210781+0000","last_became_peered":"2024-09-20T21:01:12.210781+0000","last_unstale":"2024-09-20T21:01:14.123061+0000","last_undegraded":"2024-09-20T21:01:14.123061+0000","last_fullsized":"2024-09-20T21:01:14.123061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201509+0000","last_change":"2024-09-20T21:01:11.222738+0000","last_active":"2024-09-20T21:01:14.201509+0000","last_peered":"2024-09-20T21:01:14.201509+0000","last_clean":"2024-09-20T21:01:14.201509+0000","last_became_active":"2024-09-20T21:01:11.221990+0000","last_became_peered":"2024-09-20T21:01:11.221990+0000","last_unstale":"2024-09-20T21:01:14.201509+0000","last_undegraded":"2024-09-20T21:01:14.201509+0000","last_fullsized":"2024-09-20T21:01:14.201509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":249856,"data_stored":651168,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":651803,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:01:15.182 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:01:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:15.531 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:01:15.548 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-20T21:01:14.982380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90076,"kb_used_data":672,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025444,"statfs":{"total":289910292480,"available":289818054656,"internally_reserved":0,"allocated":688128,"data_stored":1362612,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4788,"internal_metadata":91483468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.125264"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214311+0000","last_change":"2024-09-20T21:01:12.240709+0000","last_active":"2024-09-20T21:01:13.214311+0000","last_peered":"2024-09-20T21:01:13.214311+0000","last_clean":"2024-09-20T21:01:13.214311+0000","last_became_active":"2024-09-20T21:01:12.239599+0000","last_became_peered":"2024-09-20T21:01:12.239599+0000","last_unstale":"2024-09-20T21:01:13.214311+0000","last_undegraded":"2024-09-20T21:01:13.214311+0000","last_fullsized":"2024-09-20T21:01:13.214311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213490+0000","last_change":"2024-09-20T21:01:12.236761+0000","last_active":"2024-09-20T21:01:13.213490+0000","last_peered":"2024-09-20T21:01:13.213490+0000","last_clean":"2024-09-20T21:01:13.213490+0000","last_became_active":"2024-09-20T21:01:12.235613+0000","last_became_peered":"2024-09-20T21:01:12.235613+0000","last_unstale":"2024-09-20T21:01:13.213490+0000","last_undegraded":"2024-09-20T21:01:13.213490+0000","last_fullsized":"2024-09-20T21:01:13.213490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124520+0000","last_change":"2024-09-20T21:01:12.228562+0000","last_active":"2024-09-20T21:01:14.124520+0000","last_peered":"2024-09-20T21:01:14.124520+0000","last_clean":"2024-09-20T21:01:14.124520+0000","last_became_active":"2024-09-20T21:01:12.224894+0000","last_became_peered":"2024-09-20T21:01:12.224894+0000","last_unstale":"2024-09-20T21:01:14.124520+0000","last_undegraded":"2024-09-20T21:01:14.124520+0000","last_fullsized":"2024-09-20T21:01:14.124520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.657192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123465+0000","last_change":"2024-09-20T21:01:12.227789+0000","last_active":"2024-09-20T21:01:14.123465+0000","last_peered":"2024-09-20T21:01:14.123465+0000","last_clean":"2024-09-20T21:01:14.123465+0000","last_became_active":"2024-09-20T21:01:12.225718+0000","last_became_peered":"2024-09-20T21:01:12.225718+0000","last_unstale":"2024-09-20T21:01:14.123465+0000","last_undegraded":"2024-09-20T21:01:14.123465+0000","last_fullsized":"2024-09-20T21:01:14.123465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:15.226852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213450+0000","last_change":"2024-09-20T21:01:12.232080+0000","last_active":"2024-09-20T21:01:13.213450+0000","last_peered":"2024-09-20T21:01:13.213450+0000","last_clean":"2024-09-20T21:01:13.213450+0000","last_became_active":"2024-09-20T21:01:12.231429+0000","last_became_peered":"2024-09-20T21:01:12.231429+0000","last_unstale":"2024-09-20T21:01:13.213450+0000","last_undegraded":"2024-09-20T21:01:13.213450+0000","last_fullsized":"2024-09-20T21:01:13.213450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122213+0000","last_change":"2024-09-20T21:01:12.231871+0000","last_active":"2024-09-20T21:01:14.122213+0000","last_peered":"2024-09-20T21:01:14.122213+0000","last_clean":"2024-09-20T21:01:14.122213+0000","last_became_active":"2024-09-20T21:01:12.229463+0000","last_became_peered":"2024-09-20T21:01:12.229463+0000","last_unstale":"2024-09-20T21:01:14.122213+0000","last_undegraded":"2024-09-20T21:01:14.122213+0000","last_fullsized":"2024-09-20T21:01:14.122213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122268+0000","last_change":"2024-09-20T21:01:12.226969+0000","last_active":"2024-09-20T21:01:14.122268+0000","last_peered":"2024-09-20T21:01:14.122268+0000","last_clean":"2024-09-20T21:01:14.122268+0000","last_became_active":"2024-09-20T21:01:12.225800+0000","last_became_peered":"2024-09-20T21:01:12.225800+0000","last_unstale":"2024-09-20T21:01:14.122268+0000","last_undegraded":"2024-09-20T21:01:14.122268+0000","last_fullsized":"2024-09-20T21:01:14.122268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.121876+0000","last_change":"2024-09-20T21:01:12.217357+0000","last_active":"2024-09-20T21:01:14.121876+0000","last_peered":"2024-09-20T21:01:14.121876+0000","last_clean":"2024-09-20T21:01:14.121876+0000","last_became_active":"2024-09-20T21:01:12.213483+0000","last_became_peered":"2024-09-20T21:01:12.213483+0000","last_unstale":"2024-09-20T21:01:14.121876+0000","last_undegraded":"2024-09-20T21:01:14.121876+0000","last_fullsized":"2024-09-20T21:01:14.121876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200770+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:01:14.200770+0000","last_peered":"2024-09-20T21:01:14.200770+0000","last_clean":"2024-09-20T21:01:14.200770+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:01:14.200770+0000","last_undegraded":"2024-09-20T21:01:14.200770+0000","last_fullsized":"2024-09-20T21:01:14.200770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213647+0000","last_change":"2024-09-20T21:01:12.240432+0000","last_active":"2024-09-20T21:01:13.213647+0000","last_peered":"2024-09-20T21:01:13.213647+0000","last_clean":"2024-09-20T21:01:13.213647+0000","last_became_active":"2024-09-20T21:01:12.238826+0000","last_became_peered":"2024-09-20T21:01:12.238826+0000","last_unstale":"2024-09-20T21:01:13.213647+0000","last_undegraded":"2024-09-20T21:01:13.213647+0000","last_fullsized":"2024-09-20T21:01:13.213647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123974+0000","last_change":"2024-09-20T21:01:12.213062+0000","last_active":"2024-09-20T21:01:14.123974+0000","last_peered":"2024-09-20T21:01:14.123974+0000","last_clean":"2024-09-20T21:01:14.123974+0000","last_became_active":"2024-09-20T21:01:12.211953+0000","last_became_peered":"2024-09-20T21:01:12.211953+0000","last_unstale":"2024-09-20T21:01:14.123974+0000","last_undegraded":"2024-09-20T21:01:14.123974+0000","last_fullsized":"2024-09-20T21:01:14.123974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.052874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212638+0000","last_change":"2024-09-20T21:01:12.229580+0000","last_active":"2024-09-20T21:01:13.212638+0000","last_peered":"2024-09-20T21:01:13.212638+0000","last_clean":"2024-09-20T21:01:13.212638+0000","last_became_active":"2024-09-20T21:01:12.226915+0000","last_became_peered":"2024-09-20T21:01:12.226915+0000","last_unstale":"2024-09-20T21:01:13.212638+0000","last_undegraded":"2024-09-20T21:01:13.212638+0000","last_fullsized":"2024-09-20T21:01:13.212638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.985765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212841+0000","last_change":"2024-09-20T21:01:12.230410+0000","last_active":"2024-09-20T21:01:13.212841+0000","last_peered":"2024-09-20T21:01:13.212841+0000","last_clean":"2024-09-20T21:01:13.212841+0000","last_became_active":"2024-09-20T21:01:12.229859+0000","last_became_peered":"2024-09-20T21:01:12.229859+0000","last_unstale":"2024-09-20T21:01:13.212841+0000","last_undegraded":"2024-09-20T21:01:13.212841+0000","last_fullsized":"2024-09-20T21:01:13.212841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122301+0000","last_change":"2024-09-20T21:01:12.220376+0000","last_active":"2024-09-20T21:01:14.122301+0000","last_peered":"2024-09-20T21:01:14.122301+0000","last_clean":"2024-09-20T21:01:14.122301+0000","last_became_active":"2024-09-20T21:01:12.219338+0000","last_became_peered":"2024-09-20T21:01:12.219338+0000","last_unstale":"2024-09-20T21:01:14.122301+0000","last_undegraded":"2024-09-20T21:01:14.122301+0000","last_fullsized":"2024-09-20T21:01:14.122301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122306+0000","last_change":"2024-09-20T21:01:12.218884+0000","last_active":"2024-09-20T21:01:14.122306+0000","last_peered":"2024-09-20T21:01:14.122306+0000","last_clean":"2024-09-20T21:01:14.122306+0000","last_became_active":"2024-09-20T21:01:12.218225+0000","last_became_peered":"2024-09-20T21:01:12.218225+0000","last_unstale":"2024-09-20T21:01:14.122306+0000","last_undegraded":"2024-09-20T21:01:14.122306+0000","last_fullsized":"2024-09-20T21:01:14.122306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.121878+0000","last_change":"2024-09-20T21:01:12.214974+0000","last_active":"2024-09-20T21:01:14.121878+0000","last_peered":"2024-09-20T21:01:14.121878+0000","last_clean":"2024-09-20T21:01:14.121878+0000","last_became_active":"2024-09-20T21:01:12.212149+0000","last_became_peered":"2024-09-20T21:01:12.212149+0000","last_unstale":"2024-09-20T21:01:14.121878+0000","last_undegraded":"2024-09-20T21:01:14.121878+0000","last_fullsized":"2024-09-20T21:01:14.121878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201894+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:01:14.201894+0000","last_peered":"2024-09-20T21:01:14.201894+0000","last_clean":"2024-09-20T21:01:14.201894+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:01:14.201894+0000","last_undegraded":"2024-09-20T21:01:14.201894+0000","last_fullsized":"2024-09-20T21:01:14.201894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214150+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:01:13.214150+0000","last_peered":"2024-09-20T21:01:13.214150+0000","last_clean":"2024-09-20T21:01:13.214150+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:01:13.214150+0000","last_undegraded":"2024-09-20T21:01:13.214150+0000","last_fullsized":"2024-09-20T21:01:13.214150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200522+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:01:14.200522+0000","last_peered":"2024-09-20T21:01:14.200522+0000","last_clean":"2024-09-20T21:01:14.200522+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:01:14.200522+0000","last_undegraded":"2024-09-20T21:01:14.200522+0000","last_fullsized":"2024-09-20T21:01:14.200522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123547+0000","last_change":"2024-09-20T21:01:12.212785+0000","last_active":"2024-09-20T21:01:14.123547+0000","last_peered":"2024-09-20T21:01:14.123547+0000","last_clean":"2024-09-20T21:01:14.123547+0000","last_became_active":"2024-09-20T21:01:12.211844+0000","last_became_peered":"2024-09-20T21:01:12.211844+0000","last_unstale":"2024-09-20T21:01:14.123547+0000","last_undegraded":"2024-09-20T21:01:14.123547+0000","last_fullsized":"2024-09-20T21:01:14.123547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:38.821473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123510+0000","last_change":"2024-09-20T21:01:12.210710+0000","last_active":"2024-09-20T21:01:14.123510+0000","last_peered":"2024-09-20T21:01:14.123510+0000","last_clean":"2024-09-20T21:01:14.123510+0000","last_became_active":"2024-09-20T21:01:12.209676+0000","last_became_peered":"2024-09-20T21:01:12.209676+0000","last_unstale":"2024-09-20T21:01:14.123510+0000","last_undegraded":"2024-09-20T21:01:14.123510+0000","last_fullsized":"2024-09-20T21:01:14.123510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:48.442304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213498+0000","last_change":"2024-09-20T21:01:12.230375+0000","last_active":"2024-09-20T21:01:13.213498+0000","last_peered":"2024-09-20T21:01:13.213498+0000","last_clean":"2024-09-20T21:01:13.213498+0000","last_became_active":"2024-09-20T21:01:12.228679+0000","last_became_peered":"2024-09-20T21:01:12.228679+0000","last_unstale":"2024-09-20T21:01:13.213498+0000","last_undegraded":"2024-09-20T21:01:13.213498+0000","last_fullsized":"2024-09-20T21:01:13.213498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199168+0000","last_change":"2024-09-20T21:01:12.214484+0000","last_active":"2024-09-20T21:01:14.199168+0000","last_peered":"2024-09-20T21:01:14.199168+0000","last_clean":"2024-09-20T21:01:14.199168+0000","last_became_active":"2024-09-20T21:01:12.212293+0000","last_became_peered":"2024-09-20T21:01:12.212293+0000","last_unstale":"2024-09-20T21:01:14.199168+0000","last_undegraded":"2024-09-20T21:01:14.199168+0000","last_fullsized":"2024-09-20T21:01:14.199168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212124+0000","last_change":"2024-09-20T21:01:12.229114+0000","last_active":"2024-09-20T21:01:13.212124+0000","last_peered":"2024-09-20T21:01:13.212124+0000","last_clean":"2024-09-20T21:01:13.212124+0000","last_became_active":"2024-09-20T21:01:12.227812+0000","last_became_peered":"2024-09-20T21:01:12.227812+0000","last_unstale":"2024-09-20T21:01:13.212124+0000","last_undegraded":"2024-09-20T21:01:13.212124+0000","last_fullsized":"2024-09-20T21:01:13.212124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:02.638461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214589+0000","last_change":"2024-09-20T21:01:12.237926+0000","last_active":"2024-09-20T21:01:13.214589+0000","last_peered":"2024-09-20T21:01:13.214589+0000","last_clean":"2024-09-20T21:01:13.214589+0000","last_became_active":"2024-09-20T21:01:12.234061+0000","last_became_peered":"2024-09-20T21:01:12.234061+0000","last_unstale":"2024-09-20T21:01:13.214589+0000","last_undegraded":"2024-09-20T21:01:13.214589+0000","last_fullsized":"2024-09-20T21:01:13.214589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201638+0000","last_change":"2024-09-20T21:01:12.214728+0000","last_active":"2024-09-20T21:01:14.201638+0000","last_peered":"2024-09-20T21:01:14.201638+0000","last_clean":"2024-09-20T21:01:14.201638+0000","last_became_active":"2024-09-20T21:01:12.213159+0000","last_became_peered":"2024-09-20T21:01:12.213159+0000","last_unstale":"2024-09-20T21:01:14.201638+0000","last_undegraded":"2024-09-20T21:01:14.201638+0000","last_fullsized":"2024-09-20T21:01:14.201638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124525+0000","last_change":"2024-09-20T21:01:12.227975+0000","last_active":"2024-09-20T21:01:14.124525+0000","last_peered":"2024-09-20T21:01:14.124525+0000","last_clean":"2024-09-20T21:01:14.124525+0000","last_became_active":"2024-09-20T21:01:12.223433+0000","last_became_peered":"2024-09-20T21:01:12.223433+0000","last_unstale":"2024-09-20T21:01:14.124525+0000","last_undegraded":"2024-09-20T21:01:14.124525+0000","last_fullsized":"2024-09-20T21:01:14.124525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:32.017817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213358+0000","last_change":"2024-09-20T21:01:12.227425+0000","last_active":"2024-09-20T21:01:13.213358+0000","last_peered":"2024-09-20T21:01:13.213358+0000","last_clean":"2024-09-20T21:01:13.213358+0000","last_became_active":"2024-09-20T21:01:12.226625+0000","last_became_peered":"2024-09-20T21:01:12.226625+0000","last_unstale":"2024-09-20T21:01:13.213358+0000","last_undegraded":"2024-09-20T21:01:13.213358+0000","last_fullsized":"2024-09-20T21:01:13.213358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200909+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:01:14.200909+0000","last_peered":"2024-09-20T21:01:14.200909+0000","last_clean":"2024-09-20T21:01:14.200909+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:01:14.200909+0000","last_undegraded":"2024-09-20T21:01:14.200909+0000","last_fullsized":"2024-09-20T21:01:14.200909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213141+0000","last_change":"2024-09-20T21:01:12.230684+0000","last_active":"2024-09-20T21:01:13.213141+0000","last_peered":"2024-09-20T21:01:13.213141+0000","last_clean":"2024-09-20T21:01:13.213141+0000","last_became_active":"2024-09-20T21:01:12.229915+0000","last_became_peered":"2024-09-20T21:01:12.229915+0000","last_unstale":"2024-09-20T21:01:13.213141+0000","last_undegraded":"2024-09-20T21:01:13.213141+0000","last_fullsized":"2024-09-20T21:01:13.213141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199024+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:01:14.199024+0000","last_peered":"2024-09-20T21:01:14.199024+0000","last_clean":"2024-09-20T21:01:14.199024+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:01:14.199024+0000","last_undegraded":"2024-09-20T21:01:14.199024+0000","last_fullsized":"2024-09-20T21:01:14.199024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122415+0000","last_change":"2024-09-20T21:01:12.215773+0000","last_active":"2024-09-20T21:01:14.122415+0000","last_peered":"2024-09-20T21:01:14.122415+0000","last_clean":"2024-09-20T21:01:14.122415+0000","last_became_active":"2024-09-20T21:01:12.212199+0000","last_became_peered":"2024-09-20T21:01:12.212199+0000","last_unstale":"2024-09-20T21:01:14.122415+0000","last_undegraded":"2024-09-20T21:01:14.122415+0000","last_fullsized":"2024-09-20T21:01:14.122415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213925+0000","last_change":"2024-09-20T21:01:12.232814+0000","last_active":"2024-09-20T21:01:13.213925+0000","last_peered":"2024-09-20T21:01:13.213925+0000","last_clean":"2024-09-20T21:01:13.213925+0000","last_became_active":"2024-09-20T21:01:12.232026+0000","last_became_peered":"2024-09-20T21:01:12.232026+0000","last_unstale":"2024-09-20T21:01:13.213925+0000","last_undegraded":"2024-09-20T21:01:13.213925+0000","last_fullsized":"2024-09-20T21:01:13.213925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123899+0000","last_change":"2024-09-20T21:01:11.216956+0000","last_active":"2024-09-20T21:01:14.123899+0000","last_peered":"2024-09-20T21:01:14.123899+0000","last_clean":"2024-09-20T21:01:14.123899+0000","last_became_active":"2024-09-20T21:01:11.216462+0000","last_became_peered":"2024-09-20T21:01:11.216462+0000","last_unstale":"2024-09-20T21:01:14.123899+0000","last_undegraded":"2024-09-20T21:01:14.123899+0000","last_fullsized":"2024-09-20T21:01:14.123899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213710+0000","last_change":"2024-09-20T21:01:12.230727+0000","last_active":"2024-09-20T21:01:13.213710+0000","last_peered":"2024-09-20T21:01:13.213710+0000","last_clean":"2024-09-20T21:01:13.213710+0000","last_became_active":"2024-09-20T21:01:12.229987+0000","last_became_peered":"2024-09-20T21:01:12.229987+0000","last_unstale":"2024-09-20T21:01:13.213710+0000","last_undegraded":"2024-09-20T21:01:13.213710+0000","last_fullsized":"2024-09-20T21:01:13.213710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199555+0000","last_change":"2024-09-20T21:01:11.220335+0000","last_active":"2024-09-20T21:01:14.199555+0000","last_peered":"2024-09-20T21:01:14.199555+0000","last_clean":"2024-09-20T21:01:14.199555+0000","last_became_active":"2024-09-20T21:01:11.219506+0000","last_became_peered":"2024-09-20T21:01:11.219506+0000","last_unstale":"2024-09-20T21:01:14.199555+0000","last_undegraded":"2024-09-20T21:01:14.199555+0000","last_fullsized":"2024-09-20T21:01:14.199555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:16:05.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.202043+0000","last_change":"2024-09-20T21:01:12.214329+0000","last_active":"2024-09-20T21:01:14.202043+0000","last_peered":"2024-09-20T21:01:14.202043+0000","last_clean":"2024-09-20T21:01:14.202043+0000","last_became_active":"2024-09-20T21:01:12.212104+0000","last_became_peered":"2024-09-20T21:01:12.212104+0000","last_unstale":"2024-09-20T21:01:14.202043+0000","last_undegraded":"2024-09-20T21:01:14.202043+0000","last_fullsized":"2024-09-20T21:01:14.202043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212170+0000","last_change":"2024-09-20T21:01:11.213590+0000","last_active":"2024-09-20T21:01:13.212170+0000","last_peered":"2024-09-20T21:01:13.212170+0000","last_clean":"2024-09-20T21:01:13.212170+0000","last_became_active":"2024-09-20T21:01:11.212919+0000","last_became_peered":"2024-09-20T21:01:11.212919+0000","last_unstale":"2024-09-20T21:01:13.212170+0000","last_undegraded":"2024-09-20T21:01:13.212170+0000","last_fullsized":"2024-09-20T21:01:13.212170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.040754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201236+0000","last_change":"2024-09-20T21:01:12.214556+0000","last_active":"2024-09-20T21:01:14.201236+0000","last_peered":"2024-09-20T21:01:14.201236+0000","last_clean":"2024-09-20T21:01:14.201236+0000","last_became_active":"2024-09-20T21:01:12.212508+0000","last_became_peered":"2024-09-20T21:01:12.212508+0000","last_unstale":"2024-09-20T21:01:14.201236+0000","last_undegraded":"2024-09-20T21:01:14.201236+0000","last_fullsized":"2024-09-20T21:01:14.201236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122423+0000","last_change":"2024-09-20T21:01:11.224946+0000","last_active":"2024-09-20T21:01:14.122423+0000","last_peered":"2024-09-20T21:01:14.122423+0000","last_clean":"2024-09-20T21:01:14.122423+0000","last_became_active":"2024-09-20T21:01:11.224026+0000","last_became_peered":"2024-09-20T21:01:11.224026+0000","last_unstale":"2024-09-20T21:01:14.122423+0000","last_undegraded":"2024-09-20T21:01:14.122423+0000","last_fullsized":"2024-09-20T21:01:14.122423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124768+0000","last_change":"2024-09-20T21:01:11.221253+0000","last_active":"2024-09-20T21:01:14.124768+0000","last_peered":"2024-09-20T21:01:14.124768+0000","last_clean":"2024-09-20T21:01:14.124768+0000","last_became_active":"2024-09-20T21:01:11.220476+0000","last_became_peered":"2024-09-20T21:01:11.220476+0000","last_unstale":"2024-09-20T21:01:14.124768+0000","last_undegraded":"2024-09-20T21:01:14.124768+0000","last_fullsized":"2024-09-20T21:01:14.124768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.211746+0000","last_change":"2024-09-20T21:01:12.229503+0000","last_active":"2024-09-20T21:01:13.211746+0000","last_peered":"2024-09-20T21:01:13.211746+0000","last_clean":"2024-09-20T21:01:13.211746+0000","last_became_active":"2024-09-20T21:01:12.228540+0000","last_became_peered":"2024-09-20T21:01:12.228540+0000","last_unstale":"2024-09-20T21:01:13.211746+0000","last_undegraded":"2024-09-20T21:01:13.211746+0000","last_fullsized":"2024-09-20T21:01:13.211746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:13.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214449+0000","last_change":"2024-09-20T21:01:11.214247+0000","last_active":"2024-09-20T21:01:13.214449+0000","last_peered":"2024-09-20T21:01:13.214449+0000","last_clean":"2024-09-20T21:01:13.214449+0000","last_became_active":"2024-09-20T21:01:11.212760+0000","last_became_peered":"2024-09-20T21:01:11.212760+0000","last_unstale":"2024-09-20T21:01:13.214449+0000","last_undegraded":"2024-09-20T21:01:13.214449+0000","last_fullsized":"2024-09-20T21:01:13.214449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:20.108703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.211910+0000","last_change":"2024-09-20T21:01:12.238294+0000","last_active":"2024-09-20T21:01:13.211910+0000","last_peered":"2024-09-20T21:01:13.211910+0000","last_clean":"2024-09-20T21:01:13.211910+0000","last_became_active":"2024-09-20T21:01:12.237461+0000","last_became_peered":"2024-09-20T21:01:12.237461+0000","last_unstale":"2024-09-20T21:01:13.211910+0000","last_undegraded":"2024-09-20T21:01:13.211910+0000","last_fullsized":"2024-09-20T21:01:13.211910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:11.215425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.125136+0000","last_change":"2024-09-20T21:01:11.221716+0000","last_active":"2024-09-20T21:01:14.125136+0000","last_peered":"2024-09-20T21:01:14.125136+0000","last_clean":"2024-09-20T21:01:14.125136+0000","last_became_active":"2024-09-20T21:01:11.220620+0000","last_became_peered":"2024-09-20T21:01:11.220620+0000","last_unstale":"2024-09-20T21:01:14.125136+0000","last_undegraded":"2024-09-20T21:01:14.125136+0000","last_fullsized":"2024-09-20T21:01:14.125136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:13.593747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123197+0000","last_change":"2024-09-20T21:01:12.210785+0000","last_active":"2024-09-20T21:01:14.123197+0000","last_peered":"2024-09-20T21:01:14.123197+0000","last_clean":"2024-09-20T21:01:14.123197+0000","last_became_active":"2024-09-20T21:01:12.209489+0000","last_became_peered":"2024-09-20T21:01:12.209489+0000","last_unstale":"2024-09-20T21:01:14.123197+0000","last_undegraded":"2024-09-20T21:01:14.123197+0000","last_fullsized":"2024-09-20T21:01:14.123197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124280+0000","last_change":"2024-09-20T21:01:11.217199+0000","last_active":"2024-09-20T21:01:14.124280+0000","last_peered":"2024-09-20T21:01:14.124280+0000","last_clean":"2024-09-20T21:01:14.124280+0000","last_became_active":"2024-09-20T21:01:11.216370+0000","last_became_peered":"2024-09-20T21:01:11.216370+0000","last_unstale":"2024-09-20T21:01:14.124280+0000","last_undegraded":"2024-09-20T21:01:14.124280+0000","last_fullsized":"2024-09-20T21:01:14.124280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200309+0000","last_change":"2024-09-20T21:01:12.220592+0000","last_active":"2024-09-20T21:01:14.200309+0000","last_peered":"2024-09-20T21:01:14.200309+0000","last_clean":"2024-09-20T21:01:14.200309+0000","last_became_active":"2024-09-20T21:01:12.219682+0000","last_became_peered":"2024-09-20T21:01:12.219682+0000","last_unstale":"2024-09-20T21:01:14.200309+0000","last_undegraded":"2024-09-20T21:01:14.200309+0000","last_fullsized":"2024-09-20T21:01:14.200309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200717+0000","last_change":"2024-09-20T21:01:11.220548+0000","last_active":"2024-09-20T21:01:14.200717+0000","last_peered":"2024-09-20T21:01:14.200717+0000","last_clean":"2024-09-20T21:01:14.200717+0000","last_became_active":"2024-09-20T21:01:11.219847+0000","last_became_peered":"2024-09-20T21:01:11.219847+0000","last_unstale":"2024-09-20T21:01:14.200717+0000","last_undegraded":"2024-09-20T21:01:14.200717+0000","last_fullsized":"2024-09-20T21:01:14.200717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123890+0000","last_change":"2024-09-20T21:01:12.211812+0000","last_active":"2024-09-20T21:01:14.123890+0000","last_peered":"2024-09-20T21:01:14.123890+0000","last_clean":"2024-09-20T21:01:14.123890+0000","last_became_active":"2024-09-20T21:01:12.209826+0000","last_became_peered":"2024-09-20T21:01:12.209826+0000","last_unstale":"2024-09-20T21:01:14.123890+0000","last_undegraded":"2024-09-20T21:01:14.123890+0000","last_fullsized":"2024-09-20T21:01:14.123890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:46:41.210017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124551+0000","last_change":"2024-09-20T21:01:11.219106+0000","last_active":"2024-09-20T21:01:14.124551+0000","last_peered":"2024-09-20T21:01:14.124551+0000","last_clean":"2024-09-20T21:01:14.124551+0000","last_became_active":"2024-09-20T21:01:11.218259+0000","last_became_peered":"2024-09-20T21:01:11.218259+0000","last_unstale":"2024-09-20T21:01:14.124551+0000","last_undegraded":"2024-09-20T21:01:14.124551+0000","last_fullsized":"2024-09-20T21:01:14.124551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124978+0000","last_change":"2024-09-20T21:01:12.225987+0000","last_active":"2024-09-20T21:01:14.124978+0000","last_peered":"2024-09-20T21:01:14.124978+0000","last_clean":"2024-09-20T21:01:14.124978+0000","last_became_active":"2024-09-20T21:01:12.222916+0000","last_became_peered":"2024-09-20T21:01:12.222916+0000","last_unstale":"2024-09-20T21:01:14.124978+0000","last_undegraded":"2024-09-20T21:01:14.124978+0000","last_fullsized":"2024-09-20T21:01:14.124978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:16.681572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213152+0000","last_change":"2024-09-20T21:01:11.213371+0000","last_active":"2024-09-20T21:01:13.213152+0000","last_peered":"2024-09-20T21:01:13.213152+0000","last_clean":"2024-09-20T21:01:13.213152+0000","last_became_active":"2024-09-20T21:01:11.212385+0000","last_became_peered":"2024-09-20T21:01:11.212385+0000","last_unstale":"2024-09-20T21:01:13.213152+0000","last_undegraded":"2024-09-20T21:01:13.213152+0000","last_fullsized":"2024-09-20T21:01:13.213152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:56.734999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124036+0000","last_change":"2024-09-20T21:01:12.202841+0000","last_active":"2024-09-20T21:01:14.124036+0000","last_peered":"2024-09-20T21:01:14.124036+0000","last_clean":"2024-09-20T21:01:14.124036+0000","last_became_active":"2024-09-20T21:01:12.201016+0000","last_became_peered":"2024-09-20T21:01:12.201016+0000","last_unstale":"2024-09-20T21:01:14.124036+0000","last_undegraded":"2024-09-20T21:01:14.124036+0000","last_fullsized":"2024-09-20T21:01:14.124036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:55.984268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212340+0000","last_change":"2024-09-20T21:01:11.220785+0000","last_active":"2024-09-20T21:01:13.212340+0000","last_peered":"2024-09-20T21:01:13.212340+0000","last_clean":"2024-09-20T21:01:13.212340+0000","last_became_active":"2024-09-20T21:01:11.220111+0000","last_became_peered":"2024-09-20T21:01:11.220111+0000","last_unstale":"2024-09-20T21:01:13.212340+0000","last_undegraded":"2024-09-20T21:01:13.212340+0000","last_fullsized":"2024-09-20T21:01:13.212340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.621763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201099+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:01:14.201099+0000","last_peered":"2024-09-20T21:01:14.201099+0000","last_clean":"2024-09-20T21:01:14.201099+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:01:14.201099+0000","last_undegraded":"2024-09-20T21:01:14.201099+0000","last_fullsized":"2024-09-20T21:01:14.201099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":224,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123095+0000","last_change":"2024-09-20T21:01:02.293432+0000","last_active":"2024-09-20T21:01:14.123095+0000","last_peered":"2024-09-20T21:01:14.123095+0000","last_clean":"2024-09-20T21:01:14.123095+0000","last_became_active":"2024-09-20T21:01:02.291361+0000","last_became_peered":"2024-09-20T21:01:02.291361+0000","last_unstale":"2024-09-20T21:01:14.123095+0000","last_undegraded":"2024-09-20T21:01:14.123095+0000","last_fullsized":"2024-09-20T21:01:14.123095+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:52.935898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124386+0000","last_change":"2024-09-20T21:01:09.031119+0000","last_active":"2024-09-20T21:01:14.124386+0000","last_peered":"2024-09-20T21:01:14.124386+0000","last_clean":"2024-09-20T21:01:14.124386+0000","last_became_active":"2024-09-20T21:01:06.994429+0000","last_became_peered":"2024-09-20T21:01:06.994429+0000","last_unstale":"2024-09-20T21:01:14.124386+0000","last_undegraded":"2024-09-20T21:01:14.124386+0000","last_fullsized":"2024-09-20T21:01:14.124386+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:47.585068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025064900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199836+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:01:14.199836+0000","last_peered":"2024-09-20T21:01:14.199836+0000","last_clean":"2024-09-20T21:01:14.199836+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:01:14.199836+0000","last_undegraded":"2024-09-20T21:01:14.199836+0000","last_fullsized":"2024-09-20T21:01:14.199836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.125031+0000","last_change":"2024-09-20T21:01:12.224024+0000","last_active":"2024-09-20T21:01:14.125031+0000","last_peered":"2024-09-20T21:01:14.125031+0000","last_clean":"2024-09-20T21:01:14.125031+0000","last_became_active":"2024-09-20T21:01:12.222433+0000","last_became_peered":"2024-09-20T21:01:12.222433+0000","last_unstale":"2024-09-20T21:01:14.125031+0000","last_undegraded":"2024-09-20T21:01:14.125031+0000","last_fullsized":"2024-09-20T21:01:14.125031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:23.486608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122691+0000","last_change":"2024-09-20T21:01:09.029382+0000","last_active":"2024-09-20T21:01:14.122691+0000","last_peered":"2024-09-20T21:01:14.122691+0000","last_clean":"2024-09-20T21:01:14.122691+0000","last_became_active":"2024-09-20T21:01:06.997340+0000","last_became_peered":"2024-09-20T21:01:06.997340+0000","last_unstale":"2024-09-20T21:01:14.122691+0000","last_undegraded":"2024-09-20T21:01:14.122691+0000","last_fullsized":"2024-09-20T21:01:14.122691+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:25:22.179131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081948399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200224+0000","last_change":"2024-09-20T21:01:11.220462+0000","last_active":"2024-09-20T21:01:14.200224+0000","last_peered":"2024-09-20T21:01:14.200224+0000","last_clean":"2024-09-20T21:01:14.200224+0000","last_became_active":"2024-09-20T21:01:11.219778+0000","last_became_peered":"2024-09-20T21:01:11.219778+0000","last_unstale":"2024-09-20T21:01:14.200224+0000","last_undegraded":"2024-09-20T21:01:14.200224+0000","last_fullsized":"2024-09-20T21:01:14.200224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:08.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214544+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:01:13.214544+0000","last_peered":"2024-09-20T21:01:13.214544+0000","last_clean":"2024-09-20T21:01:13.214544+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:01:13.214544+0000","last_undegraded":"2024-09-20T21:01:13.214544+0000","last_fullsized":"2024-09-20T21:01:13.214544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200370+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:01:14.200370+0000","last_peered":"2024-09-20T21:01:14.200370+0000","last_clean":"2024-09-20T21:01:14.200370+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:01:14.200370+0000","last_undegraded":"2024-09-20T21:01:14.200370+0000","last_fullsized":"2024-09-20T21:01:14.200370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213846+0000","last_change":"2024-09-20T21:01:11.217295+0000","last_active":"2024-09-20T21:01:13.213846+0000","last_peered":"2024-09-20T21:01:13.213846+0000","last_clean":"2024-09-20T21:01:13.213846+0000","last_became_active":"2024-09-20T21:01:11.216350+0000","last_became_peered":"2024-09-20T21:01:11.216350+0000","last_unstale":"2024-09-20T21:01:13.213846+0000","last_undegraded":"2024-09-20T21:01:13.213846+0000","last_fullsized":"2024-09-20T21:01:13.213846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:59.661622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201362+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:01:14.201362+0000","last_peered":"2024-09-20T21:01:14.201362+0000","last_clean":"2024-09-20T21:01:14.201362+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:01:14.201362+0000","last_undegraded":"2024-09-20T21:01:14.201362+0000","last_fullsized":"2024-09-20T21:01:14.201362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123352+0000","last_change":"2024-09-20T21:01:09.030841+0000","last_active":"2024-09-20T21:01:14.123352+0000","last_peered":"2024-09-20T21:01:14.123352+0000","last_clean":"2024-09-20T21:01:14.123352+0000","last_became_active":"2024-09-20T21:01:06.994033+0000","last_became_peered":"2024-09-20T21:01:06.994033+0000","last_unstale":"2024-09-20T21:01:14.123352+0000","last_undegraded":"2024-09-20T21:01:14.123352+0000","last_fullsized":"2024-09-20T21:01:14.123352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:57.919077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022137329999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124182+0000","last_change":"2024-09-20T21:01:11.217114+0000","last_active":"2024-09-20T21:01:14.124182+0000","last_peered":"2024-09-20T21:01:14.124182+0000","last_clean":"2024-09-20T21:01:14.124182+0000","last_became_active":"2024-09-20T21:01:11.215974+0000","last_became_peered":"2024-09-20T21:01:11.215974+0000","last_unstale":"2024-09-20T21:01:14.124182+0000","last_undegraded":"2024-09-20T21:01:14.124182+0000","last_fullsized":"2024-09-20T21:01:14.124182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.200880+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:01:14.200880+0000","last_peered":"2024-09-20T21:01:14.200880+0000","last_clean":"2024-09-20T21:01:14.200880+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:01:14.200880+0000","last_undegraded":"2024-09-20T21:01:14.200880+0000","last_fullsized":"2024-09-20T21:01:14.200880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.125164+0000","last_change":"2024-09-20T21:01:11.217713+0000","last_active":"2024-09-20T21:01:14.125164+0000","last_peered":"2024-09-20T21:01:14.125164+0000","last_clean":"2024-09-20T21:01:14.125164+0000","last_became_active":"2024-09-20T21:01:11.215699+0000","last_became_peered":"2024-09-20T21:01:11.215699+0000","last_unstale":"2024-09-20T21:01:14.125164+0000","last_undegraded":"2024-09-20T21:01:14.125164+0000","last_fullsized":"2024-09-20T21:01:14.125164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:06.986446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201259+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:01:14.201259+0000","last_peered":"2024-09-20T21:01:14.201259+0000","last_clean":"2024-09-20T21:01:14.201259+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:01:14.201259+0000","last_undegraded":"2024-09-20T21:01:14.201259+0000","last_fullsized":"2024-09-20T21:01:14.201259+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212682+0000","last_change":"2024-09-20T21:01:12.227746+0000","last_active":"2024-09-20T21:01:13.212682+0000","last_peered":"2024-09-20T21:01:13.212682+0000","last_clean":"2024-09-20T21:01:13.212682+0000","last_became_active":"2024-09-20T21:01:12.226860+0000","last_became_peered":"2024-09-20T21:01:12.226860+0000","last_unstale":"2024-09-20T21:01:13.212682+0000","last_undegraded":"2024-09-20T21:01:13.212682+0000","last_fullsized":"2024-09-20T21:01:13.212682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:02.144980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201156+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:01:14.201156+0000","last_peered":"2024-09-20T21:01:14.201156+0000","last_clean":"2024-09-20T21:01:14.201156+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:01:14.201156+0000","last_undegraded":"2024-09-20T21:01:14.201156+0000","last_fullsized":"2024-09-20T21:01:14.201156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214353+0000","last_change":"2024-09-20T21:01:09.385616+0000","last_active":"2024-09-20T21:01:13.214353+0000","last_peered":"2024-09-20T21:01:13.214353+0000","last_clean":"2024-09-20T21:01:13.214353+0000","last_became_active":"2024-09-20T21:01:07.000811+0000","last_became_peered":"2024-09-20T21:01:07.000811+0000","last_unstale":"2024-09-20T21:01:13.214353+0000","last_undegraded":"2024-09-20T21:01:13.214353+0000","last_fullsized":"2024-09-20T21:01:13.214353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:03.917240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077098100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212840+0000","last_change":"2024-09-20T21:01:12.227533+0000","last_active":"2024-09-20T21:01:13.212840+0000","last_peered":"2024-09-20T21:01:13.212840+0000","last_clean":"2024-09-20T21:01:13.212840+0000","last_became_active":"2024-09-20T21:01:12.226676+0000","last_became_peered":"2024-09-20T21:01:12.226676+0000","last_unstale":"2024-09-20T21:01:13.212840+0000","last_undegraded":"2024-09-20T21:01:13.212840+0000","last_fullsized":"2024-09-20T21:01:13.212840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201745+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:01:14.201745+0000","last_peered":"2024-09-20T21:01:14.201745+0000","last_clean":"2024-09-20T21:01:14.201745+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:01:14.201745+0000","last_undegraded":"2024-09-20T21:01:14.201745+0000","last_fullsized":"2024-09-20T21:01:14.201745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.202521+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:01:14.202521+0000","last_peered":"2024-09-20T21:01:14.202521+0000","last_clean":"2024-09-20T21:01:14.202521+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:01:14.202521+0000","last_undegraded":"2024-09-20T21:01:14.202521+0000","last_fullsized":"2024-09-20T21:01:14.202521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199393+0000","last_change":"2024-09-20T21:01:12.227354+0000","last_active":"2024-09-20T21:01:14.199393+0000","last_peered":"2024-09-20T21:01:14.199393+0000","last_clean":"2024-09-20T21:01:14.199393+0000","last_became_active":"2024-09-20T21:01:12.226078+0000","last_became_peered":"2024-09-20T21:01:12.226078+0000","last_unstale":"2024-09-20T21:01:14.199393+0000","last_undegraded":"2024-09-20T21:01:14.199393+0000","last_fullsized":"2024-09-20T21:01:14.199393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.205378+0000","last_change":"2024-09-20T21:01:11.220479+0000","last_active":"2024-09-20T21:01:14.205378+0000","last_peered":"2024-09-20T21:01:14.205378+0000","last_clean":"2024-09-20T21:01:14.205378+0000","last_became_active":"2024-09-20T21:01:11.219658+0000","last_became_peered":"2024-09-20T21:01:11.219658+0000","last_unstale":"2024-09-20T21:01:14.205378+0000","last_undegraded":"2024-09-20T21:01:14.205378+0000","last_fullsized":"2024-09-20T21:01:14.205378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124793+0000","last_change":"2024-09-20T21:01:09.029413+0000","last_active":"2024-09-20T21:01:14.124793+0000","last_peered":"2024-09-20T21:01:14.124793+0000","last_clean":"2024-09-20T21:01:14.124793+0000","last_became_active":"2024-09-20T21:01:06.997186+0000","last_became_peered":"2024-09-20T21:01:06.997186+0000","last_unstale":"2024-09-20T21:01:14.124793+0000","last_undegraded":"2024-09-20T21:01:14.124793+0000","last_fullsized":"2024-09-20T21:01:14.124793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:09:55.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.211937+0000","last_change":"2024-09-20T21:01:12.228307+0000","last_active":"2024-09-20T21:01:13.211937+0000","last_peered":"2024-09-20T21:01:13.211937+0000","last_clean":"2024-09-20T21:01:13.211937+0000","last_became_active":"2024-09-20T21:01:12.226322+0000","last_became_peered":"2024-09-20T21:01:12.226322+0000","last_unstale":"2024-09-20T21:01:13.211937+0000","last_undegraded":"2024-09-20T21:01:13.211937+0000","last_fullsized":"2024-09-20T21:01:13.211937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:52.194070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124559+0000","last_change":"2024-09-20T21:01:12.220324+0000","last_active":"2024-09-20T21:01:14.124559+0000","last_peered":"2024-09-20T21:01:14.124559+0000","last_clean":"2024-09-20T21:01:14.124559+0000","last_became_active":"2024-09-20T21:01:12.219327+0000","last_became_peered":"2024-09-20T21:01:12.219327+0000","last_unstale":"2024-09-20T21:01:14.124559+0000","last_undegraded":"2024-09-20T21:01:14.124559+0000","last_fullsized":"2024-09-20T21:01:14.124559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:56.030003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124171+0000","last_change":"2024-09-20T21:01:11.221231+0000","last_active":"2024-09-20T21:01:14.124171+0000","last_peered":"2024-09-20T21:01:14.124171+0000","last_clean":"2024-09-20T21:01:14.124171+0000","last_became_active":"2024-09-20T21:01:11.220426+0000","last_became_peered":"2024-09-20T21:01:11.220426+0000","last_unstale":"2024-09-20T21:01:14.124171+0000","last_undegraded":"2024-09-20T21:01:14.124171+0000","last_fullsized":"2024-09-20T21:01:14.124171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199268+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:01:14.199268+0000","last_peered":"2024-09-20T21:01:14.199268+0000","last_clean":"2024-09-20T21:01:14.199268+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:01:14.199268+0000","last_undegraded":"2024-09-20T21:01:14.199268+0000","last_fullsized":"2024-09-20T21:01:14.199268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214207+0000","last_change":"2024-09-20T21:01:11.220027+0000","last_active":"2024-09-20T21:01:13.214207+0000","last_peered":"2024-09-20T21:01:13.214207+0000","last_clean":"2024-09-20T21:01:13.214207+0000","last_became_active":"2024-09-20T21:01:11.218551+0000","last_became_peered":"2024-09-20T21:01:11.218551+0000","last_unstale":"2024-09-20T21:01:13.214207+0000","last_undegraded":"2024-09-20T21:01:13.214207+0000","last_fullsized":"2024-09-20T21:01:13.214207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:47:59.918561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.124358+0000","last_change":"2024-09-20T21:01:11.218922+0000","last_active":"2024-09-20T21:01:14.124358+0000","last_peered":"2024-09-20T21:01:14.124358+0000","last_clean":"2024-09-20T21:01:14.124358+0000","last_became_active":"2024-09-20T21:01:11.218028+0000","last_became_peered":"2024-09-20T21:01:11.218028+0000","last_unstale":"2024-09-20T21:01:14.124358+0000","last_undegraded":"2024-09-20T21:01:14.124358+0000","last_fullsized":"2024-09-20T21:01:14.124358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199534+0000","last_change":"2024-09-20T21:01:12.211553+0000","last_active":"2024-09-20T21:01:14.199534+0000","last_peered":"2024-09-20T21:01:14.199534+0000","last_clean":"2024-09-20T21:01:14.199534+0000","last_became_active":"2024-09-20T21:01:12.210101+0000","last_became_peered":"2024-09-20T21:01:12.210101+0000","last_unstale":"2024-09-20T21:01:14.199534+0000","last_undegraded":"2024-09-20T21:01:14.199534+0000","last_fullsized":"2024-09-20T21:01:14.199534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201601+0000","last_change":"2024-09-20T21:01:11.221867+0000","last_active":"2024-09-20T21:01:14.201601+0000","last_peered":"2024-09-20T21:01:14.201601+0000","last_clean":"2024-09-20T21:01:14.201601+0000","last_became_active":"2024-09-20T21:01:11.220980+0000","last_became_peered":"2024-09-20T21:01:11.220980+0000","last_unstale":"2024-09-20T21:01:14.201601+0000","last_undegraded":"2024-09-20T21:01:14.201601+0000","last_fullsized":"2024-09-20T21:01:14.201601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199627+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:01:14.199627+0000","last_peered":"2024-09-20T21:01:14.199627+0000","last_clean":"2024-09-20T21:01:14.199627+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:01:14.199627+0000","last_undegraded":"2024-09-20T21:01:14.199627+0000","last_fullsized":"2024-09-20T21:01:14.199627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214582+0000","last_change":"2024-09-20T21:01:12.236819+0000","last_active":"2024-09-20T21:01:13.214582+0000","last_peered":"2024-09-20T21:01:13.214582+0000","last_clean":"2024-09-20T21:01:13.214582+0000","last_became_active":"2024-09-20T21:01:12.233922+0000","last_became_peered":"2024-09-20T21:01:12.233922+0000","last_unstale":"2024-09-20T21:01:13.214582+0000","last_undegraded":"2024-09-20T21:01:13.214582+0000","last_fullsized":"2024-09-20T21:01:13.214582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199708+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:01:14.199708+0000","last_peered":"2024-09-20T21:01:14.199708+0000","last_clean":"2024-09-20T21:01:14.199708+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:01:14.199708+0000","last_undegraded":"2024-09-20T21:01:14.199708+0000","last_fullsized":"2024-09-20T21:01:14.199708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201257+0000","last_change":"2024-09-20T21:01:12.227395+0000","last_active":"2024-09-20T21:01:14.201257+0000","last_peered":"2024-09-20T21:01:14.201257+0000","last_clean":"2024-09-20T21:01:14.201257+0000","last_became_active":"2024-09-20T21:01:12.226122+0000","last_became_peered":"2024-09-20T21:01:12.226122+0000","last_unstale":"2024-09-20T21:01:14.201257+0000","last_undegraded":"2024-09-20T21:01:14.201257+0000","last_fullsized":"2024-09-20T21:01:14.201257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.199924+0000","last_change":"2024-09-20T21:01:11.220367+0000","last_active":"2024-09-20T21:01:14.199924+0000","last_peered":"2024-09-20T21:01:14.199924+0000","last_clean":"2024-09-20T21:01:14.199924+0000","last_became_active":"2024-09-20T21:01:11.219090+0000","last_became_peered":"2024-09-20T21:01:11.219090+0000","last_unstale":"2024-09-20T21:01:14.199924+0000","last_undegraded":"2024-09-20T21:01:14.199924+0000","last_fullsized":"2024-09-20T21:01:14.199924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213645+0000","last_change":"2024-09-20T21:01:12.238895+0000","last_active":"2024-09-20T21:01:13.213645+0000","last_peered":"2024-09-20T21:01:13.213645+0000","last_clean":"2024-09-20T21:01:13.213645+0000","last_became_active":"2024-09-20T21:01:12.235481+0000","last_became_peered":"2024-09-20T21:01:12.235481+0000","last_unstale":"2024-09-20T21:01:13.213645+0000","last_undegraded":"2024-09-20T21:01:13.213645+0000","last_fullsized":"2024-09-20T21:01:13.213645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213441+0000","last_change":"2024-09-20T21:01:11.217493+0000","last_active":"2024-09-20T21:01:13.213441+0000","last_peered":"2024-09-20T21:01:13.213441+0000","last_clean":"2024-09-20T21:01:13.213441+0000","last_became_active":"2024-09-20T21:01:11.216073+0000","last_became_peered":"2024-09-20T21:01:11.216073+0000","last_unstale":"2024-09-20T21:01:13.213441+0000","last_undegraded":"2024-09-20T21:01:13.213441+0000","last_fullsized":"2024-09-20T21:01:13.213441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:23:30.512126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212929+0000","last_change":"2024-09-20T21:01:12.232371+0000","last_active":"2024-09-20T21:01:13.212929+0000","last_peered":"2024-09-20T21:01:13.212929+0000","last_clean":"2024-09-20T21:01:13.212929+0000","last_became_active":"2024-09-20T21:01:12.231450+0000","last_became_peered":"2024-09-20T21:01:12.231450+0000","last_unstale":"2024-09-20T21:01:13.212929+0000","last_undegraded":"2024-09-20T21:01:13.212929+0000","last_fullsized":"2024-09-20T21:01:13.212929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.213202+0000","last_change":"2024-09-20T21:01:11.218440+0000","last_active":"2024-09-20T21:01:13.213202+0000","last_peered":"2024-09-20T21:01:13.213202+0000","last_clean":"2024-09-20T21:01:13.213202+0000","last_became_active":"2024-09-20T21:01:11.217722+0000","last_became_peered":"2024-09-20T21:01:11.217722+0000","last_unstale":"2024-09-20T21:01:13.213202+0000","last_undegraded":"2024-09-20T21:01:13.213202+0000","last_fullsized":"2024-09-20T21:01:13.213202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:11:02.101254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.122468+0000","last_change":"2024-09-20T21:01:12.212994+0000","last_active":"2024-09-20T21:01:14.122468+0000","last_peered":"2024-09-20T21:01:14.122468+0000","last_clean":"2024-09-20T21:01:14.122468+0000","last_became_active":"2024-09-20T21:01:12.211080+0000","last_became_peered":"2024-09-20T21:01:12.211080+0000","last_unstale":"2024-09-20T21:01:14.122468+0000","last_undegraded":"2024-09-20T21:01:14.122468+0000","last_fullsized":"2024-09-20T21:01:14.122468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123828+0000","last_change":"2024-09-20T21:01:11.217211+0000","last_active":"2024-09-20T21:01:14.123828+0000","last_peered":"2024-09-20T21:01:14.123828+0000","last_clean":"2024-09-20T21:01:14.123828+0000","last_became_active":"2024-09-20T21:01:11.216428+0000","last_became_peered":"2024-09-20T21:01:11.216428+0000","last_unstale":"2024-09-20T21:01:14.123828+0000","last_undegraded":"2024-09-20T21:01:14.123828+0000","last_fullsized":"2024-09-20T21:01:14.123828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123054+0000","last_change":"2024-09-20T21:01:12.214965+0000","last_active":"2024-09-20T21:01:14.123054+0000","last_peered":"2024-09-20T21:01:14.123054+0000","last_clean":"2024-09-20T21:01:14.123054+0000","last_became_active":"2024-09-20T21:01:12.211534+0000","last_became_peered":"2024-09-20T21:01:12.211534+0000","last_unstale":"2024-09-20T21:01:14.123054+0000","last_undegraded":"2024-09-20T21:01:14.123054+0000","last_fullsized":"2024-09-20T21:01:14.123054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.214039+0000","last_change":"2024-09-20T21:01:11.220332+0000","last_active":"2024-09-20T21:01:13.214039+0000","last_peered":"2024-09-20T21:01:13.214039+0000","last_clean":"2024-09-20T21:01:13.214039+0000","last_became_active":"2024-09-20T21:01:11.219022+0000","last_became_peered":"2024-09-20T21:01:11.219022+0000","last_unstale":"2024-09-20T21:01:13.214039+0000","last_undegraded":"2024-09-20T21:01:13.214039+0000","last_fullsized":"2024-09-20T21:01:13.214039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.928114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:13.212865+0000","last_change":"2024-09-20T21:01:12.238819+0000","last_active":"2024-09-20T21:01:13.212865+0000","last_peered":"2024-09-20T21:01:13.212865+0000","last_clean":"2024-09-20T21:01:13.212865+0000","last_became_active":"2024-09-20T21:01:12.237939+0000","last_became_peered":"2024-09-20T21:01:12.237939+0000","last_unstale":"2024-09-20T21:01:13.212865+0000","last_undegraded":"2024-09-20T21:01:13.212865+0000","last_fullsized":"2024-09-20T21:01:13.212865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201776+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:01:14.201776+0000","last_peered":"2024-09-20T21:01:14.201776+0000","last_clean":"2024-09-20T21:01:14.201776+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:01:14.201776+0000","last_undegraded":"2024-09-20T21:01:14.201776+0000","last_fullsized":"2024-09-20T21:01:14.201776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.123061+0000","last_change":"2024-09-20T21:01:12.213562+0000","last_active":"2024-09-20T21:01:14.123061+0000","last_peered":"2024-09-20T21:01:14.123061+0000","last_clean":"2024-09-20T21:01:14.123061+0000","last_became_active":"2024-09-20T21:01:12.210781+0000","last_became_peered":"2024-09-20T21:01:12.210781+0000","last_unstale":"2024-09-20T21:01:14.123061+0000","last_undegraded":"2024-09-20T21:01:14.123061+0000","last_fullsized":"2024-09-20T21:01:14.123061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.201509+0000","last_change":"2024-09-20T21:01:11.222738+0000","last_active":"2024-09-20T21:01:14.201509+0000","last_peered":"2024-09-20T21:01:14.201509+0000","last_clean":"2024-09-20T21:01:14.201509+0000","last_became_active":"2024-09-20T21:01:11.221990+0000","last_became_peered":"2024-09-20T21:01:11.221990+0000","last_unstale":"2024-09-20T21:01:14.201509+0000","last_undegraded":"2024-09-20T21:01:14.201509+0000","last_fullsized":"2024-09-20T21:01:14.201509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":249856,"data_stored":651168,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":651803,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:01:15.552 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-20T21:01:15.552 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-20T21:01:15.552 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-20T21:01:15.552 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-20T21:01:15.552 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-20T21:01:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:15.938 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":4255306755},{"type":"v1","addr":"172.21.15.112:6801","nonce":4255306755}]},"active_addr":"172.21.15.112:6801/4255306755","active_change":"2024-09-20T21:00:54.845796+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2220883323}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":521141583}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2141516059}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":4035170032}]}]} 2024-09-20T21:01:15.942 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-20T21:01:15.942 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-20T21:01:15.942 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:01:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:16.220 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:01:14.979294+0000","last_up_change":"2024-09-20T21:00:59.725541+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T21:01:05.455429+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T21:01:10.047761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T21:01:10.524533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6801","nonce":2769075992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6803","nonce":2769075992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6807","nonce":2769075992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6805","nonce":2769075992}]},"public_addr":"172.21.15.161:6801/2769075992","cluster_addr":"172.21.15.161:6803/2769075992","heartbeat_back_addr":"172.21.15.161:6807/2769075992","heartbeat_front_addr":"172.21.15.161:6805/2769075992","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:01:16.239 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-20T21:01:16.239 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:01:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:16.524 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:01:14.979294+0000","last_up_change":"2024-09-20T21:00:59.725541+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T21:01:05.455429+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T21:01:10.047761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T21:01:10.524533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6801","nonce":2769075992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6803","nonce":2769075992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6807","nonce":2769075992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6805","nonce":2769075992}]},"public_addr":"172.21.15.161:6801/2769075992","cluster_addr":"172.21.15.161:6803/2769075992","heartbeat_back_addr":"172.21.15.161:6807/2769075992","heartbeat_front_addr":"172.21.15.161:6805/2769075992","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:01:16.541 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-20T21:01:16.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-20T21:01:16.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-20T21:01:16.695 INFO:teuthology.orchestra.run.smithi112.stdout:34359738374 2024-09-20T21:01:16.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-20T21:01:16.707 INFO:teuthology.orchestra.run.smithi112.stdout:34359738375 2024-09-20T21:01:16.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-20T21:01:16.717 INFO:teuthology.orchestra.run.smithi112.stdout:34359738375 2024-09-20T21:01:16.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-20T21:01:17.015 INFO:teuthology.orchestra.run.smithi112.stdout:34359738372 2024-09-20T21:01:17.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738372 for osd.1 2024-09-20T21:01:17.047 INFO:teuthology.orchestra.run.smithi112.stdout:34359738373 2024-09-20T21:01:17.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738373 for osd.2 2024-09-20T21:01:17.080 INFO:teuthology.orchestra.run.smithi112.stdout:34359738373 2024-09-20T21:01:17.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738373 for osd.0 2024-09-20T21:01:18.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-20T21:01:18.065 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-20T21:01:18.097 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-20T21:01:18.352 INFO:teuthology.orchestra.run.smithi112.stdout:34359738374 2024-09-20T21:01:18.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-09-20T21:01:18.369 DEBUG:teuthology.parallel:result is None 2024-09-20T21:01:18.374 INFO:teuthology.orchestra.run.smithi112.stdout:34359738375 2024-09-20T21:01:18.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-09-20T21:01:18.391 DEBUG:teuthology.parallel:result is None 2024-09-20T21:01:18.422 INFO:teuthology.orchestra.run.smithi112.stdout:34359738375 2024-09-20T21:01:18.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-09-20T21:01:18.439 DEBUG:teuthology.parallel:result is None 2024-09-20T21:01:18.439 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-20T21:01:18.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:01:18.771 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:18.773 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:01:18.787 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-20T21:01:16.858664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90108,"kb_used_data":696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025412,"statfs":{"total":289910292480,"available":289818021888,"internally_reserved":0,"allocated":712704,"data_stored":1375416,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4788,"internal_metadata":91483468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.670022"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306410+0000","last_change":"2024-09-20T21:01:12.240709+0000","last_active":"2024-09-20T21:01:15.306410+0000","last_peered":"2024-09-20T21:01:15.306410+0000","last_clean":"2024-09-20T21:01:15.306410+0000","last_became_active":"2024-09-20T21:01:12.239599+0000","last_became_peered":"2024-09-20T21:01:12.239599+0000","last_unstale":"2024-09-20T21:01:15.306410+0000","last_undegraded":"2024-09-20T21:01:15.306410+0000","last_fullsized":"2024-09-20T21:01:15.306410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304904+0000","last_change":"2024-09-20T21:01:12.236761+0000","last_active":"2024-09-20T21:01:15.304904+0000","last_peered":"2024-09-20T21:01:15.304904+0000","last_clean":"2024-09-20T21:01:15.304904+0000","last_became_active":"2024-09-20T21:01:12.235613+0000","last_became_peered":"2024-09-20T21:01:12.235613+0000","last_unstale":"2024-09-20T21:01:15.304904+0000","last_undegraded":"2024-09-20T21:01:15.304904+0000","last_fullsized":"2024-09-20T21:01:15.304904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985464+0000","last_change":"2024-09-20T21:01:12.228562+0000","last_active":"2024-09-20T21:01:14.985464+0000","last_peered":"2024-09-20T21:01:14.985464+0000","last_clean":"2024-09-20T21:01:14.985464+0000","last_became_active":"2024-09-20T21:01:12.224894+0000","last_became_peered":"2024-09-20T21:01:12.224894+0000","last_unstale":"2024-09-20T21:01:14.985464+0000","last_undegraded":"2024-09-20T21:01:14.985464+0000","last_fullsized":"2024-09-20T21:01:14.985464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.657192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985376+0000","last_change":"2024-09-20T21:01:12.227789+0000","last_active":"2024-09-20T21:01:14.985376+0000","last_peered":"2024-09-20T21:01:14.985376+0000","last_clean":"2024-09-20T21:01:14.985376+0000","last_became_active":"2024-09-20T21:01:12.225718+0000","last_became_peered":"2024-09-20T21:01:12.225718+0000","last_unstale":"2024-09-20T21:01:14.985376+0000","last_undegraded":"2024-09-20T21:01:14.985376+0000","last_fullsized":"2024-09-20T21:01:14.985376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:15.226852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305052+0000","last_change":"2024-09-20T21:01:12.232080+0000","last_active":"2024-09-20T21:01:15.305052+0000","last_peered":"2024-09-20T21:01:15.305052+0000","last_clean":"2024-09-20T21:01:15.305052+0000","last_became_active":"2024-09-20T21:01:12.231429+0000","last_became_peered":"2024-09-20T21:01:12.231429+0000","last_unstale":"2024-09-20T21:01:15.305052+0000","last_undegraded":"2024-09-20T21:01:15.305052+0000","last_fullsized":"2024-09-20T21:01:15.305052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984770+0000","last_change":"2024-09-20T21:01:12.231871+0000","last_active":"2024-09-20T21:01:14.984770+0000","last_peered":"2024-09-20T21:01:14.984770+0000","last_clean":"2024-09-20T21:01:14.984770+0000","last_became_active":"2024-09-20T21:01:12.229463+0000","last_became_peered":"2024-09-20T21:01:12.229463+0000","last_unstale":"2024-09-20T21:01:14.984770+0000","last_undegraded":"2024-09-20T21:01:14.984770+0000","last_fullsized":"2024-09-20T21:01:14.984770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984571+0000","last_change":"2024-09-20T21:01:12.226969+0000","last_active":"2024-09-20T21:01:14.984571+0000","last_peered":"2024-09-20T21:01:14.984571+0000","last_clean":"2024-09-20T21:01:14.984571+0000","last_became_active":"2024-09-20T21:01:12.225800+0000","last_became_peered":"2024-09-20T21:01:12.225800+0000","last_unstale":"2024-09-20T21:01:14.984571+0000","last_undegraded":"2024-09-20T21:01:14.984571+0000","last_fullsized":"2024-09-20T21:01:14.984571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984474+0000","last_change":"2024-09-20T21:01:12.217357+0000","last_active":"2024-09-20T21:01:14.984474+0000","last_peered":"2024-09-20T21:01:14.984474+0000","last_clean":"2024-09-20T21:01:14.984474+0000","last_became_active":"2024-09-20T21:01:12.213483+0000","last_became_peered":"2024-09-20T21:01:12.213483+0000","last_unstale":"2024-09-20T21:01:14.984474+0000","last_undegraded":"2024-09-20T21:01:14.984474+0000","last_fullsized":"2024-09-20T21:01:14.984474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824366+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:01:15.824366+0000","last_peered":"2024-09-20T21:01:15.824366+0000","last_clean":"2024-09-20T21:01:15.824366+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:01:15.824366+0000","last_undegraded":"2024-09-20T21:01:15.824366+0000","last_fullsized":"2024-09-20T21:01:15.824366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305301+0000","last_change":"2024-09-20T21:01:12.240432+0000","last_active":"2024-09-20T21:01:15.305301+0000","last_peered":"2024-09-20T21:01:15.305301+0000","last_clean":"2024-09-20T21:01:15.305301+0000","last_became_active":"2024-09-20T21:01:12.238826+0000","last_became_peered":"2024-09-20T21:01:12.238826+0000","last_unstale":"2024-09-20T21:01:15.305301+0000","last_undegraded":"2024-09-20T21:01:15.305301+0000","last_fullsized":"2024-09-20T21:01:15.305301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985723+0000","last_change":"2024-09-20T21:01:12.213062+0000","last_active":"2024-09-20T21:01:14.985723+0000","last_peered":"2024-09-20T21:01:14.985723+0000","last_clean":"2024-09-20T21:01:14.985723+0000","last_became_active":"2024-09-20T21:01:12.211953+0000","last_became_peered":"2024-09-20T21:01:12.211953+0000","last_unstale":"2024-09-20T21:01:14.985723+0000","last_undegraded":"2024-09-20T21:01:14.985723+0000","last_fullsized":"2024-09-20T21:01:14.985723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.052874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304989+0000","last_change":"2024-09-20T21:01:12.229580+0000","last_active":"2024-09-20T21:01:15.304989+0000","last_peered":"2024-09-20T21:01:15.304989+0000","last_clean":"2024-09-20T21:01:15.304989+0000","last_became_active":"2024-09-20T21:01:12.226915+0000","last_became_peered":"2024-09-20T21:01:12.226915+0000","last_unstale":"2024-09-20T21:01:15.304989+0000","last_undegraded":"2024-09-20T21:01:15.304989+0000","last_fullsized":"2024-09-20T21:01:15.304989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.985765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304611+0000","last_change":"2024-09-20T21:01:12.230410+0000","last_active":"2024-09-20T21:01:15.304611+0000","last_peered":"2024-09-20T21:01:15.304611+0000","last_clean":"2024-09-20T21:01:15.304611+0000","last_became_active":"2024-09-20T21:01:12.229859+0000","last_became_peered":"2024-09-20T21:01:12.229859+0000","last_unstale":"2024-09-20T21:01:15.304611+0000","last_undegraded":"2024-09-20T21:01:15.304611+0000","last_fullsized":"2024-09-20T21:01:15.304611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985035+0000","last_change":"2024-09-20T21:01:12.220376+0000","last_active":"2024-09-20T21:01:14.985035+0000","last_peered":"2024-09-20T21:01:14.985035+0000","last_clean":"2024-09-20T21:01:14.985035+0000","last_became_active":"2024-09-20T21:01:12.219338+0000","last_became_peered":"2024-09-20T21:01:12.219338+0000","last_unstale":"2024-09-20T21:01:14.985035+0000","last_undegraded":"2024-09-20T21:01:14.985035+0000","last_fullsized":"2024-09-20T21:01:14.985035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984765+0000","last_change":"2024-09-20T21:01:12.218884+0000","last_active":"2024-09-20T21:01:14.984765+0000","last_peered":"2024-09-20T21:01:14.984765+0000","last_clean":"2024-09-20T21:01:14.984765+0000","last_became_active":"2024-09-20T21:01:12.218225+0000","last_became_peered":"2024-09-20T21:01:12.218225+0000","last_unstale":"2024-09-20T21:01:14.984765+0000","last_undegraded":"2024-09-20T21:01:14.984765+0000","last_fullsized":"2024-09-20T21:01:14.984765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984513+0000","last_change":"2024-09-20T21:01:12.214974+0000","last_active":"2024-09-20T21:01:14.984513+0000","last_peered":"2024-09-20T21:01:14.984513+0000","last_clean":"2024-09-20T21:01:14.984513+0000","last_became_active":"2024-09-20T21:01:12.212149+0000","last_became_peered":"2024-09-20T21:01:12.212149+0000","last_unstale":"2024-09-20T21:01:14.984513+0000","last_undegraded":"2024-09-20T21:01:14.984513+0000","last_fullsized":"2024-09-20T21:01:14.984513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825339+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:01:15.825339+0000","last_peered":"2024-09-20T21:01:15.825339+0000","last_clean":"2024-09-20T21:01:15.825339+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:01:15.825339+0000","last_undegraded":"2024-09-20T21:01:15.825339+0000","last_fullsized":"2024-09-20T21:01:15.825339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305951+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:01:15.305951+0000","last_peered":"2024-09-20T21:01:15.305951+0000","last_clean":"2024-09-20T21:01:15.305951+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:01:15.305951+0000","last_undegraded":"2024-09-20T21:01:15.305951+0000","last_fullsized":"2024-09-20T21:01:15.305951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823775+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:01:15.823775+0000","last_peered":"2024-09-20T21:01:15.823775+0000","last_clean":"2024-09-20T21:01:15.823775+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:01:15.823775+0000","last_undegraded":"2024-09-20T21:01:15.823775+0000","last_fullsized":"2024-09-20T21:01:15.823775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986032+0000","last_change":"2024-09-20T21:01:12.212785+0000","last_active":"2024-09-20T21:01:14.986032+0000","last_peered":"2024-09-20T21:01:14.986032+0000","last_clean":"2024-09-20T21:01:14.986032+0000","last_became_active":"2024-09-20T21:01:12.211844+0000","last_became_peered":"2024-09-20T21:01:12.211844+0000","last_unstale":"2024-09-20T21:01:14.986032+0000","last_undegraded":"2024-09-20T21:01:14.986032+0000","last_fullsized":"2024-09-20T21:01:14.986032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:38.821473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986326+0000","last_change":"2024-09-20T21:01:12.210710+0000","last_active":"2024-09-20T21:01:14.986326+0000","last_peered":"2024-09-20T21:01:14.986326+0000","last_clean":"2024-09-20T21:01:14.986326+0000","last_became_active":"2024-09-20T21:01:12.209676+0000","last_became_peered":"2024-09-20T21:01:12.209676+0000","last_unstale":"2024-09-20T21:01:14.986326+0000","last_undegraded":"2024-09-20T21:01:14.986326+0000","last_fullsized":"2024-09-20T21:01:14.986326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:48.442304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304234+0000","last_change":"2024-09-20T21:01:12.230375+0000","last_active":"2024-09-20T21:01:15.304234+0000","last_peered":"2024-09-20T21:01:15.304234+0000","last_clean":"2024-09-20T21:01:15.304234+0000","last_became_active":"2024-09-20T21:01:12.228679+0000","last_became_peered":"2024-09-20T21:01:12.228679+0000","last_unstale":"2024-09-20T21:01:15.304234+0000","last_undegraded":"2024-09-20T21:01:15.304234+0000","last_fullsized":"2024-09-20T21:01:15.304234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822604+0000","last_change":"2024-09-20T21:01:12.214484+0000","last_active":"2024-09-20T21:01:15.822604+0000","last_peered":"2024-09-20T21:01:15.822604+0000","last_clean":"2024-09-20T21:01:15.822604+0000","last_became_active":"2024-09-20T21:01:12.212293+0000","last_became_peered":"2024-09-20T21:01:12.212293+0000","last_unstale":"2024-09-20T21:01:15.822604+0000","last_undegraded":"2024-09-20T21:01:15.822604+0000","last_fullsized":"2024-09-20T21:01:15.822604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304078+0000","last_change":"2024-09-20T21:01:12.229114+0000","last_active":"2024-09-20T21:01:15.304078+0000","last_peered":"2024-09-20T21:01:15.304078+0000","last_clean":"2024-09-20T21:01:15.304078+0000","last_became_active":"2024-09-20T21:01:12.227812+0000","last_became_peered":"2024-09-20T21:01:12.227812+0000","last_unstale":"2024-09-20T21:01:15.304078+0000","last_undegraded":"2024-09-20T21:01:15.304078+0000","last_fullsized":"2024-09-20T21:01:15.304078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:02.638461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306541+0000","last_change":"2024-09-20T21:01:12.237926+0000","last_active":"2024-09-20T21:01:15.306541+0000","last_peered":"2024-09-20T21:01:15.306541+0000","last_clean":"2024-09-20T21:01:15.306541+0000","last_became_active":"2024-09-20T21:01:12.234061+0000","last_became_peered":"2024-09-20T21:01:12.234061+0000","last_unstale":"2024-09-20T21:01:15.306541+0000","last_undegraded":"2024-09-20T21:01:15.306541+0000","last_fullsized":"2024-09-20T21:01:15.306541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824786+0000","last_change":"2024-09-20T21:01:12.214728+0000","last_active":"2024-09-20T21:01:15.824786+0000","last_peered":"2024-09-20T21:01:15.824786+0000","last_clean":"2024-09-20T21:01:15.824786+0000","last_became_active":"2024-09-20T21:01:12.213159+0000","last_became_peered":"2024-09-20T21:01:12.213159+0000","last_unstale":"2024-09-20T21:01:15.824786+0000","last_undegraded":"2024-09-20T21:01:15.824786+0000","last_fullsized":"2024-09-20T21:01:15.824786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985824+0000","last_change":"2024-09-20T21:01:12.227975+0000","last_active":"2024-09-20T21:01:14.985824+0000","last_peered":"2024-09-20T21:01:14.985824+0000","last_clean":"2024-09-20T21:01:14.985824+0000","last_became_active":"2024-09-20T21:01:12.223433+0000","last_became_peered":"2024-09-20T21:01:12.223433+0000","last_unstale":"2024-09-20T21:01:14.985824+0000","last_undegraded":"2024-09-20T21:01:14.985824+0000","last_fullsized":"2024-09-20T21:01:14.985824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:32.017817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305701+0000","last_change":"2024-09-20T21:01:12.227425+0000","last_active":"2024-09-20T21:01:15.305701+0000","last_peered":"2024-09-20T21:01:15.305701+0000","last_clean":"2024-09-20T21:01:15.305701+0000","last_became_active":"2024-09-20T21:01:12.226625+0000","last_became_peered":"2024-09-20T21:01:12.226625+0000","last_unstale":"2024-09-20T21:01:15.305701+0000","last_undegraded":"2024-09-20T21:01:15.305701+0000","last_fullsized":"2024-09-20T21:01:15.305701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824366+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:01:15.824366+0000","last_peered":"2024-09-20T21:01:15.824366+0000","last_clean":"2024-09-20T21:01:15.824366+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:01:15.824366+0000","last_undegraded":"2024-09-20T21:01:15.824366+0000","last_fullsized":"2024-09-20T21:01:15.824366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304558+0000","last_change":"2024-09-20T21:01:12.230684+0000","last_active":"2024-09-20T21:01:15.304558+0000","last_peered":"2024-09-20T21:01:15.304558+0000","last_clean":"2024-09-20T21:01:15.304558+0000","last_became_active":"2024-09-20T21:01:12.229915+0000","last_became_peered":"2024-09-20T21:01:12.229915+0000","last_unstale":"2024-09-20T21:01:15.304558+0000","last_undegraded":"2024-09-20T21:01:15.304558+0000","last_fullsized":"2024-09-20T21:01:15.304558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822770+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:01:15.822770+0000","last_peered":"2024-09-20T21:01:15.822770+0000","last_clean":"2024-09-20T21:01:15.822770+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:01:15.822770+0000","last_undegraded":"2024-09-20T21:01:15.822770+0000","last_fullsized":"2024-09-20T21:01:15.822770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984770+0000","last_change":"2024-09-20T21:01:12.215773+0000","last_active":"2024-09-20T21:01:14.984770+0000","last_peered":"2024-09-20T21:01:14.984770+0000","last_clean":"2024-09-20T21:01:14.984770+0000","last_became_active":"2024-09-20T21:01:12.212199+0000","last_became_peered":"2024-09-20T21:01:12.212199+0000","last_unstale":"2024-09-20T21:01:14.984770+0000","last_undegraded":"2024-09-20T21:01:14.984770+0000","last_fullsized":"2024-09-20T21:01:14.984770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305678+0000","last_change":"2024-09-20T21:01:12.232814+0000","last_active":"2024-09-20T21:01:15.305678+0000","last_peered":"2024-09-20T21:01:15.305678+0000","last_clean":"2024-09-20T21:01:15.305678+0000","last_became_active":"2024-09-20T21:01:12.232026+0000","last_became_peered":"2024-09-20T21:01:12.232026+0000","last_unstale":"2024-09-20T21:01:15.305678+0000","last_undegraded":"2024-09-20T21:01:15.305678+0000","last_fullsized":"2024-09-20T21:01:15.305678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986403+0000","last_change":"2024-09-20T21:01:11.216956+0000","last_active":"2024-09-20T21:01:14.986403+0000","last_peered":"2024-09-20T21:01:14.986403+0000","last_clean":"2024-09-20T21:01:14.986403+0000","last_became_active":"2024-09-20T21:01:11.216462+0000","last_became_peered":"2024-09-20T21:01:11.216462+0000","last_unstale":"2024-09-20T21:01:14.986403+0000","last_undegraded":"2024-09-20T21:01:14.986403+0000","last_fullsized":"2024-09-20T21:01:14.986403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305641+0000","last_change":"2024-09-20T21:01:12.230727+0000","last_active":"2024-09-20T21:01:15.305641+0000","last_peered":"2024-09-20T21:01:15.305641+0000","last_clean":"2024-09-20T21:01:15.305641+0000","last_became_active":"2024-09-20T21:01:12.229987+0000","last_became_peered":"2024-09-20T21:01:12.229987+0000","last_unstale":"2024-09-20T21:01:15.305641+0000","last_undegraded":"2024-09-20T21:01:15.305641+0000","last_fullsized":"2024-09-20T21:01:15.305641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823289+0000","last_change":"2024-09-20T21:01:11.220335+0000","last_active":"2024-09-20T21:01:15.823289+0000","last_peered":"2024-09-20T21:01:15.823289+0000","last_clean":"2024-09-20T21:01:15.823289+0000","last_became_active":"2024-09-20T21:01:11.219506+0000","last_became_peered":"2024-09-20T21:01:11.219506+0000","last_unstale":"2024-09-20T21:01:15.823289+0000","last_undegraded":"2024-09-20T21:01:15.823289+0000","last_fullsized":"2024-09-20T21:01:15.823289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:16:05.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825073+0000","last_change":"2024-09-20T21:01:12.214329+0000","last_active":"2024-09-20T21:01:15.825073+0000","last_peered":"2024-09-20T21:01:15.825073+0000","last_clean":"2024-09-20T21:01:15.825073+0000","last_became_active":"2024-09-20T21:01:12.212104+0000","last_became_peered":"2024-09-20T21:01:12.212104+0000","last_unstale":"2024-09-20T21:01:15.825073+0000","last_undegraded":"2024-09-20T21:01:15.825073+0000","last_fullsized":"2024-09-20T21:01:15.825073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304158+0000","last_change":"2024-09-20T21:01:11.213590+0000","last_active":"2024-09-20T21:01:15.304158+0000","last_peered":"2024-09-20T21:01:15.304158+0000","last_clean":"2024-09-20T21:01:15.304158+0000","last_became_active":"2024-09-20T21:01:11.212919+0000","last_became_peered":"2024-09-20T21:01:11.212919+0000","last_unstale":"2024-09-20T21:01:15.304158+0000","last_undegraded":"2024-09-20T21:01:15.304158+0000","last_fullsized":"2024-09-20T21:01:15.304158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.040754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824531+0000","last_change":"2024-09-20T21:01:12.214556+0000","last_active":"2024-09-20T21:01:15.824531+0000","last_peered":"2024-09-20T21:01:15.824531+0000","last_clean":"2024-09-20T21:01:15.824531+0000","last_became_active":"2024-09-20T21:01:12.212508+0000","last_became_peered":"2024-09-20T21:01:12.212508+0000","last_unstale":"2024-09-20T21:01:15.824531+0000","last_undegraded":"2024-09-20T21:01:15.824531+0000","last_fullsized":"2024-09-20T21:01:15.824531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985051+0000","last_change":"2024-09-20T21:01:11.224946+0000","last_active":"2024-09-20T21:01:14.985051+0000","last_peered":"2024-09-20T21:01:14.985051+0000","last_clean":"2024-09-20T21:01:14.985051+0000","last_became_active":"2024-09-20T21:01:11.224026+0000","last_became_peered":"2024-09-20T21:01:11.224026+0000","last_unstale":"2024-09-20T21:01:14.985051+0000","last_undegraded":"2024-09-20T21:01:14.985051+0000","last_fullsized":"2024-09-20T21:01:14.985051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986492+0000","last_change":"2024-09-20T21:01:11.221253+0000","last_active":"2024-09-20T21:01:14.986492+0000","last_peered":"2024-09-20T21:01:14.986492+0000","last_clean":"2024-09-20T21:01:14.986492+0000","last_became_active":"2024-09-20T21:01:11.220476+0000","last_became_peered":"2024-09-20T21:01:11.220476+0000","last_unstale":"2024-09-20T21:01:14.986492+0000","last_undegraded":"2024-09-20T21:01:14.986492+0000","last_fullsized":"2024-09-20T21:01:14.986492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304115+0000","last_change":"2024-09-20T21:01:12.229503+0000","last_active":"2024-09-20T21:01:15.304115+0000","last_peered":"2024-09-20T21:01:15.304115+0000","last_clean":"2024-09-20T21:01:15.304115+0000","last_became_active":"2024-09-20T21:01:12.228540+0000","last_became_peered":"2024-09-20T21:01:12.228540+0000","last_unstale":"2024-09-20T21:01:15.304115+0000","last_undegraded":"2024-09-20T21:01:15.304115+0000","last_fullsized":"2024-09-20T21:01:15.304115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:13.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305796+0000","last_change":"2024-09-20T21:01:11.214247+0000","last_active":"2024-09-20T21:01:15.305796+0000","last_peered":"2024-09-20T21:01:15.305796+0000","last_clean":"2024-09-20T21:01:15.305796+0000","last_became_active":"2024-09-20T21:01:11.212760+0000","last_became_peered":"2024-09-20T21:01:11.212760+0000","last_unstale":"2024-09-20T21:01:15.305796+0000","last_undegraded":"2024-09-20T21:01:15.305796+0000","last_fullsized":"2024-09-20T21:01:15.305796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:20.108703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.303861+0000","last_change":"2024-09-20T21:01:12.238294+0000","last_active":"2024-09-20T21:01:15.303861+0000","last_peered":"2024-09-20T21:01:15.303861+0000","last_clean":"2024-09-20T21:01:15.303861+0000","last_became_active":"2024-09-20T21:01:12.237461+0000","last_became_peered":"2024-09-20T21:01:12.237461+0000","last_unstale":"2024-09-20T21:01:15.303861+0000","last_undegraded":"2024-09-20T21:01:15.303861+0000","last_fullsized":"2024-09-20T21:01:15.303861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:11.215425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986624+0000","last_change":"2024-09-20T21:01:11.221716+0000","last_active":"2024-09-20T21:01:14.986624+0000","last_peered":"2024-09-20T21:01:14.986624+0000","last_clean":"2024-09-20T21:01:14.986624+0000","last_became_active":"2024-09-20T21:01:11.220620+0000","last_became_peered":"2024-09-20T21:01:11.220620+0000","last_unstale":"2024-09-20T21:01:14.986624+0000","last_undegraded":"2024-09-20T21:01:14.986624+0000","last_fullsized":"2024-09-20T21:01:14.986624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:13.593747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985365+0000","last_change":"2024-09-20T21:01:12.210785+0000","last_active":"2024-09-20T21:01:14.985365+0000","last_peered":"2024-09-20T21:01:14.985365+0000","last_clean":"2024-09-20T21:01:14.985365+0000","last_became_active":"2024-09-20T21:01:12.209489+0000","last_became_peered":"2024-09-20T21:01:12.209489+0000","last_unstale":"2024-09-20T21:01:14.985365+0000","last_undegraded":"2024-09-20T21:01:14.985365+0000","last_fullsized":"2024-09-20T21:01:14.985365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986875+0000","last_change":"2024-09-20T21:01:11.217199+0000","last_active":"2024-09-20T21:01:14.986875+0000","last_peered":"2024-09-20T21:01:14.986875+0000","last_clean":"2024-09-20T21:01:14.986875+0000","last_became_active":"2024-09-20T21:01:11.216370+0000","last_became_peered":"2024-09-20T21:01:11.216370+0000","last_unstale":"2024-09-20T21:01:14.986875+0000","last_undegraded":"2024-09-20T21:01:14.986875+0000","last_fullsized":"2024-09-20T21:01:14.986875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824109+0000","last_change":"2024-09-20T21:01:12.220592+0000","last_active":"2024-09-20T21:01:15.824109+0000","last_peered":"2024-09-20T21:01:15.824109+0000","last_clean":"2024-09-20T21:01:15.824109+0000","last_became_active":"2024-09-20T21:01:12.219682+0000","last_became_peered":"2024-09-20T21:01:12.219682+0000","last_unstale":"2024-09-20T21:01:15.824109+0000","last_undegraded":"2024-09-20T21:01:15.824109+0000","last_fullsized":"2024-09-20T21:01:15.824109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824706+0000","last_change":"2024-09-20T21:01:11.220548+0000","last_active":"2024-09-20T21:01:15.824706+0000","last_peered":"2024-09-20T21:01:15.824706+0000","last_clean":"2024-09-20T21:01:15.824706+0000","last_became_active":"2024-09-20T21:01:11.219847+0000","last_became_peered":"2024-09-20T21:01:11.219847+0000","last_unstale":"2024-09-20T21:01:15.824706+0000","last_undegraded":"2024-09-20T21:01:15.824706+0000","last_fullsized":"2024-09-20T21:01:15.824706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985939+0000","last_change":"2024-09-20T21:01:12.211812+0000","last_active":"2024-09-20T21:01:14.985939+0000","last_peered":"2024-09-20T21:01:14.985939+0000","last_clean":"2024-09-20T21:01:14.985939+0000","last_became_active":"2024-09-20T21:01:12.209826+0000","last_became_peered":"2024-09-20T21:01:12.209826+0000","last_unstale":"2024-09-20T21:01:14.985939+0000","last_undegraded":"2024-09-20T21:01:14.985939+0000","last_fullsized":"2024-09-20T21:01:14.985939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:46:41.210017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986629+0000","last_change":"2024-09-20T21:01:11.219106+0000","last_active":"2024-09-20T21:01:14.986629+0000","last_peered":"2024-09-20T21:01:14.986629+0000","last_clean":"2024-09-20T21:01:14.986629+0000","last_became_active":"2024-09-20T21:01:11.218259+0000","last_became_peered":"2024-09-20T21:01:11.218259+0000","last_unstale":"2024-09-20T21:01:14.986629+0000","last_undegraded":"2024-09-20T21:01:14.986629+0000","last_fullsized":"2024-09-20T21:01:14.986629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986094+0000","last_change":"2024-09-20T21:01:12.225987+0000","last_active":"2024-09-20T21:01:14.986094+0000","last_peered":"2024-09-20T21:01:14.986094+0000","last_clean":"2024-09-20T21:01:14.986094+0000","last_became_active":"2024-09-20T21:01:12.222916+0000","last_became_peered":"2024-09-20T21:01:12.222916+0000","last_unstale":"2024-09-20T21:01:14.986094+0000","last_undegraded":"2024-09-20T21:01:14.986094+0000","last_fullsized":"2024-09-20T21:01:14.986094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:16.681572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304200+0000","last_change":"2024-09-20T21:01:11.213371+0000","last_active":"2024-09-20T21:01:15.304200+0000","last_peered":"2024-09-20T21:01:15.304200+0000","last_clean":"2024-09-20T21:01:15.304200+0000","last_became_active":"2024-09-20T21:01:11.212385+0000","last_became_peered":"2024-09-20T21:01:11.212385+0000","last_unstale":"2024-09-20T21:01:15.304200+0000","last_undegraded":"2024-09-20T21:01:15.304200+0000","last_fullsized":"2024-09-20T21:01:15.304200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:56.734999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985452+0000","last_change":"2024-09-20T21:01:12.202841+0000","last_active":"2024-09-20T21:01:14.985452+0000","last_peered":"2024-09-20T21:01:14.985452+0000","last_clean":"2024-09-20T21:01:14.985452+0000","last_became_active":"2024-09-20T21:01:12.201016+0000","last_became_peered":"2024-09-20T21:01:12.201016+0000","last_unstale":"2024-09-20T21:01:14.985452+0000","last_undegraded":"2024-09-20T21:01:14.985452+0000","last_fullsized":"2024-09-20T21:01:14.985452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:55.984268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304606+0000","last_change":"2024-09-20T21:01:11.220785+0000","last_active":"2024-09-20T21:01:15.304606+0000","last_peered":"2024-09-20T21:01:15.304606+0000","last_clean":"2024-09-20T21:01:15.304606+0000","last_became_active":"2024-09-20T21:01:11.220111+0000","last_became_peered":"2024-09-20T21:01:11.220111+0000","last_unstale":"2024-09-20T21:01:15.304606+0000","last_undegraded":"2024-09-20T21:01:15.304606+0000","last_fullsized":"2024-09-20T21:01:15.304606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.621763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824680+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:01:15.824680+0000","last_peered":"2024-09-20T21:01:15.824680+0000","last_clean":"2024-09-20T21:01:15.824680+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:01:15.824680+0000","last_undegraded":"2024-09-20T21:01:15.824680+0000","last_fullsized":"2024-09-20T21:01:15.824680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986367+0000","last_change":"2024-09-20T21:01:02.293432+0000","last_active":"2024-09-20T21:01:14.986367+0000","last_peered":"2024-09-20T21:01:14.986367+0000","last_clean":"2024-09-20T21:01:14.986367+0000","last_became_active":"2024-09-20T21:01:02.291361+0000","last_became_peered":"2024-09-20T21:01:02.291361+0000","last_unstale":"2024-09-20T21:01:14.986367+0000","last_undegraded":"2024-09-20T21:01:14.986367+0000","last_fullsized":"2024-09-20T21:01:14.986367+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:52.935898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986794+0000","last_change":"2024-09-20T21:01:09.031119+0000","last_active":"2024-09-20T21:01:14.986794+0000","last_peered":"2024-09-20T21:01:14.986794+0000","last_clean":"2024-09-20T21:01:14.986794+0000","last_became_active":"2024-09-20T21:01:06.994429+0000","last_became_peered":"2024-09-20T21:01:06.994429+0000","last_unstale":"2024-09-20T21:01:14.986794+0000","last_undegraded":"2024-09-20T21:01:14.986794+0000","last_fullsized":"2024-09-20T21:01:14.986794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:47.585068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025064900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823578+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:01:15.823578+0000","last_peered":"2024-09-20T21:01:15.823578+0000","last_clean":"2024-09-20T21:01:15.823578+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:01:15.823578+0000","last_undegraded":"2024-09-20T21:01:15.823578+0000","last_fullsized":"2024-09-20T21:01:15.823578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986350+0000","last_change":"2024-09-20T21:01:12.224024+0000","last_active":"2024-09-20T21:01:14.986350+0000","last_peered":"2024-09-20T21:01:14.986350+0000","last_clean":"2024-09-20T21:01:14.986350+0000","last_became_active":"2024-09-20T21:01:12.222433+0000","last_became_peered":"2024-09-20T21:01:12.222433+0000","last_unstale":"2024-09-20T21:01:14.986350+0000","last_undegraded":"2024-09-20T21:01:14.986350+0000","last_fullsized":"2024-09-20T21:01:14.986350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:23.486608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.987258+0000","last_change":"2024-09-20T21:01:09.029382+0000","last_active":"2024-09-20T21:01:14.987258+0000","last_peered":"2024-09-20T21:01:14.987258+0000","last_clean":"2024-09-20T21:01:14.987258+0000","last_became_active":"2024-09-20T21:01:06.997340+0000","last_became_peered":"2024-09-20T21:01:06.997340+0000","last_unstale":"2024-09-20T21:01:14.987258+0000","last_undegraded":"2024-09-20T21:01:14.987258+0000","last_fullsized":"2024-09-20T21:01:14.987258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:25:22.179131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081948399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823666+0000","last_change":"2024-09-20T21:01:11.220462+0000","last_active":"2024-09-20T21:01:15.823666+0000","last_peered":"2024-09-20T21:01:15.823666+0000","last_clean":"2024-09-20T21:01:15.823666+0000","last_became_active":"2024-09-20T21:01:11.219778+0000","last_became_peered":"2024-09-20T21:01:11.219778+0000","last_unstale":"2024-09-20T21:01:15.823666+0000","last_undegraded":"2024-09-20T21:01:15.823666+0000","last_fullsized":"2024-09-20T21:01:15.823666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:08.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305546+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:01:15.305546+0000","last_peered":"2024-09-20T21:01:15.305546+0000","last_clean":"2024-09-20T21:01:15.305546+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:01:15.305546+0000","last_undegraded":"2024-09-20T21:01:15.305546+0000","last_fullsized":"2024-09-20T21:01:15.305546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824232+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:01:15.824232+0000","last_peered":"2024-09-20T21:01:15.824232+0000","last_clean":"2024-09-20T21:01:15.824232+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:01:15.824232+0000","last_undegraded":"2024-09-20T21:01:15.824232+0000","last_fullsized":"2024-09-20T21:01:15.824232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304870+0000","last_change":"2024-09-20T21:01:11.217295+0000","last_active":"2024-09-20T21:01:15.304870+0000","last_peered":"2024-09-20T21:01:15.304870+0000","last_clean":"2024-09-20T21:01:15.304870+0000","last_became_active":"2024-09-20T21:01:11.216350+0000","last_became_peered":"2024-09-20T21:01:11.216350+0000","last_unstale":"2024-09-20T21:01:15.304870+0000","last_undegraded":"2024-09-20T21:01:15.304870+0000","last_fullsized":"2024-09-20T21:01:15.304870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:59.661622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824867+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:01:15.824867+0000","last_peered":"2024-09-20T21:01:15.824867+0000","last_clean":"2024-09-20T21:01:15.824867+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:01:15.824867+0000","last_undegraded":"2024-09-20T21:01:15.824867+0000","last_fullsized":"2024-09-20T21:01:15.824867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986806+0000","last_change":"2024-09-20T21:01:09.030841+0000","last_active":"2024-09-20T21:01:14.986806+0000","last_peered":"2024-09-20T21:01:14.986806+0000","last_clean":"2024-09-20T21:01:14.986806+0000","last_became_active":"2024-09-20T21:01:06.994033+0000","last_became_peered":"2024-09-20T21:01:06.994033+0000","last_unstale":"2024-09-20T21:01:14.986806+0000","last_undegraded":"2024-09-20T21:01:14.986806+0000","last_fullsized":"2024-09-20T21:01:14.986806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:57.919077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022137329999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986580+0000","last_change":"2024-09-20T21:01:11.217114+0000","last_active":"2024-09-20T21:01:14.986580+0000","last_peered":"2024-09-20T21:01:14.986580+0000","last_clean":"2024-09-20T21:01:14.986580+0000","last_became_active":"2024-09-20T21:01:11.215974+0000","last_became_peered":"2024-09-20T21:01:11.215974+0000","last_unstale":"2024-09-20T21:01:14.986580+0000","last_undegraded":"2024-09-20T21:01:14.986580+0000","last_fullsized":"2024-09-20T21:01:14.986580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824363+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:01:15.824363+0000","last_peered":"2024-09-20T21:01:15.824363+0000","last_clean":"2024-09-20T21:01:15.824363+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:01:15.824363+0000","last_undegraded":"2024-09-20T21:01:15.824363+0000","last_fullsized":"2024-09-20T21:01:15.824363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986856+0000","last_change":"2024-09-20T21:01:11.217713+0000","last_active":"2024-09-20T21:01:14.986856+0000","last_peered":"2024-09-20T21:01:14.986856+0000","last_clean":"2024-09-20T21:01:14.986856+0000","last_became_active":"2024-09-20T21:01:11.215699+0000","last_became_peered":"2024-09-20T21:01:11.215699+0000","last_unstale":"2024-09-20T21:01:14.986856+0000","last_undegraded":"2024-09-20T21:01:14.986856+0000","last_fullsized":"2024-09-20T21:01:14.986856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:06.986446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824922+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:01:15.824922+0000","last_peered":"2024-09-20T21:01:15.824922+0000","last_clean":"2024-09-20T21:01:15.824922+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:01:15.824922+0000","last_undegraded":"2024-09-20T21:01:15.824922+0000","last_fullsized":"2024-09-20T21:01:15.824922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304465+0000","last_change":"2024-09-20T21:01:12.227746+0000","last_active":"2024-09-20T21:01:15.304465+0000","last_peered":"2024-09-20T21:01:15.304465+0000","last_clean":"2024-09-20T21:01:15.304465+0000","last_became_active":"2024-09-20T21:01:12.226860+0000","last_became_peered":"2024-09-20T21:01:12.226860+0000","last_unstale":"2024-09-20T21:01:15.304465+0000","last_undegraded":"2024-09-20T21:01:15.304465+0000","last_fullsized":"2024-09-20T21:01:15.304465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:02.144980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824585+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:01:15.824585+0000","last_peered":"2024-09-20T21:01:15.824585+0000","last_clean":"2024-09-20T21:01:15.824585+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:01:15.824585+0000","last_undegraded":"2024-09-20T21:01:15.824585+0000","last_fullsized":"2024-09-20T21:01:15.824585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306339+0000","last_change":"2024-09-20T21:01:09.385616+0000","last_active":"2024-09-20T21:01:15.306339+0000","last_peered":"2024-09-20T21:01:15.306339+0000","last_clean":"2024-09-20T21:01:15.306339+0000","last_became_active":"2024-09-20T21:01:07.000811+0000","last_became_peered":"2024-09-20T21:01:07.000811+0000","last_unstale":"2024-09-20T21:01:15.306339+0000","last_undegraded":"2024-09-20T21:01:15.306339+0000","last_fullsized":"2024-09-20T21:01:15.306339+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:03.917240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077098100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304881+0000","last_change":"2024-09-20T21:01:12.227533+0000","last_active":"2024-09-20T21:01:15.304881+0000","last_peered":"2024-09-20T21:01:15.304881+0000","last_clean":"2024-09-20T21:01:15.304881+0000","last_became_active":"2024-09-20T21:01:12.226676+0000","last_became_peered":"2024-09-20T21:01:12.226676+0000","last_unstale":"2024-09-20T21:01:15.304881+0000","last_undegraded":"2024-09-20T21:01:15.304881+0000","last_fullsized":"2024-09-20T21:01:15.304881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825579+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:01:15.825579+0000","last_peered":"2024-09-20T21:01:15.825579+0000","last_clean":"2024-09-20T21:01:15.825579+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:01:15.825579+0000","last_undegraded":"2024-09-20T21:01:15.825579+0000","last_fullsized":"2024-09-20T21:01:15.825579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825452+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:01:15.825452+0000","last_peered":"2024-09-20T21:01:15.825452+0000","last_clean":"2024-09-20T21:01:15.825452+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:01:15.825452+0000","last_undegraded":"2024-09-20T21:01:15.825452+0000","last_fullsized":"2024-09-20T21:01:15.825452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823700+0000","last_change":"2024-09-20T21:01:12.227354+0000","last_active":"2024-09-20T21:01:15.823700+0000","last_peered":"2024-09-20T21:01:15.823700+0000","last_clean":"2024-09-20T21:01:15.823700+0000","last_became_active":"2024-09-20T21:01:12.226078+0000","last_became_peered":"2024-09-20T21:01:12.226078+0000","last_unstale":"2024-09-20T21:01:15.823700+0000","last_undegraded":"2024-09-20T21:01:15.823700+0000","last_fullsized":"2024-09-20T21:01:15.823700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825269+0000","last_change":"2024-09-20T21:01:11.220479+0000","last_active":"2024-09-20T21:01:15.825269+0000","last_peered":"2024-09-20T21:01:15.825269+0000","last_clean":"2024-09-20T21:01:15.825269+0000","last_became_active":"2024-09-20T21:01:11.219658+0000","last_became_peered":"2024-09-20T21:01:11.219658+0000","last_unstale":"2024-09-20T21:01:15.825269+0000","last_undegraded":"2024-09-20T21:01:15.825269+0000","last_fullsized":"2024-09-20T21:01:15.825269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986873+0000","last_change":"2024-09-20T21:01:09.029413+0000","last_active":"2024-09-20T21:01:14.986873+0000","last_peered":"2024-09-20T21:01:14.986873+0000","last_clean":"2024-09-20T21:01:14.986873+0000","last_became_active":"2024-09-20T21:01:06.997186+0000","last_became_peered":"2024-09-20T21:01:06.997186+0000","last_unstale":"2024-09-20T21:01:14.986873+0000","last_undegraded":"2024-09-20T21:01:14.986873+0000","last_fullsized":"2024-09-20T21:01:14.986873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:09:55.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.303941+0000","last_change":"2024-09-20T21:01:12.228307+0000","last_active":"2024-09-20T21:01:15.303941+0000","last_peered":"2024-09-20T21:01:15.303941+0000","last_clean":"2024-09-20T21:01:15.303941+0000","last_became_active":"2024-09-20T21:01:12.226322+0000","last_became_peered":"2024-09-20T21:01:12.226322+0000","last_unstale":"2024-09-20T21:01:15.303941+0000","last_undegraded":"2024-09-20T21:01:15.303941+0000","last_fullsized":"2024-09-20T21:01:15.303941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:52.194070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985673+0000","last_change":"2024-09-20T21:01:12.220324+0000","last_active":"2024-09-20T21:01:14.985673+0000","last_peered":"2024-09-20T21:01:14.985673+0000","last_clean":"2024-09-20T21:01:14.985673+0000","last_became_active":"2024-09-20T21:01:12.219327+0000","last_became_peered":"2024-09-20T21:01:12.219327+0000","last_unstale":"2024-09-20T21:01:14.985673+0000","last_undegraded":"2024-09-20T21:01:14.985673+0000","last_fullsized":"2024-09-20T21:01:14.985673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:56.030003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986595+0000","last_change":"2024-09-20T21:01:11.221231+0000","last_active":"2024-09-20T21:01:14.986595+0000","last_peered":"2024-09-20T21:01:14.986595+0000","last_clean":"2024-09-20T21:01:14.986595+0000","last_became_active":"2024-09-20T21:01:11.220426+0000","last_became_peered":"2024-09-20T21:01:11.220426+0000","last_unstale":"2024-09-20T21:01:14.986595+0000","last_undegraded":"2024-09-20T21:01:14.986595+0000","last_fullsized":"2024-09-20T21:01:14.986595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822977+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:01:15.822977+0000","last_peered":"2024-09-20T21:01:15.822977+0000","last_clean":"2024-09-20T21:01:15.822977+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:01:15.822977+0000","last_undegraded":"2024-09-20T21:01:15.822977+0000","last_fullsized":"2024-09-20T21:01:15.822977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305982+0000","last_change":"2024-09-20T21:01:11.220027+0000","last_active":"2024-09-20T21:01:15.305982+0000","last_peered":"2024-09-20T21:01:15.305982+0000","last_clean":"2024-09-20T21:01:15.305982+0000","last_became_active":"2024-09-20T21:01:11.218551+0000","last_became_peered":"2024-09-20T21:01:11.218551+0000","last_unstale":"2024-09-20T21:01:15.305982+0000","last_undegraded":"2024-09-20T21:01:15.305982+0000","last_fullsized":"2024-09-20T21:01:15.305982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:47:59.918561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986048+0000","last_change":"2024-09-20T21:01:11.218922+0000","last_active":"2024-09-20T21:01:14.986048+0000","last_peered":"2024-09-20T21:01:14.986048+0000","last_clean":"2024-09-20T21:01:14.986048+0000","last_became_active":"2024-09-20T21:01:11.218028+0000","last_became_peered":"2024-09-20T21:01:11.218028+0000","last_unstale":"2024-09-20T21:01:14.986048+0000","last_undegraded":"2024-09-20T21:01:14.986048+0000","last_fullsized":"2024-09-20T21:01:14.986048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822895+0000","last_change":"2024-09-20T21:01:12.211553+0000","last_active":"2024-09-20T21:01:15.822895+0000","last_peered":"2024-09-20T21:01:15.822895+0000","last_clean":"2024-09-20T21:01:15.822895+0000","last_became_active":"2024-09-20T21:01:12.210101+0000","last_became_peered":"2024-09-20T21:01:12.210101+0000","last_unstale":"2024-09-20T21:01:15.822895+0000","last_undegraded":"2024-09-20T21:01:15.822895+0000","last_fullsized":"2024-09-20T21:01:15.822895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825324+0000","last_change":"2024-09-20T21:01:11.221867+0000","last_active":"2024-09-20T21:01:15.825324+0000","last_peered":"2024-09-20T21:01:15.825324+0000","last_clean":"2024-09-20T21:01:15.825324+0000","last_became_active":"2024-09-20T21:01:11.220980+0000","last_became_peered":"2024-09-20T21:01:11.220980+0000","last_unstale":"2024-09-20T21:01:15.825324+0000","last_undegraded":"2024-09-20T21:01:15.825324+0000","last_fullsized":"2024-09-20T21:01:15.825324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823018+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:01:15.823018+0000","last_peered":"2024-09-20T21:01:15.823018+0000","last_clean":"2024-09-20T21:01:15.823018+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:01:15.823018+0000","last_undegraded":"2024-09-20T21:01:15.823018+0000","last_fullsized":"2024-09-20T21:01:15.823018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306640+0000","last_change":"2024-09-20T21:01:12.236819+0000","last_active":"2024-09-20T21:01:15.306640+0000","last_peered":"2024-09-20T21:01:15.306640+0000","last_clean":"2024-09-20T21:01:15.306640+0000","last_became_active":"2024-09-20T21:01:12.233922+0000","last_became_peered":"2024-09-20T21:01:12.233922+0000","last_unstale":"2024-09-20T21:01:15.306640+0000","last_undegraded":"2024-09-20T21:01:15.306640+0000","last_fullsized":"2024-09-20T21:01:15.306640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823315+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:01:15.823315+0000","last_peered":"2024-09-20T21:01:15.823315+0000","last_clean":"2024-09-20T21:01:15.823315+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:01:15.823315+0000","last_undegraded":"2024-09-20T21:01:15.823315+0000","last_fullsized":"2024-09-20T21:01:15.823315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824535+0000","last_change":"2024-09-20T21:01:12.227395+0000","last_active":"2024-09-20T21:01:15.824535+0000","last_peered":"2024-09-20T21:01:15.824535+0000","last_clean":"2024-09-20T21:01:15.824535+0000","last_became_active":"2024-09-20T21:01:12.226122+0000","last_became_peered":"2024-09-20T21:01:12.226122+0000","last_unstale":"2024-09-20T21:01:15.824535+0000","last_undegraded":"2024-09-20T21:01:15.824535+0000","last_fullsized":"2024-09-20T21:01:15.824535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823918+0000","last_change":"2024-09-20T21:01:11.220367+0000","last_active":"2024-09-20T21:01:15.823918+0000","last_peered":"2024-09-20T21:01:15.823918+0000","last_clean":"2024-09-20T21:01:15.823918+0000","last_became_active":"2024-09-20T21:01:11.219090+0000","last_became_peered":"2024-09-20T21:01:11.219090+0000","last_unstale":"2024-09-20T21:01:15.823918+0000","last_undegraded":"2024-09-20T21:01:15.823918+0000","last_fullsized":"2024-09-20T21:01:15.823918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305423+0000","last_change":"2024-09-20T21:01:12.238895+0000","last_active":"2024-09-20T21:01:15.305423+0000","last_peered":"2024-09-20T21:01:15.305423+0000","last_clean":"2024-09-20T21:01:15.305423+0000","last_became_active":"2024-09-20T21:01:12.235481+0000","last_became_peered":"2024-09-20T21:01:12.235481+0000","last_unstale":"2024-09-20T21:01:15.305423+0000","last_undegraded":"2024-09-20T21:01:15.305423+0000","last_fullsized":"2024-09-20T21:01:15.305423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304734+0000","last_change":"2024-09-20T21:01:11.217493+0000","last_active":"2024-09-20T21:01:15.304734+0000","last_peered":"2024-09-20T21:01:15.304734+0000","last_clean":"2024-09-20T21:01:15.304734+0000","last_became_active":"2024-09-20T21:01:11.216073+0000","last_became_peered":"2024-09-20T21:01:11.216073+0000","last_unstale":"2024-09-20T21:01:15.304734+0000","last_undegraded":"2024-09-20T21:01:15.304734+0000","last_fullsized":"2024-09-20T21:01:15.304734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:23:30.512126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305358+0000","last_change":"2024-09-20T21:01:12.232371+0000","last_active":"2024-09-20T21:01:15.305358+0000","last_peered":"2024-09-20T21:01:15.305358+0000","last_clean":"2024-09-20T21:01:15.305358+0000","last_became_active":"2024-09-20T21:01:12.231450+0000","last_became_peered":"2024-09-20T21:01:12.231450+0000","last_unstale":"2024-09-20T21:01:15.305358+0000","last_undegraded":"2024-09-20T21:01:15.305358+0000","last_fullsized":"2024-09-20T21:01:15.305358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305184+0000","last_change":"2024-09-20T21:01:11.218440+0000","last_active":"2024-09-20T21:01:15.305184+0000","last_peered":"2024-09-20T21:01:15.305184+0000","last_clean":"2024-09-20T21:01:15.305184+0000","last_became_active":"2024-09-20T21:01:11.217722+0000","last_became_peered":"2024-09-20T21:01:11.217722+0000","last_unstale":"2024-09-20T21:01:15.305184+0000","last_undegraded":"2024-09-20T21:01:15.305184+0000","last_fullsized":"2024-09-20T21:01:15.305184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:11:02.101254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985035+0000","last_change":"2024-09-20T21:01:12.212994+0000","last_active":"2024-09-20T21:01:14.985035+0000","last_peered":"2024-09-20T21:01:14.985035+0000","last_clean":"2024-09-20T21:01:14.985035+0000","last_became_active":"2024-09-20T21:01:12.211080+0000","last_became_peered":"2024-09-20T21:01:12.211080+0000","last_unstale":"2024-09-20T21:01:14.985035+0000","last_undegraded":"2024-09-20T21:01:14.985035+0000","last_fullsized":"2024-09-20T21:01:14.985035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986320+0000","last_change":"2024-09-20T21:01:11.217211+0000","last_active":"2024-09-20T21:01:14.986320+0000","last_peered":"2024-09-20T21:01:14.986320+0000","last_clean":"2024-09-20T21:01:14.986320+0000","last_became_active":"2024-09-20T21:01:11.216428+0000","last_became_peered":"2024-09-20T21:01:11.216428+0000","last_unstale":"2024-09-20T21:01:14.986320+0000","last_undegraded":"2024-09-20T21:01:14.986320+0000","last_fullsized":"2024-09-20T21:01:14.986320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986366+0000","last_change":"2024-09-20T21:01:12.214965+0000","last_active":"2024-09-20T21:01:14.986366+0000","last_peered":"2024-09-20T21:01:14.986366+0000","last_clean":"2024-09-20T21:01:14.986366+0000","last_became_active":"2024-09-20T21:01:12.211534+0000","last_became_peered":"2024-09-20T21:01:12.211534+0000","last_unstale":"2024-09-20T21:01:14.986366+0000","last_undegraded":"2024-09-20T21:01:14.986366+0000","last_fullsized":"2024-09-20T21:01:14.986366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305711+0000","last_change":"2024-09-20T21:01:11.220332+0000","last_active":"2024-09-20T21:01:15.305711+0000","last_peered":"2024-09-20T21:01:15.305711+0000","last_clean":"2024-09-20T21:01:15.305711+0000","last_became_active":"2024-09-20T21:01:11.219022+0000","last_became_peered":"2024-09-20T21:01:11.219022+0000","last_unstale":"2024-09-20T21:01:15.305711+0000","last_undegraded":"2024-09-20T21:01:15.305711+0000","last_fullsized":"2024-09-20T21:01:15.305711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.928114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304479+0000","last_change":"2024-09-20T21:01:12.238819+0000","last_active":"2024-09-20T21:01:15.304479+0000","last_peered":"2024-09-20T21:01:15.304479+0000","last_clean":"2024-09-20T21:01:15.304479+0000","last_became_active":"2024-09-20T21:01:12.237939+0000","last_became_peered":"2024-09-20T21:01:12.237939+0000","last_unstale":"2024-09-20T21:01:15.304479+0000","last_undegraded":"2024-09-20T21:01:15.304479+0000","last_fullsized":"2024-09-20T21:01:15.304479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825078+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:01:15.825078+0000","last_peered":"2024-09-20T21:01:15.825078+0000","last_clean":"2024-09-20T21:01:15.825078+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:01:15.825078+0000","last_undegraded":"2024-09-20T21:01:15.825078+0000","last_fullsized":"2024-09-20T21:01:15.825078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986017+0000","last_change":"2024-09-20T21:01:12.213562+0000","last_active":"2024-09-20T21:01:14.986017+0000","last_peered":"2024-09-20T21:01:14.986017+0000","last_clean":"2024-09-20T21:01:14.986017+0000","last_became_active":"2024-09-20T21:01:12.210781+0000","last_became_peered":"2024-09-20T21:01:12.210781+0000","last_unstale":"2024-09-20T21:01:14.986017+0000","last_undegraded":"2024-09-20T21:01:14.986017+0000","last_fullsized":"2024-09-20T21:01:14.986017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825003+0000","last_change":"2024-09-20T21:01:11.222738+0000","last_active":"2024-09-20T21:01:15.825003+0000","last_peered":"2024-09-20T21:01:15.825003+0000","last_clean":"2024-09-20T21:01:15.825003+0000","last_became_active":"2024-09-20T21:01:11.221990+0000","last_became_peered":"2024-09-20T21:01:11.221990+0000","last_unstale":"2024-09-20T21:01:15.825003+0000","last_undegraded":"2024-09-20T21:01:15.825003+0000","last_fullsized":"2024-09-20T21:01:15.825003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":258048,"data_stored":655436,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":270336,"data_stored":656071,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:01:18.791 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:01:19.104 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:19.106 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:01:19.121 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-20T21:01:18.859248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90108,"kb_used_data":696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025412,"statfs":{"total":289910292480,"available":289818021888,"internally_reserved":0,"allocated":712704,"data_stored":1375416,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4788,"internal_metadata":91483468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.669287"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306410+0000","last_change":"2024-09-20T21:01:12.240709+0000","last_active":"2024-09-20T21:01:15.306410+0000","last_peered":"2024-09-20T21:01:15.306410+0000","last_clean":"2024-09-20T21:01:15.306410+0000","last_became_active":"2024-09-20T21:01:12.239599+0000","last_became_peered":"2024-09-20T21:01:12.239599+0000","last_unstale":"2024-09-20T21:01:15.306410+0000","last_undegraded":"2024-09-20T21:01:15.306410+0000","last_fullsized":"2024-09-20T21:01:15.306410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304904+0000","last_change":"2024-09-20T21:01:12.236761+0000","last_active":"2024-09-20T21:01:15.304904+0000","last_peered":"2024-09-20T21:01:15.304904+0000","last_clean":"2024-09-20T21:01:15.304904+0000","last_became_active":"2024-09-20T21:01:12.235613+0000","last_became_peered":"2024-09-20T21:01:12.235613+0000","last_unstale":"2024-09-20T21:01:15.304904+0000","last_undegraded":"2024-09-20T21:01:15.304904+0000","last_fullsized":"2024-09-20T21:01:15.304904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985464+0000","last_change":"2024-09-20T21:01:12.228562+0000","last_active":"2024-09-20T21:01:14.985464+0000","last_peered":"2024-09-20T21:01:14.985464+0000","last_clean":"2024-09-20T21:01:14.985464+0000","last_became_active":"2024-09-20T21:01:12.224894+0000","last_became_peered":"2024-09-20T21:01:12.224894+0000","last_unstale":"2024-09-20T21:01:14.985464+0000","last_undegraded":"2024-09-20T21:01:14.985464+0000","last_fullsized":"2024-09-20T21:01:14.985464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.657192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985376+0000","last_change":"2024-09-20T21:01:12.227789+0000","last_active":"2024-09-20T21:01:14.985376+0000","last_peered":"2024-09-20T21:01:14.985376+0000","last_clean":"2024-09-20T21:01:14.985376+0000","last_became_active":"2024-09-20T21:01:12.225718+0000","last_became_peered":"2024-09-20T21:01:12.225718+0000","last_unstale":"2024-09-20T21:01:14.985376+0000","last_undegraded":"2024-09-20T21:01:14.985376+0000","last_fullsized":"2024-09-20T21:01:14.985376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:15.226852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305052+0000","last_change":"2024-09-20T21:01:12.232080+0000","last_active":"2024-09-20T21:01:15.305052+0000","last_peered":"2024-09-20T21:01:15.305052+0000","last_clean":"2024-09-20T21:01:15.305052+0000","last_became_active":"2024-09-20T21:01:12.231429+0000","last_became_peered":"2024-09-20T21:01:12.231429+0000","last_unstale":"2024-09-20T21:01:15.305052+0000","last_undegraded":"2024-09-20T21:01:15.305052+0000","last_fullsized":"2024-09-20T21:01:15.305052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984770+0000","last_change":"2024-09-20T21:01:12.231871+0000","last_active":"2024-09-20T21:01:14.984770+0000","last_peered":"2024-09-20T21:01:14.984770+0000","last_clean":"2024-09-20T21:01:14.984770+0000","last_became_active":"2024-09-20T21:01:12.229463+0000","last_became_peered":"2024-09-20T21:01:12.229463+0000","last_unstale":"2024-09-20T21:01:14.984770+0000","last_undegraded":"2024-09-20T21:01:14.984770+0000","last_fullsized":"2024-09-20T21:01:14.984770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984571+0000","last_change":"2024-09-20T21:01:12.226969+0000","last_active":"2024-09-20T21:01:14.984571+0000","last_peered":"2024-09-20T21:01:14.984571+0000","last_clean":"2024-09-20T21:01:14.984571+0000","last_became_active":"2024-09-20T21:01:12.225800+0000","last_became_peered":"2024-09-20T21:01:12.225800+0000","last_unstale":"2024-09-20T21:01:14.984571+0000","last_undegraded":"2024-09-20T21:01:14.984571+0000","last_fullsized":"2024-09-20T21:01:14.984571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984474+0000","last_change":"2024-09-20T21:01:12.217357+0000","last_active":"2024-09-20T21:01:14.984474+0000","last_peered":"2024-09-20T21:01:14.984474+0000","last_clean":"2024-09-20T21:01:14.984474+0000","last_became_active":"2024-09-20T21:01:12.213483+0000","last_became_peered":"2024-09-20T21:01:12.213483+0000","last_unstale":"2024-09-20T21:01:14.984474+0000","last_undegraded":"2024-09-20T21:01:14.984474+0000","last_fullsized":"2024-09-20T21:01:14.984474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824366+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:01:15.824366+0000","last_peered":"2024-09-20T21:01:15.824366+0000","last_clean":"2024-09-20T21:01:15.824366+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:01:15.824366+0000","last_undegraded":"2024-09-20T21:01:15.824366+0000","last_fullsized":"2024-09-20T21:01:15.824366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305301+0000","last_change":"2024-09-20T21:01:12.240432+0000","last_active":"2024-09-20T21:01:15.305301+0000","last_peered":"2024-09-20T21:01:15.305301+0000","last_clean":"2024-09-20T21:01:15.305301+0000","last_became_active":"2024-09-20T21:01:12.238826+0000","last_became_peered":"2024-09-20T21:01:12.238826+0000","last_unstale":"2024-09-20T21:01:15.305301+0000","last_undegraded":"2024-09-20T21:01:15.305301+0000","last_fullsized":"2024-09-20T21:01:15.305301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985723+0000","last_change":"2024-09-20T21:01:12.213062+0000","last_active":"2024-09-20T21:01:14.985723+0000","last_peered":"2024-09-20T21:01:14.985723+0000","last_clean":"2024-09-20T21:01:14.985723+0000","last_became_active":"2024-09-20T21:01:12.211953+0000","last_became_peered":"2024-09-20T21:01:12.211953+0000","last_unstale":"2024-09-20T21:01:14.985723+0000","last_undegraded":"2024-09-20T21:01:14.985723+0000","last_fullsized":"2024-09-20T21:01:14.985723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.052874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304989+0000","last_change":"2024-09-20T21:01:12.229580+0000","last_active":"2024-09-20T21:01:15.304989+0000","last_peered":"2024-09-20T21:01:15.304989+0000","last_clean":"2024-09-20T21:01:15.304989+0000","last_became_active":"2024-09-20T21:01:12.226915+0000","last_became_peered":"2024-09-20T21:01:12.226915+0000","last_unstale":"2024-09-20T21:01:15.304989+0000","last_undegraded":"2024-09-20T21:01:15.304989+0000","last_fullsized":"2024-09-20T21:01:15.304989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.985765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304611+0000","last_change":"2024-09-20T21:01:12.230410+0000","last_active":"2024-09-20T21:01:15.304611+0000","last_peered":"2024-09-20T21:01:15.304611+0000","last_clean":"2024-09-20T21:01:15.304611+0000","last_became_active":"2024-09-20T21:01:12.229859+0000","last_became_peered":"2024-09-20T21:01:12.229859+0000","last_unstale":"2024-09-20T21:01:15.304611+0000","last_undegraded":"2024-09-20T21:01:15.304611+0000","last_fullsized":"2024-09-20T21:01:15.304611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985035+0000","last_change":"2024-09-20T21:01:12.220376+0000","last_active":"2024-09-20T21:01:14.985035+0000","last_peered":"2024-09-20T21:01:14.985035+0000","last_clean":"2024-09-20T21:01:14.985035+0000","last_became_active":"2024-09-20T21:01:12.219338+0000","last_became_peered":"2024-09-20T21:01:12.219338+0000","last_unstale":"2024-09-20T21:01:14.985035+0000","last_undegraded":"2024-09-20T21:01:14.985035+0000","last_fullsized":"2024-09-20T21:01:14.985035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984765+0000","last_change":"2024-09-20T21:01:12.218884+0000","last_active":"2024-09-20T21:01:14.984765+0000","last_peered":"2024-09-20T21:01:14.984765+0000","last_clean":"2024-09-20T21:01:14.984765+0000","last_became_active":"2024-09-20T21:01:12.218225+0000","last_became_peered":"2024-09-20T21:01:12.218225+0000","last_unstale":"2024-09-20T21:01:14.984765+0000","last_undegraded":"2024-09-20T21:01:14.984765+0000","last_fullsized":"2024-09-20T21:01:14.984765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984513+0000","last_change":"2024-09-20T21:01:12.214974+0000","last_active":"2024-09-20T21:01:14.984513+0000","last_peered":"2024-09-20T21:01:14.984513+0000","last_clean":"2024-09-20T21:01:14.984513+0000","last_became_active":"2024-09-20T21:01:12.212149+0000","last_became_peered":"2024-09-20T21:01:12.212149+0000","last_unstale":"2024-09-20T21:01:14.984513+0000","last_undegraded":"2024-09-20T21:01:14.984513+0000","last_fullsized":"2024-09-20T21:01:14.984513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825339+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:01:15.825339+0000","last_peered":"2024-09-20T21:01:15.825339+0000","last_clean":"2024-09-20T21:01:15.825339+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:01:15.825339+0000","last_undegraded":"2024-09-20T21:01:15.825339+0000","last_fullsized":"2024-09-20T21:01:15.825339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305951+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:01:15.305951+0000","last_peered":"2024-09-20T21:01:15.305951+0000","last_clean":"2024-09-20T21:01:15.305951+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:01:15.305951+0000","last_undegraded":"2024-09-20T21:01:15.305951+0000","last_fullsized":"2024-09-20T21:01:15.305951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823775+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:01:15.823775+0000","last_peered":"2024-09-20T21:01:15.823775+0000","last_clean":"2024-09-20T21:01:15.823775+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:01:15.823775+0000","last_undegraded":"2024-09-20T21:01:15.823775+0000","last_fullsized":"2024-09-20T21:01:15.823775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986032+0000","last_change":"2024-09-20T21:01:12.212785+0000","last_active":"2024-09-20T21:01:14.986032+0000","last_peered":"2024-09-20T21:01:14.986032+0000","last_clean":"2024-09-20T21:01:14.986032+0000","last_became_active":"2024-09-20T21:01:12.211844+0000","last_became_peered":"2024-09-20T21:01:12.211844+0000","last_unstale":"2024-09-20T21:01:14.986032+0000","last_undegraded":"2024-09-20T21:01:14.986032+0000","last_fullsized":"2024-09-20T21:01:14.986032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:38.821473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986326+0000","last_change":"2024-09-20T21:01:12.210710+0000","last_active":"2024-09-20T21:01:14.986326+0000","last_peered":"2024-09-20T21:01:14.986326+0000","last_clean":"2024-09-20T21:01:14.986326+0000","last_became_active":"2024-09-20T21:01:12.209676+0000","last_became_peered":"2024-09-20T21:01:12.209676+0000","last_unstale":"2024-09-20T21:01:14.986326+0000","last_undegraded":"2024-09-20T21:01:14.986326+0000","last_fullsized":"2024-09-20T21:01:14.986326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:48.442304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304234+0000","last_change":"2024-09-20T21:01:12.230375+0000","last_active":"2024-09-20T21:01:15.304234+0000","last_peered":"2024-09-20T21:01:15.304234+0000","last_clean":"2024-09-20T21:01:15.304234+0000","last_became_active":"2024-09-20T21:01:12.228679+0000","last_became_peered":"2024-09-20T21:01:12.228679+0000","last_unstale":"2024-09-20T21:01:15.304234+0000","last_undegraded":"2024-09-20T21:01:15.304234+0000","last_fullsized":"2024-09-20T21:01:15.304234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822604+0000","last_change":"2024-09-20T21:01:12.214484+0000","last_active":"2024-09-20T21:01:15.822604+0000","last_peered":"2024-09-20T21:01:15.822604+0000","last_clean":"2024-09-20T21:01:15.822604+0000","last_became_active":"2024-09-20T21:01:12.212293+0000","last_became_peered":"2024-09-20T21:01:12.212293+0000","last_unstale":"2024-09-20T21:01:15.822604+0000","last_undegraded":"2024-09-20T21:01:15.822604+0000","last_fullsized":"2024-09-20T21:01:15.822604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304078+0000","last_change":"2024-09-20T21:01:12.229114+0000","last_active":"2024-09-20T21:01:15.304078+0000","last_peered":"2024-09-20T21:01:15.304078+0000","last_clean":"2024-09-20T21:01:15.304078+0000","last_became_active":"2024-09-20T21:01:12.227812+0000","last_became_peered":"2024-09-20T21:01:12.227812+0000","last_unstale":"2024-09-20T21:01:15.304078+0000","last_undegraded":"2024-09-20T21:01:15.304078+0000","last_fullsized":"2024-09-20T21:01:15.304078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:02.638461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306541+0000","last_change":"2024-09-20T21:01:12.237926+0000","last_active":"2024-09-20T21:01:15.306541+0000","last_peered":"2024-09-20T21:01:15.306541+0000","last_clean":"2024-09-20T21:01:15.306541+0000","last_became_active":"2024-09-20T21:01:12.234061+0000","last_became_peered":"2024-09-20T21:01:12.234061+0000","last_unstale":"2024-09-20T21:01:15.306541+0000","last_undegraded":"2024-09-20T21:01:15.306541+0000","last_fullsized":"2024-09-20T21:01:15.306541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824786+0000","last_change":"2024-09-20T21:01:12.214728+0000","last_active":"2024-09-20T21:01:15.824786+0000","last_peered":"2024-09-20T21:01:15.824786+0000","last_clean":"2024-09-20T21:01:15.824786+0000","last_became_active":"2024-09-20T21:01:12.213159+0000","last_became_peered":"2024-09-20T21:01:12.213159+0000","last_unstale":"2024-09-20T21:01:15.824786+0000","last_undegraded":"2024-09-20T21:01:15.824786+0000","last_fullsized":"2024-09-20T21:01:15.824786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985824+0000","last_change":"2024-09-20T21:01:12.227975+0000","last_active":"2024-09-20T21:01:14.985824+0000","last_peered":"2024-09-20T21:01:14.985824+0000","last_clean":"2024-09-20T21:01:14.985824+0000","last_became_active":"2024-09-20T21:01:12.223433+0000","last_became_peered":"2024-09-20T21:01:12.223433+0000","last_unstale":"2024-09-20T21:01:14.985824+0000","last_undegraded":"2024-09-20T21:01:14.985824+0000","last_fullsized":"2024-09-20T21:01:14.985824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:32.017817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305701+0000","last_change":"2024-09-20T21:01:12.227425+0000","last_active":"2024-09-20T21:01:15.305701+0000","last_peered":"2024-09-20T21:01:15.305701+0000","last_clean":"2024-09-20T21:01:15.305701+0000","last_became_active":"2024-09-20T21:01:12.226625+0000","last_became_peered":"2024-09-20T21:01:12.226625+0000","last_unstale":"2024-09-20T21:01:15.305701+0000","last_undegraded":"2024-09-20T21:01:15.305701+0000","last_fullsized":"2024-09-20T21:01:15.305701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824366+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:01:15.824366+0000","last_peered":"2024-09-20T21:01:15.824366+0000","last_clean":"2024-09-20T21:01:15.824366+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:01:15.824366+0000","last_undegraded":"2024-09-20T21:01:15.824366+0000","last_fullsized":"2024-09-20T21:01:15.824366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304558+0000","last_change":"2024-09-20T21:01:12.230684+0000","last_active":"2024-09-20T21:01:15.304558+0000","last_peered":"2024-09-20T21:01:15.304558+0000","last_clean":"2024-09-20T21:01:15.304558+0000","last_became_active":"2024-09-20T21:01:12.229915+0000","last_became_peered":"2024-09-20T21:01:12.229915+0000","last_unstale":"2024-09-20T21:01:15.304558+0000","last_undegraded":"2024-09-20T21:01:15.304558+0000","last_fullsized":"2024-09-20T21:01:15.304558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822770+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:01:15.822770+0000","last_peered":"2024-09-20T21:01:15.822770+0000","last_clean":"2024-09-20T21:01:15.822770+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:01:15.822770+0000","last_undegraded":"2024-09-20T21:01:15.822770+0000","last_fullsized":"2024-09-20T21:01:15.822770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984770+0000","last_change":"2024-09-20T21:01:12.215773+0000","last_active":"2024-09-20T21:01:14.984770+0000","last_peered":"2024-09-20T21:01:14.984770+0000","last_clean":"2024-09-20T21:01:14.984770+0000","last_became_active":"2024-09-20T21:01:12.212199+0000","last_became_peered":"2024-09-20T21:01:12.212199+0000","last_unstale":"2024-09-20T21:01:14.984770+0000","last_undegraded":"2024-09-20T21:01:14.984770+0000","last_fullsized":"2024-09-20T21:01:14.984770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305678+0000","last_change":"2024-09-20T21:01:12.232814+0000","last_active":"2024-09-20T21:01:15.305678+0000","last_peered":"2024-09-20T21:01:15.305678+0000","last_clean":"2024-09-20T21:01:15.305678+0000","last_became_active":"2024-09-20T21:01:12.232026+0000","last_became_peered":"2024-09-20T21:01:12.232026+0000","last_unstale":"2024-09-20T21:01:15.305678+0000","last_undegraded":"2024-09-20T21:01:15.305678+0000","last_fullsized":"2024-09-20T21:01:15.305678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986403+0000","last_change":"2024-09-20T21:01:11.216956+0000","last_active":"2024-09-20T21:01:14.986403+0000","last_peered":"2024-09-20T21:01:14.986403+0000","last_clean":"2024-09-20T21:01:14.986403+0000","last_became_active":"2024-09-20T21:01:11.216462+0000","last_became_peered":"2024-09-20T21:01:11.216462+0000","last_unstale":"2024-09-20T21:01:14.986403+0000","last_undegraded":"2024-09-20T21:01:14.986403+0000","last_fullsized":"2024-09-20T21:01:14.986403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305641+0000","last_change":"2024-09-20T21:01:12.230727+0000","last_active":"2024-09-20T21:01:15.305641+0000","last_peered":"2024-09-20T21:01:15.305641+0000","last_clean":"2024-09-20T21:01:15.305641+0000","last_became_active":"2024-09-20T21:01:12.229987+0000","last_became_peered":"2024-09-20T21:01:12.229987+0000","last_unstale":"2024-09-20T21:01:15.305641+0000","last_undegraded":"2024-09-20T21:01:15.305641+0000","last_fullsized":"2024-09-20T21:01:15.305641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823289+0000","last_change":"2024-09-20T21:01:11.220335+0000","last_active":"2024-09-20T21:01:15.823289+0000","last_peered":"2024-09-20T21:01:15.823289+0000","last_clean":"2024-09-20T21:01:15.823289+0000","last_became_active":"2024-09-20T21:01:11.219506+0000","last_became_peered":"2024-09-20T21:01:11.219506+0000","last_unstale":"2024-09-20T21:01:15.823289+0000","last_undegraded":"2024-09-20T21:01:15.823289+0000","last_fullsized":"2024-09-20T21:01:15.823289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:16:05.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825073+0000","last_change":"2024-09-20T21:01:12.214329+0000","last_active":"2024-09-20T21:01:15.825073+0000","last_peered":"2024-09-20T21:01:15.825073+0000","last_clean":"2024-09-20T21:01:15.825073+0000","last_became_active":"2024-09-20T21:01:12.212104+0000","last_became_peered":"2024-09-20T21:01:12.212104+0000","last_unstale":"2024-09-20T21:01:15.825073+0000","last_undegraded":"2024-09-20T21:01:15.825073+0000","last_fullsized":"2024-09-20T21:01:15.825073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304158+0000","last_change":"2024-09-20T21:01:11.213590+0000","last_active":"2024-09-20T21:01:15.304158+0000","last_peered":"2024-09-20T21:01:15.304158+0000","last_clean":"2024-09-20T21:01:15.304158+0000","last_became_active":"2024-09-20T21:01:11.212919+0000","last_became_peered":"2024-09-20T21:01:11.212919+0000","last_unstale":"2024-09-20T21:01:15.304158+0000","last_undegraded":"2024-09-20T21:01:15.304158+0000","last_fullsized":"2024-09-20T21:01:15.304158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.040754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824531+0000","last_change":"2024-09-20T21:01:12.214556+0000","last_active":"2024-09-20T21:01:15.824531+0000","last_peered":"2024-09-20T21:01:15.824531+0000","last_clean":"2024-09-20T21:01:15.824531+0000","last_became_active":"2024-09-20T21:01:12.212508+0000","last_became_peered":"2024-09-20T21:01:12.212508+0000","last_unstale":"2024-09-20T21:01:15.824531+0000","last_undegraded":"2024-09-20T21:01:15.824531+0000","last_fullsized":"2024-09-20T21:01:15.824531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985051+0000","last_change":"2024-09-20T21:01:11.224946+0000","last_active":"2024-09-20T21:01:14.985051+0000","last_peered":"2024-09-20T21:01:14.985051+0000","last_clean":"2024-09-20T21:01:14.985051+0000","last_became_active":"2024-09-20T21:01:11.224026+0000","last_became_peered":"2024-09-20T21:01:11.224026+0000","last_unstale":"2024-09-20T21:01:14.985051+0000","last_undegraded":"2024-09-20T21:01:14.985051+0000","last_fullsized":"2024-09-20T21:01:14.985051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986492+0000","last_change":"2024-09-20T21:01:11.221253+0000","last_active":"2024-09-20T21:01:14.986492+0000","last_peered":"2024-09-20T21:01:14.986492+0000","last_clean":"2024-09-20T21:01:14.986492+0000","last_became_active":"2024-09-20T21:01:11.220476+0000","last_became_peered":"2024-09-20T21:01:11.220476+0000","last_unstale":"2024-09-20T21:01:14.986492+0000","last_undegraded":"2024-09-20T21:01:14.986492+0000","last_fullsized":"2024-09-20T21:01:14.986492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304115+0000","last_change":"2024-09-20T21:01:12.229503+0000","last_active":"2024-09-20T21:01:15.304115+0000","last_peered":"2024-09-20T21:01:15.304115+0000","last_clean":"2024-09-20T21:01:15.304115+0000","last_became_active":"2024-09-20T21:01:12.228540+0000","last_became_peered":"2024-09-20T21:01:12.228540+0000","last_unstale":"2024-09-20T21:01:15.304115+0000","last_undegraded":"2024-09-20T21:01:15.304115+0000","last_fullsized":"2024-09-20T21:01:15.304115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:13.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305796+0000","last_change":"2024-09-20T21:01:11.214247+0000","last_active":"2024-09-20T21:01:15.305796+0000","last_peered":"2024-09-20T21:01:15.305796+0000","last_clean":"2024-09-20T21:01:15.305796+0000","last_became_active":"2024-09-20T21:01:11.212760+0000","last_became_peered":"2024-09-20T21:01:11.212760+0000","last_unstale":"2024-09-20T21:01:15.305796+0000","last_undegraded":"2024-09-20T21:01:15.305796+0000","last_fullsized":"2024-09-20T21:01:15.305796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:20.108703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.303861+0000","last_change":"2024-09-20T21:01:12.238294+0000","last_active":"2024-09-20T21:01:15.303861+0000","last_peered":"2024-09-20T21:01:15.303861+0000","last_clean":"2024-09-20T21:01:15.303861+0000","last_became_active":"2024-09-20T21:01:12.237461+0000","last_became_peered":"2024-09-20T21:01:12.237461+0000","last_unstale":"2024-09-20T21:01:15.303861+0000","last_undegraded":"2024-09-20T21:01:15.303861+0000","last_fullsized":"2024-09-20T21:01:15.303861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:11.215425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986624+0000","last_change":"2024-09-20T21:01:11.221716+0000","last_active":"2024-09-20T21:01:14.986624+0000","last_peered":"2024-09-20T21:01:14.986624+0000","last_clean":"2024-09-20T21:01:14.986624+0000","last_became_active":"2024-09-20T21:01:11.220620+0000","last_became_peered":"2024-09-20T21:01:11.220620+0000","last_unstale":"2024-09-20T21:01:14.986624+0000","last_undegraded":"2024-09-20T21:01:14.986624+0000","last_fullsized":"2024-09-20T21:01:14.986624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:13.593747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985365+0000","last_change":"2024-09-20T21:01:12.210785+0000","last_active":"2024-09-20T21:01:14.985365+0000","last_peered":"2024-09-20T21:01:14.985365+0000","last_clean":"2024-09-20T21:01:14.985365+0000","last_became_active":"2024-09-20T21:01:12.209489+0000","last_became_peered":"2024-09-20T21:01:12.209489+0000","last_unstale":"2024-09-20T21:01:14.985365+0000","last_undegraded":"2024-09-20T21:01:14.985365+0000","last_fullsized":"2024-09-20T21:01:14.985365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986875+0000","last_change":"2024-09-20T21:01:11.217199+0000","last_active":"2024-09-20T21:01:14.986875+0000","last_peered":"2024-09-20T21:01:14.986875+0000","last_clean":"2024-09-20T21:01:14.986875+0000","last_became_active":"2024-09-20T21:01:11.216370+0000","last_became_peered":"2024-09-20T21:01:11.216370+0000","last_unstale":"2024-09-20T21:01:14.986875+0000","last_undegraded":"2024-09-20T21:01:14.986875+0000","last_fullsized":"2024-09-20T21:01:14.986875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824109+0000","last_change":"2024-09-20T21:01:12.220592+0000","last_active":"2024-09-20T21:01:15.824109+0000","last_peered":"2024-09-20T21:01:15.824109+0000","last_clean":"2024-09-20T21:01:15.824109+0000","last_became_active":"2024-09-20T21:01:12.219682+0000","last_became_peered":"2024-09-20T21:01:12.219682+0000","last_unstale":"2024-09-20T21:01:15.824109+0000","last_undegraded":"2024-09-20T21:01:15.824109+0000","last_fullsized":"2024-09-20T21:01:15.824109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824706+0000","last_change":"2024-09-20T21:01:11.220548+0000","last_active":"2024-09-20T21:01:15.824706+0000","last_peered":"2024-09-20T21:01:15.824706+0000","last_clean":"2024-09-20T21:01:15.824706+0000","last_became_active":"2024-09-20T21:01:11.219847+0000","last_became_peered":"2024-09-20T21:01:11.219847+0000","last_unstale":"2024-09-20T21:01:15.824706+0000","last_undegraded":"2024-09-20T21:01:15.824706+0000","last_fullsized":"2024-09-20T21:01:15.824706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985939+0000","last_change":"2024-09-20T21:01:12.211812+0000","last_active":"2024-09-20T21:01:14.985939+0000","last_peered":"2024-09-20T21:01:14.985939+0000","last_clean":"2024-09-20T21:01:14.985939+0000","last_became_active":"2024-09-20T21:01:12.209826+0000","last_became_peered":"2024-09-20T21:01:12.209826+0000","last_unstale":"2024-09-20T21:01:14.985939+0000","last_undegraded":"2024-09-20T21:01:14.985939+0000","last_fullsized":"2024-09-20T21:01:14.985939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:46:41.210017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986629+0000","last_change":"2024-09-20T21:01:11.219106+0000","last_active":"2024-09-20T21:01:14.986629+0000","last_peered":"2024-09-20T21:01:14.986629+0000","last_clean":"2024-09-20T21:01:14.986629+0000","last_became_active":"2024-09-20T21:01:11.218259+0000","last_became_peered":"2024-09-20T21:01:11.218259+0000","last_unstale":"2024-09-20T21:01:14.986629+0000","last_undegraded":"2024-09-20T21:01:14.986629+0000","last_fullsized":"2024-09-20T21:01:14.986629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986094+0000","last_change":"2024-09-20T21:01:12.225987+0000","last_active":"2024-09-20T21:01:14.986094+0000","last_peered":"2024-09-20T21:01:14.986094+0000","last_clean":"2024-09-20T21:01:14.986094+0000","last_became_active":"2024-09-20T21:01:12.222916+0000","last_became_peered":"2024-09-20T21:01:12.222916+0000","last_unstale":"2024-09-20T21:01:14.986094+0000","last_undegraded":"2024-09-20T21:01:14.986094+0000","last_fullsized":"2024-09-20T21:01:14.986094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:16.681572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304200+0000","last_change":"2024-09-20T21:01:11.213371+0000","last_active":"2024-09-20T21:01:15.304200+0000","last_peered":"2024-09-20T21:01:15.304200+0000","last_clean":"2024-09-20T21:01:15.304200+0000","last_became_active":"2024-09-20T21:01:11.212385+0000","last_became_peered":"2024-09-20T21:01:11.212385+0000","last_unstale":"2024-09-20T21:01:15.304200+0000","last_undegraded":"2024-09-20T21:01:15.304200+0000","last_fullsized":"2024-09-20T21:01:15.304200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:56.734999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985452+0000","last_change":"2024-09-20T21:01:12.202841+0000","last_active":"2024-09-20T21:01:14.985452+0000","last_peered":"2024-09-20T21:01:14.985452+0000","last_clean":"2024-09-20T21:01:14.985452+0000","last_became_active":"2024-09-20T21:01:12.201016+0000","last_became_peered":"2024-09-20T21:01:12.201016+0000","last_unstale":"2024-09-20T21:01:14.985452+0000","last_undegraded":"2024-09-20T21:01:14.985452+0000","last_fullsized":"2024-09-20T21:01:14.985452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:55.984268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304606+0000","last_change":"2024-09-20T21:01:11.220785+0000","last_active":"2024-09-20T21:01:15.304606+0000","last_peered":"2024-09-20T21:01:15.304606+0000","last_clean":"2024-09-20T21:01:15.304606+0000","last_became_active":"2024-09-20T21:01:11.220111+0000","last_became_peered":"2024-09-20T21:01:11.220111+0000","last_unstale":"2024-09-20T21:01:15.304606+0000","last_undegraded":"2024-09-20T21:01:15.304606+0000","last_fullsized":"2024-09-20T21:01:15.304606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.621763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824680+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:01:15.824680+0000","last_peered":"2024-09-20T21:01:15.824680+0000","last_clean":"2024-09-20T21:01:15.824680+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:01:15.824680+0000","last_undegraded":"2024-09-20T21:01:15.824680+0000","last_fullsized":"2024-09-20T21:01:15.824680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986367+0000","last_change":"2024-09-20T21:01:02.293432+0000","last_active":"2024-09-20T21:01:14.986367+0000","last_peered":"2024-09-20T21:01:14.986367+0000","last_clean":"2024-09-20T21:01:14.986367+0000","last_became_active":"2024-09-20T21:01:02.291361+0000","last_became_peered":"2024-09-20T21:01:02.291361+0000","last_unstale":"2024-09-20T21:01:14.986367+0000","last_undegraded":"2024-09-20T21:01:14.986367+0000","last_fullsized":"2024-09-20T21:01:14.986367+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:52.935898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986794+0000","last_change":"2024-09-20T21:01:09.031119+0000","last_active":"2024-09-20T21:01:14.986794+0000","last_peered":"2024-09-20T21:01:14.986794+0000","last_clean":"2024-09-20T21:01:14.986794+0000","last_became_active":"2024-09-20T21:01:06.994429+0000","last_became_peered":"2024-09-20T21:01:06.994429+0000","last_unstale":"2024-09-20T21:01:14.986794+0000","last_undegraded":"2024-09-20T21:01:14.986794+0000","last_fullsized":"2024-09-20T21:01:14.986794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:47.585068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025064900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823578+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:01:15.823578+0000","last_peered":"2024-09-20T21:01:15.823578+0000","last_clean":"2024-09-20T21:01:15.823578+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:01:15.823578+0000","last_undegraded":"2024-09-20T21:01:15.823578+0000","last_fullsized":"2024-09-20T21:01:15.823578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986350+0000","last_change":"2024-09-20T21:01:12.224024+0000","last_active":"2024-09-20T21:01:14.986350+0000","last_peered":"2024-09-20T21:01:14.986350+0000","last_clean":"2024-09-20T21:01:14.986350+0000","last_became_active":"2024-09-20T21:01:12.222433+0000","last_became_peered":"2024-09-20T21:01:12.222433+0000","last_unstale":"2024-09-20T21:01:14.986350+0000","last_undegraded":"2024-09-20T21:01:14.986350+0000","last_fullsized":"2024-09-20T21:01:14.986350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:23.486608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.987258+0000","last_change":"2024-09-20T21:01:09.029382+0000","last_active":"2024-09-20T21:01:14.987258+0000","last_peered":"2024-09-20T21:01:14.987258+0000","last_clean":"2024-09-20T21:01:14.987258+0000","last_became_active":"2024-09-20T21:01:06.997340+0000","last_became_peered":"2024-09-20T21:01:06.997340+0000","last_unstale":"2024-09-20T21:01:14.987258+0000","last_undegraded":"2024-09-20T21:01:14.987258+0000","last_fullsized":"2024-09-20T21:01:14.987258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:25:22.179131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081948399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823666+0000","last_change":"2024-09-20T21:01:11.220462+0000","last_active":"2024-09-20T21:01:15.823666+0000","last_peered":"2024-09-20T21:01:15.823666+0000","last_clean":"2024-09-20T21:01:15.823666+0000","last_became_active":"2024-09-20T21:01:11.219778+0000","last_became_peered":"2024-09-20T21:01:11.219778+0000","last_unstale":"2024-09-20T21:01:15.823666+0000","last_undegraded":"2024-09-20T21:01:15.823666+0000","last_fullsized":"2024-09-20T21:01:15.823666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:08.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305546+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:01:15.305546+0000","last_peered":"2024-09-20T21:01:15.305546+0000","last_clean":"2024-09-20T21:01:15.305546+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:01:15.305546+0000","last_undegraded":"2024-09-20T21:01:15.305546+0000","last_fullsized":"2024-09-20T21:01:15.305546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824232+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:01:15.824232+0000","last_peered":"2024-09-20T21:01:15.824232+0000","last_clean":"2024-09-20T21:01:15.824232+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:01:15.824232+0000","last_undegraded":"2024-09-20T21:01:15.824232+0000","last_fullsized":"2024-09-20T21:01:15.824232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304870+0000","last_change":"2024-09-20T21:01:11.217295+0000","last_active":"2024-09-20T21:01:15.304870+0000","last_peered":"2024-09-20T21:01:15.304870+0000","last_clean":"2024-09-20T21:01:15.304870+0000","last_became_active":"2024-09-20T21:01:11.216350+0000","last_became_peered":"2024-09-20T21:01:11.216350+0000","last_unstale":"2024-09-20T21:01:15.304870+0000","last_undegraded":"2024-09-20T21:01:15.304870+0000","last_fullsized":"2024-09-20T21:01:15.304870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:59.661622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824867+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:01:15.824867+0000","last_peered":"2024-09-20T21:01:15.824867+0000","last_clean":"2024-09-20T21:01:15.824867+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:01:15.824867+0000","last_undegraded":"2024-09-20T21:01:15.824867+0000","last_fullsized":"2024-09-20T21:01:15.824867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986806+0000","last_change":"2024-09-20T21:01:09.030841+0000","last_active":"2024-09-20T21:01:14.986806+0000","last_peered":"2024-09-20T21:01:14.986806+0000","last_clean":"2024-09-20T21:01:14.986806+0000","last_became_active":"2024-09-20T21:01:06.994033+0000","last_became_peered":"2024-09-20T21:01:06.994033+0000","last_unstale":"2024-09-20T21:01:14.986806+0000","last_undegraded":"2024-09-20T21:01:14.986806+0000","last_fullsized":"2024-09-20T21:01:14.986806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:57.919077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022137329999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986580+0000","last_change":"2024-09-20T21:01:11.217114+0000","last_active":"2024-09-20T21:01:14.986580+0000","last_peered":"2024-09-20T21:01:14.986580+0000","last_clean":"2024-09-20T21:01:14.986580+0000","last_became_active":"2024-09-20T21:01:11.215974+0000","last_became_peered":"2024-09-20T21:01:11.215974+0000","last_unstale":"2024-09-20T21:01:14.986580+0000","last_undegraded":"2024-09-20T21:01:14.986580+0000","last_fullsized":"2024-09-20T21:01:14.986580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824363+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:01:15.824363+0000","last_peered":"2024-09-20T21:01:15.824363+0000","last_clean":"2024-09-20T21:01:15.824363+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:01:15.824363+0000","last_undegraded":"2024-09-20T21:01:15.824363+0000","last_fullsized":"2024-09-20T21:01:15.824363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986856+0000","last_change":"2024-09-20T21:01:11.217713+0000","last_active":"2024-09-20T21:01:14.986856+0000","last_peered":"2024-09-20T21:01:14.986856+0000","last_clean":"2024-09-20T21:01:14.986856+0000","last_became_active":"2024-09-20T21:01:11.215699+0000","last_became_peered":"2024-09-20T21:01:11.215699+0000","last_unstale":"2024-09-20T21:01:14.986856+0000","last_undegraded":"2024-09-20T21:01:14.986856+0000","last_fullsized":"2024-09-20T21:01:14.986856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:06.986446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824922+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:01:15.824922+0000","last_peered":"2024-09-20T21:01:15.824922+0000","last_clean":"2024-09-20T21:01:15.824922+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:01:15.824922+0000","last_undegraded":"2024-09-20T21:01:15.824922+0000","last_fullsized":"2024-09-20T21:01:15.824922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304465+0000","last_change":"2024-09-20T21:01:12.227746+0000","last_active":"2024-09-20T21:01:15.304465+0000","last_peered":"2024-09-20T21:01:15.304465+0000","last_clean":"2024-09-20T21:01:15.304465+0000","last_became_active":"2024-09-20T21:01:12.226860+0000","last_became_peered":"2024-09-20T21:01:12.226860+0000","last_unstale":"2024-09-20T21:01:15.304465+0000","last_undegraded":"2024-09-20T21:01:15.304465+0000","last_fullsized":"2024-09-20T21:01:15.304465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:02.144980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824585+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:01:15.824585+0000","last_peered":"2024-09-20T21:01:15.824585+0000","last_clean":"2024-09-20T21:01:15.824585+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:01:15.824585+0000","last_undegraded":"2024-09-20T21:01:15.824585+0000","last_fullsized":"2024-09-20T21:01:15.824585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306339+0000","last_change":"2024-09-20T21:01:09.385616+0000","last_active":"2024-09-20T21:01:15.306339+0000","last_peered":"2024-09-20T21:01:15.306339+0000","last_clean":"2024-09-20T21:01:15.306339+0000","last_became_active":"2024-09-20T21:01:07.000811+0000","last_became_peered":"2024-09-20T21:01:07.000811+0000","last_unstale":"2024-09-20T21:01:15.306339+0000","last_undegraded":"2024-09-20T21:01:15.306339+0000","last_fullsized":"2024-09-20T21:01:15.306339+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:03.917240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077098100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304881+0000","last_change":"2024-09-20T21:01:12.227533+0000","last_active":"2024-09-20T21:01:15.304881+0000","last_peered":"2024-09-20T21:01:15.304881+0000","last_clean":"2024-09-20T21:01:15.304881+0000","last_became_active":"2024-09-20T21:01:12.226676+0000","last_became_peered":"2024-09-20T21:01:12.226676+0000","last_unstale":"2024-09-20T21:01:15.304881+0000","last_undegraded":"2024-09-20T21:01:15.304881+0000","last_fullsized":"2024-09-20T21:01:15.304881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825579+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:01:15.825579+0000","last_peered":"2024-09-20T21:01:15.825579+0000","last_clean":"2024-09-20T21:01:15.825579+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:01:15.825579+0000","last_undegraded":"2024-09-20T21:01:15.825579+0000","last_fullsized":"2024-09-20T21:01:15.825579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825452+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:01:15.825452+0000","last_peered":"2024-09-20T21:01:15.825452+0000","last_clean":"2024-09-20T21:01:15.825452+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:01:15.825452+0000","last_undegraded":"2024-09-20T21:01:15.825452+0000","last_fullsized":"2024-09-20T21:01:15.825452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823700+0000","last_change":"2024-09-20T21:01:12.227354+0000","last_active":"2024-09-20T21:01:15.823700+0000","last_peered":"2024-09-20T21:01:15.823700+0000","last_clean":"2024-09-20T21:01:15.823700+0000","last_became_active":"2024-09-20T21:01:12.226078+0000","last_became_peered":"2024-09-20T21:01:12.226078+0000","last_unstale":"2024-09-20T21:01:15.823700+0000","last_undegraded":"2024-09-20T21:01:15.823700+0000","last_fullsized":"2024-09-20T21:01:15.823700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825269+0000","last_change":"2024-09-20T21:01:11.220479+0000","last_active":"2024-09-20T21:01:15.825269+0000","last_peered":"2024-09-20T21:01:15.825269+0000","last_clean":"2024-09-20T21:01:15.825269+0000","last_became_active":"2024-09-20T21:01:11.219658+0000","last_became_peered":"2024-09-20T21:01:11.219658+0000","last_unstale":"2024-09-20T21:01:15.825269+0000","last_undegraded":"2024-09-20T21:01:15.825269+0000","last_fullsized":"2024-09-20T21:01:15.825269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986873+0000","last_change":"2024-09-20T21:01:09.029413+0000","last_active":"2024-09-20T21:01:14.986873+0000","last_peered":"2024-09-20T21:01:14.986873+0000","last_clean":"2024-09-20T21:01:14.986873+0000","last_became_active":"2024-09-20T21:01:06.997186+0000","last_became_peered":"2024-09-20T21:01:06.997186+0000","last_unstale":"2024-09-20T21:01:14.986873+0000","last_undegraded":"2024-09-20T21:01:14.986873+0000","last_fullsized":"2024-09-20T21:01:14.986873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:09:55.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.303941+0000","last_change":"2024-09-20T21:01:12.228307+0000","last_active":"2024-09-20T21:01:15.303941+0000","last_peered":"2024-09-20T21:01:15.303941+0000","last_clean":"2024-09-20T21:01:15.303941+0000","last_became_active":"2024-09-20T21:01:12.226322+0000","last_became_peered":"2024-09-20T21:01:12.226322+0000","last_unstale":"2024-09-20T21:01:15.303941+0000","last_undegraded":"2024-09-20T21:01:15.303941+0000","last_fullsized":"2024-09-20T21:01:15.303941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:52.194070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985673+0000","last_change":"2024-09-20T21:01:12.220324+0000","last_active":"2024-09-20T21:01:14.985673+0000","last_peered":"2024-09-20T21:01:14.985673+0000","last_clean":"2024-09-20T21:01:14.985673+0000","last_became_active":"2024-09-20T21:01:12.219327+0000","last_became_peered":"2024-09-20T21:01:12.219327+0000","last_unstale":"2024-09-20T21:01:14.985673+0000","last_undegraded":"2024-09-20T21:01:14.985673+0000","last_fullsized":"2024-09-20T21:01:14.985673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:56.030003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986595+0000","last_change":"2024-09-20T21:01:11.221231+0000","last_active":"2024-09-20T21:01:14.986595+0000","last_peered":"2024-09-20T21:01:14.986595+0000","last_clean":"2024-09-20T21:01:14.986595+0000","last_became_active":"2024-09-20T21:01:11.220426+0000","last_became_peered":"2024-09-20T21:01:11.220426+0000","last_unstale":"2024-09-20T21:01:14.986595+0000","last_undegraded":"2024-09-20T21:01:14.986595+0000","last_fullsized":"2024-09-20T21:01:14.986595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822977+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:01:15.822977+0000","last_peered":"2024-09-20T21:01:15.822977+0000","last_clean":"2024-09-20T21:01:15.822977+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:01:15.822977+0000","last_undegraded":"2024-09-20T21:01:15.822977+0000","last_fullsized":"2024-09-20T21:01:15.822977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305982+0000","last_change":"2024-09-20T21:01:11.220027+0000","last_active":"2024-09-20T21:01:15.305982+0000","last_peered":"2024-09-20T21:01:15.305982+0000","last_clean":"2024-09-20T21:01:15.305982+0000","last_became_active":"2024-09-20T21:01:11.218551+0000","last_became_peered":"2024-09-20T21:01:11.218551+0000","last_unstale":"2024-09-20T21:01:15.305982+0000","last_undegraded":"2024-09-20T21:01:15.305982+0000","last_fullsized":"2024-09-20T21:01:15.305982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:47:59.918561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986048+0000","last_change":"2024-09-20T21:01:11.218922+0000","last_active":"2024-09-20T21:01:14.986048+0000","last_peered":"2024-09-20T21:01:14.986048+0000","last_clean":"2024-09-20T21:01:14.986048+0000","last_became_active":"2024-09-20T21:01:11.218028+0000","last_became_peered":"2024-09-20T21:01:11.218028+0000","last_unstale":"2024-09-20T21:01:14.986048+0000","last_undegraded":"2024-09-20T21:01:14.986048+0000","last_fullsized":"2024-09-20T21:01:14.986048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822895+0000","last_change":"2024-09-20T21:01:12.211553+0000","last_active":"2024-09-20T21:01:15.822895+0000","last_peered":"2024-09-20T21:01:15.822895+0000","last_clean":"2024-09-20T21:01:15.822895+0000","last_became_active":"2024-09-20T21:01:12.210101+0000","last_became_peered":"2024-09-20T21:01:12.210101+0000","last_unstale":"2024-09-20T21:01:15.822895+0000","last_undegraded":"2024-09-20T21:01:15.822895+0000","last_fullsized":"2024-09-20T21:01:15.822895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825324+0000","last_change":"2024-09-20T21:01:11.221867+0000","last_active":"2024-09-20T21:01:15.825324+0000","last_peered":"2024-09-20T21:01:15.825324+0000","last_clean":"2024-09-20T21:01:15.825324+0000","last_became_active":"2024-09-20T21:01:11.220980+0000","last_became_peered":"2024-09-20T21:01:11.220980+0000","last_unstale":"2024-09-20T21:01:15.825324+0000","last_undegraded":"2024-09-20T21:01:15.825324+0000","last_fullsized":"2024-09-20T21:01:15.825324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823018+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:01:15.823018+0000","last_peered":"2024-09-20T21:01:15.823018+0000","last_clean":"2024-09-20T21:01:15.823018+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:01:15.823018+0000","last_undegraded":"2024-09-20T21:01:15.823018+0000","last_fullsized":"2024-09-20T21:01:15.823018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306640+0000","last_change":"2024-09-20T21:01:12.236819+0000","last_active":"2024-09-20T21:01:15.306640+0000","last_peered":"2024-09-20T21:01:15.306640+0000","last_clean":"2024-09-20T21:01:15.306640+0000","last_became_active":"2024-09-20T21:01:12.233922+0000","last_became_peered":"2024-09-20T21:01:12.233922+0000","last_unstale":"2024-09-20T21:01:15.306640+0000","last_undegraded":"2024-09-20T21:01:15.306640+0000","last_fullsized":"2024-09-20T21:01:15.306640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823315+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:01:15.823315+0000","last_peered":"2024-09-20T21:01:15.823315+0000","last_clean":"2024-09-20T21:01:15.823315+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:01:15.823315+0000","last_undegraded":"2024-09-20T21:01:15.823315+0000","last_fullsized":"2024-09-20T21:01:15.823315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824535+0000","last_change":"2024-09-20T21:01:12.227395+0000","last_active":"2024-09-20T21:01:15.824535+0000","last_peered":"2024-09-20T21:01:15.824535+0000","last_clean":"2024-09-20T21:01:15.824535+0000","last_became_active":"2024-09-20T21:01:12.226122+0000","last_became_peered":"2024-09-20T21:01:12.226122+0000","last_unstale":"2024-09-20T21:01:15.824535+0000","last_undegraded":"2024-09-20T21:01:15.824535+0000","last_fullsized":"2024-09-20T21:01:15.824535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823918+0000","last_change":"2024-09-20T21:01:11.220367+0000","last_active":"2024-09-20T21:01:15.823918+0000","last_peered":"2024-09-20T21:01:15.823918+0000","last_clean":"2024-09-20T21:01:15.823918+0000","last_became_active":"2024-09-20T21:01:11.219090+0000","last_became_peered":"2024-09-20T21:01:11.219090+0000","last_unstale":"2024-09-20T21:01:15.823918+0000","last_undegraded":"2024-09-20T21:01:15.823918+0000","last_fullsized":"2024-09-20T21:01:15.823918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305423+0000","last_change":"2024-09-20T21:01:12.238895+0000","last_active":"2024-09-20T21:01:15.305423+0000","last_peered":"2024-09-20T21:01:15.305423+0000","last_clean":"2024-09-20T21:01:15.305423+0000","last_became_active":"2024-09-20T21:01:12.235481+0000","last_became_peered":"2024-09-20T21:01:12.235481+0000","last_unstale":"2024-09-20T21:01:15.305423+0000","last_undegraded":"2024-09-20T21:01:15.305423+0000","last_fullsized":"2024-09-20T21:01:15.305423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304734+0000","last_change":"2024-09-20T21:01:11.217493+0000","last_active":"2024-09-20T21:01:15.304734+0000","last_peered":"2024-09-20T21:01:15.304734+0000","last_clean":"2024-09-20T21:01:15.304734+0000","last_became_active":"2024-09-20T21:01:11.216073+0000","last_became_peered":"2024-09-20T21:01:11.216073+0000","last_unstale":"2024-09-20T21:01:15.304734+0000","last_undegraded":"2024-09-20T21:01:15.304734+0000","last_fullsized":"2024-09-20T21:01:15.304734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:23:30.512126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305358+0000","last_change":"2024-09-20T21:01:12.232371+0000","last_active":"2024-09-20T21:01:15.305358+0000","last_peered":"2024-09-20T21:01:15.305358+0000","last_clean":"2024-09-20T21:01:15.305358+0000","last_became_active":"2024-09-20T21:01:12.231450+0000","last_became_peered":"2024-09-20T21:01:12.231450+0000","last_unstale":"2024-09-20T21:01:15.305358+0000","last_undegraded":"2024-09-20T21:01:15.305358+0000","last_fullsized":"2024-09-20T21:01:15.305358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305184+0000","last_change":"2024-09-20T21:01:11.218440+0000","last_active":"2024-09-20T21:01:15.305184+0000","last_peered":"2024-09-20T21:01:15.305184+0000","last_clean":"2024-09-20T21:01:15.305184+0000","last_became_active":"2024-09-20T21:01:11.217722+0000","last_became_peered":"2024-09-20T21:01:11.217722+0000","last_unstale":"2024-09-20T21:01:15.305184+0000","last_undegraded":"2024-09-20T21:01:15.305184+0000","last_fullsized":"2024-09-20T21:01:15.305184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:11:02.101254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985035+0000","last_change":"2024-09-20T21:01:12.212994+0000","last_active":"2024-09-20T21:01:14.985035+0000","last_peered":"2024-09-20T21:01:14.985035+0000","last_clean":"2024-09-20T21:01:14.985035+0000","last_became_active":"2024-09-20T21:01:12.211080+0000","last_became_peered":"2024-09-20T21:01:12.211080+0000","last_unstale":"2024-09-20T21:01:14.985035+0000","last_undegraded":"2024-09-20T21:01:14.985035+0000","last_fullsized":"2024-09-20T21:01:14.985035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986320+0000","last_change":"2024-09-20T21:01:11.217211+0000","last_active":"2024-09-20T21:01:14.986320+0000","last_peered":"2024-09-20T21:01:14.986320+0000","last_clean":"2024-09-20T21:01:14.986320+0000","last_became_active":"2024-09-20T21:01:11.216428+0000","last_became_peered":"2024-09-20T21:01:11.216428+0000","last_unstale":"2024-09-20T21:01:14.986320+0000","last_undegraded":"2024-09-20T21:01:14.986320+0000","last_fullsized":"2024-09-20T21:01:14.986320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986366+0000","last_change":"2024-09-20T21:01:12.214965+0000","last_active":"2024-09-20T21:01:14.986366+0000","last_peered":"2024-09-20T21:01:14.986366+0000","last_clean":"2024-09-20T21:01:14.986366+0000","last_became_active":"2024-09-20T21:01:12.211534+0000","last_became_peered":"2024-09-20T21:01:12.211534+0000","last_unstale":"2024-09-20T21:01:14.986366+0000","last_undegraded":"2024-09-20T21:01:14.986366+0000","last_fullsized":"2024-09-20T21:01:14.986366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305711+0000","last_change":"2024-09-20T21:01:11.220332+0000","last_active":"2024-09-20T21:01:15.305711+0000","last_peered":"2024-09-20T21:01:15.305711+0000","last_clean":"2024-09-20T21:01:15.305711+0000","last_became_active":"2024-09-20T21:01:11.219022+0000","last_became_peered":"2024-09-20T21:01:11.219022+0000","last_unstale":"2024-09-20T21:01:15.305711+0000","last_undegraded":"2024-09-20T21:01:15.305711+0000","last_fullsized":"2024-09-20T21:01:15.305711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.928114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304479+0000","last_change":"2024-09-20T21:01:12.238819+0000","last_active":"2024-09-20T21:01:15.304479+0000","last_peered":"2024-09-20T21:01:15.304479+0000","last_clean":"2024-09-20T21:01:15.304479+0000","last_became_active":"2024-09-20T21:01:12.237939+0000","last_became_peered":"2024-09-20T21:01:12.237939+0000","last_unstale":"2024-09-20T21:01:15.304479+0000","last_undegraded":"2024-09-20T21:01:15.304479+0000","last_fullsized":"2024-09-20T21:01:15.304479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825078+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:01:15.825078+0000","last_peered":"2024-09-20T21:01:15.825078+0000","last_clean":"2024-09-20T21:01:15.825078+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:01:15.825078+0000","last_undegraded":"2024-09-20T21:01:15.825078+0000","last_fullsized":"2024-09-20T21:01:15.825078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986017+0000","last_change":"2024-09-20T21:01:12.213562+0000","last_active":"2024-09-20T21:01:14.986017+0000","last_peered":"2024-09-20T21:01:14.986017+0000","last_clean":"2024-09-20T21:01:14.986017+0000","last_became_active":"2024-09-20T21:01:12.210781+0000","last_became_peered":"2024-09-20T21:01:12.210781+0000","last_unstale":"2024-09-20T21:01:14.986017+0000","last_undegraded":"2024-09-20T21:01:14.986017+0000","last_fullsized":"2024-09-20T21:01:14.986017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825003+0000","last_change":"2024-09-20T21:01:11.222738+0000","last_active":"2024-09-20T21:01:15.825003+0000","last_peered":"2024-09-20T21:01:15.825003+0000","last_clean":"2024-09-20T21:01:15.825003+0000","last_became_active":"2024-09-20T21:01:11.221990+0000","last_became_peered":"2024-09-20T21:01:11.221990+0000","last_unstale":"2024-09-20T21:01:15.825003+0000","last_undegraded":"2024-09-20T21:01:15.825003+0000","last_fullsized":"2024-09-20T21:01:15.825003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":258048,"data_stored":655436,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":270336,"data_stored":656071,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:01:19.125 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-20T21:01:19.125 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-20T21:01:19.125 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-20T21:01:19.125 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-20T21:01:19.471 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:19.472 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-20T21:01:19.488 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-20T21:01:19.489 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T21:01:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:19.813 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"btime":"2024-09-20T21:01:14:206337+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T21:01:11.549887+0000","modified":"2024-09-20T21:01:13.564207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.112:6803/1727517517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1727517517},{"type":"v1","addr":"172.21.15.112:6803","nonce":1727517517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-20T21:01:19.813 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 5 2024-09-20T21:01:19.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T21:01:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"btime":"2024-09-20T21:01:14:206337+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T21:01:11.549887+0000","modified":"2024-09-20T21:01:13.564207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.112:6803/1727517517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1727517517},{"type":"v1","addr":"172.21.15.112:6803","nonce":1727517517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-20T21:01:20.142 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 5 2024-09-20T21:01:20.159 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:01:20.429 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:20.429 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:01:14.979294+0000","last_up_change":"2024-09-20T21:00:59.725541+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T21:01:05.455429+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T21:01:10.047761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T21:01:10.524533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6801","nonce":2769075992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6803","nonce":2769075992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6807","nonce":2769075992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2769075992},{"type":"v1","addr":"172.21.15.161:6805","nonce":2769075992}]},"public_addr":"172.21.15.161:6801/2769075992","cluster_addr":"172.21.15.161:6803/2769075992","heartbeat_back_addr":"172.21.15.161:6807/2769075992","heartbeat_front_addr":"172.21.15.161:6805/2769075992","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:01:20.446 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T21:01:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:20.747 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"btime":"2024-09-20T21:01:14:206337+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T21:01:11.549887+0000","modified":"2024-09-20T21:01:13.564207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.112:6803/1727517517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1727517517},{"type":"v1","addr":"172.21.15.112:6803","nonce":1727517517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-20T21:01:20.748 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 5 2024-09-20T21:01:20.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-20T21:01:11.549887+0000', 'modified': '2024-09-20T21:01:13.564207+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.112:6803/1727517517', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 1727517517}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 1727517517}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4204, 'qdb_cluster': [4204]} 2024-09-20T21:01:20.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-20T21:01:20.865 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-20T21:01:20.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-20T21:01:20.994+0000 7f1dfe7fc640 0 client.4379 ms_handle_reset on v2:172.21.15.112:6802/1727517517 2024-09-20T21:01:21.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-20T21:01:21.018+0000 7f1dfe7fc640 0 client.4494 ms_handle_reset on v2:172.21.15.112:6802/1727517517 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "095c2509-1828-40cb-9515-44c079c52d3b", 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4204, 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 8.8291655809999998, 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 5, 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 20, 2024-09-20T21:01:21.018 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 19, 2024-09-20T21:01:21.019 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 11.886196444999999 2024-09-20T21:01:21.019 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-20T21:01:21.032 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-20T21:01:21.041 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-20T21:01:21.042 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ed8ee0f26ef720e6504cefa8be1a2d0872192de7'}} 2024-09-20T21:01:21.042 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-20T21:01:21.042 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-20T21:01:21.042 DEBUG:teuthology.orchestra.run.smithi112:> sync 2024-09-20T21:01:21.373 DEBUG:teuthology.orchestra.run.smithi139:> sync 2024-09-20T21:01:21.533 DEBUG:teuthology.orchestra.run.smithi161:> sync 2024-09-20T21:01:21.681 DEBUG:teuthology.orchestra.run.smithi203:> sync 2024-09-20T21:01:21.801 DEBUG:tasks.thrashosds:checking console status of smithi112 2024-09-20T21:01:21.802 DEBUG:teuthology.orchestra.console.smithi112:Waiting for login prompt 2024-09-20T21:01:21.802 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi112 2024-09-20T21:01:21.910 DEBUG:teuthology.orchestra.console.smithi112:expect before: [Enter `^Ec?' for help] 2024-09-20T21:01:21.910 DEBUG:teuthology.orchestra.console.smithi112:expect after: smithi112 login: 2024-09-20T21:01:21.964 DEBUG:teuthology.orchestra.console.smithi112:console disconnect output: [Enter `^Ec?' for help] smithi112 login: [disconnect] 2024-09-20T21:01:22.064 DEBUG:tasks.thrashosds:checking console status of smithi139 2024-09-20T21:01:22.065 DEBUG:teuthology.orchestra.console.smithi139:Waiting for login prompt 2024-09-20T21:01:22.065 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi139 2024-09-20T21:01:22.141 DEBUG:teuthology.orchestra.console.smithi139:expect before: [Enter `^Ec?' for help] 2024-09-20T21:01:22.141 DEBUG:teuthology.orchestra.console.smithi139:expect after: smithi139 login: 2024-09-20T21:01:22.193 DEBUG:teuthology.orchestra.console.smithi139:console disconnect output: [Enter `^Ec?' for help] smithi139 login: [disconnect] 2024-09-20T21:01:22.295 DEBUG:tasks.thrashosds:checking console status of smithi161 2024-09-20T21:01:22.295 DEBUG:teuthology.orchestra.console.smithi161:Waiting for login prompt 2024-09-20T21:01:22.295 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi161 2024-09-20T21:01:22.445 DEBUG:teuthology.orchestra.console.smithi161:expect before: [Enter `^Ec?' for help] 2024-09-20T21:01:22.445 DEBUG:teuthology.orchestra.console.smithi161:expect after: smithi161 login: 2024-09-20T21:01:22.497 DEBUG:teuthology.orchestra.console.smithi161:console disconnect output: [Enter `^Ec?' for help] smithi161 login: [disconnect] 2024-09-20T21:01:22.598 DEBUG:tasks.thrashosds:checking console status of smithi203 2024-09-20T21:01:22.598 DEBUG:teuthology.orchestra.console.smithi203:Waiting for login prompt 2024-09-20T21:01:22.598 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi203 2024-09-20T21:01:22.692 DEBUG:teuthology.orchestra.console.smithi203:expect before: [Enter `^Ec?' for help] 2024-09-20T21:01:22.692 DEBUG:teuthology.orchestra.console.smithi203:expect after: smithi203 login: 2024-09-20T21:01:22.743 DEBUG:teuthology.orchestra.console.smithi203:console disconnect output: [Enter `^Ec?' for help] smithi203 login: [disconnect] 2024-09-20T21:01:22.845 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-20T21:01:23.164 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-20T21:01:23.164 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-20T21:01:23.164 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:01:23.449 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:23.452 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:01:23.465 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-20T21:01:22.860551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90108,"kb_used_data":696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025412,"statfs":{"total":289910292480,"available":289818021888,"internally_reserved":0,"allocated":712704,"data_stored":1375416,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4788,"internal_metadata":91483468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.652940"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306410+0000","last_change":"2024-09-20T21:01:12.240709+0000","last_active":"2024-09-20T21:01:15.306410+0000","last_peered":"2024-09-20T21:01:15.306410+0000","last_clean":"2024-09-20T21:01:15.306410+0000","last_became_active":"2024-09-20T21:01:12.239599+0000","last_became_peered":"2024-09-20T21:01:12.239599+0000","last_unstale":"2024-09-20T21:01:15.306410+0000","last_undegraded":"2024-09-20T21:01:15.306410+0000","last_fullsized":"2024-09-20T21:01:15.306410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304904+0000","last_change":"2024-09-20T21:01:12.236761+0000","last_active":"2024-09-20T21:01:15.304904+0000","last_peered":"2024-09-20T21:01:15.304904+0000","last_clean":"2024-09-20T21:01:15.304904+0000","last_became_active":"2024-09-20T21:01:12.235613+0000","last_became_peered":"2024-09-20T21:01:12.235613+0000","last_unstale":"2024-09-20T21:01:15.304904+0000","last_undegraded":"2024-09-20T21:01:15.304904+0000","last_fullsized":"2024-09-20T21:01:15.304904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985464+0000","last_change":"2024-09-20T21:01:12.228562+0000","last_active":"2024-09-20T21:01:14.985464+0000","last_peered":"2024-09-20T21:01:14.985464+0000","last_clean":"2024-09-20T21:01:14.985464+0000","last_became_active":"2024-09-20T21:01:12.224894+0000","last_became_peered":"2024-09-20T21:01:12.224894+0000","last_unstale":"2024-09-20T21:01:14.985464+0000","last_undegraded":"2024-09-20T21:01:14.985464+0000","last_fullsized":"2024-09-20T21:01:14.985464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.657192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985376+0000","last_change":"2024-09-20T21:01:12.227789+0000","last_active":"2024-09-20T21:01:14.985376+0000","last_peered":"2024-09-20T21:01:14.985376+0000","last_clean":"2024-09-20T21:01:14.985376+0000","last_became_active":"2024-09-20T21:01:12.225718+0000","last_became_peered":"2024-09-20T21:01:12.225718+0000","last_unstale":"2024-09-20T21:01:14.985376+0000","last_undegraded":"2024-09-20T21:01:14.985376+0000","last_fullsized":"2024-09-20T21:01:14.985376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:15.226852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305052+0000","last_change":"2024-09-20T21:01:12.232080+0000","last_active":"2024-09-20T21:01:15.305052+0000","last_peered":"2024-09-20T21:01:15.305052+0000","last_clean":"2024-09-20T21:01:15.305052+0000","last_became_active":"2024-09-20T21:01:12.231429+0000","last_became_peered":"2024-09-20T21:01:12.231429+0000","last_unstale":"2024-09-20T21:01:15.305052+0000","last_undegraded":"2024-09-20T21:01:15.305052+0000","last_fullsized":"2024-09-20T21:01:15.305052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984770+0000","last_change":"2024-09-20T21:01:12.231871+0000","last_active":"2024-09-20T21:01:14.984770+0000","last_peered":"2024-09-20T21:01:14.984770+0000","last_clean":"2024-09-20T21:01:14.984770+0000","last_became_active":"2024-09-20T21:01:12.229463+0000","last_became_peered":"2024-09-20T21:01:12.229463+0000","last_unstale":"2024-09-20T21:01:14.984770+0000","last_undegraded":"2024-09-20T21:01:14.984770+0000","last_fullsized":"2024-09-20T21:01:14.984770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984571+0000","last_change":"2024-09-20T21:01:12.226969+0000","last_active":"2024-09-20T21:01:14.984571+0000","last_peered":"2024-09-20T21:01:14.984571+0000","last_clean":"2024-09-20T21:01:14.984571+0000","last_became_active":"2024-09-20T21:01:12.225800+0000","last_became_peered":"2024-09-20T21:01:12.225800+0000","last_unstale":"2024-09-20T21:01:14.984571+0000","last_undegraded":"2024-09-20T21:01:14.984571+0000","last_fullsized":"2024-09-20T21:01:14.984571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984474+0000","last_change":"2024-09-20T21:01:12.217357+0000","last_active":"2024-09-20T21:01:14.984474+0000","last_peered":"2024-09-20T21:01:14.984474+0000","last_clean":"2024-09-20T21:01:14.984474+0000","last_became_active":"2024-09-20T21:01:12.213483+0000","last_became_peered":"2024-09-20T21:01:12.213483+0000","last_unstale":"2024-09-20T21:01:14.984474+0000","last_undegraded":"2024-09-20T21:01:14.984474+0000","last_fullsized":"2024-09-20T21:01:14.984474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824366+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:01:15.824366+0000","last_peered":"2024-09-20T21:01:15.824366+0000","last_clean":"2024-09-20T21:01:15.824366+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:01:15.824366+0000","last_undegraded":"2024-09-20T21:01:15.824366+0000","last_fullsized":"2024-09-20T21:01:15.824366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305301+0000","last_change":"2024-09-20T21:01:12.240432+0000","last_active":"2024-09-20T21:01:15.305301+0000","last_peered":"2024-09-20T21:01:15.305301+0000","last_clean":"2024-09-20T21:01:15.305301+0000","last_became_active":"2024-09-20T21:01:12.238826+0000","last_became_peered":"2024-09-20T21:01:12.238826+0000","last_unstale":"2024-09-20T21:01:15.305301+0000","last_undegraded":"2024-09-20T21:01:15.305301+0000","last_fullsized":"2024-09-20T21:01:15.305301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985723+0000","last_change":"2024-09-20T21:01:12.213062+0000","last_active":"2024-09-20T21:01:14.985723+0000","last_peered":"2024-09-20T21:01:14.985723+0000","last_clean":"2024-09-20T21:01:14.985723+0000","last_became_active":"2024-09-20T21:01:12.211953+0000","last_became_peered":"2024-09-20T21:01:12.211953+0000","last_unstale":"2024-09-20T21:01:14.985723+0000","last_undegraded":"2024-09-20T21:01:14.985723+0000","last_fullsized":"2024-09-20T21:01:14.985723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.052874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304989+0000","last_change":"2024-09-20T21:01:12.229580+0000","last_active":"2024-09-20T21:01:15.304989+0000","last_peered":"2024-09-20T21:01:15.304989+0000","last_clean":"2024-09-20T21:01:15.304989+0000","last_became_active":"2024-09-20T21:01:12.226915+0000","last_became_peered":"2024-09-20T21:01:12.226915+0000","last_unstale":"2024-09-20T21:01:15.304989+0000","last_undegraded":"2024-09-20T21:01:15.304989+0000","last_fullsized":"2024-09-20T21:01:15.304989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.985765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304611+0000","last_change":"2024-09-20T21:01:12.230410+0000","last_active":"2024-09-20T21:01:15.304611+0000","last_peered":"2024-09-20T21:01:15.304611+0000","last_clean":"2024-09-20T21:01:15.304611+0000","last_became_active":"2024-09-20T21:01:12.229859+0000","last_became_peered":"2024-09-20T21:01:12.229859+0000","last_unstale":"2024-09-20T21:01:15.304611+0000","last_undegraded":"2024-09-20T21:01:15.304611+0000","last_fullsized":"2024-09-20T21:01:15.304611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985035+0000","last_change":"2024-09-20T21:01:12.220376+0000","last_active":"2024-09-20T21:01:14.985035+0000","last_peered":"2024-09-20T21:01:14.985035+0000","last_clean":"2024-09-20T21:01:14.985035+0000","last_became_active":"2024-09-20T21:01:12.219338+0000","last_became_peered":"2024-09-20T21:01:12.219338+0000","last_unstale":"2024-09-20T21:01:14.985035+0000","last_undegraded":"2024-09-20T21:01:14.985035+0000","last_fullsized":"2024-09-20T21:01:14.985035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984765+0000","last_change":"2024-09-20T21:01:12.218884+0000","last_active":"2024-09-20T21:01:14.984765+0000","last_peered":"2024-09-20T21:01:14.984765+0000","last_clean":"2024-09-20T21:01:14.984765+0000","last_became_active":"2024-09-20T21:01:12.218225+0000","last_became_peered":"2024-09-20T21:01:12.218225+0000","last_unstale":"2024-09-20T21:01:14.984765+0000","last_undegraded":"2024-09-20T21:01:14.984765+0000","last_fullsized":"2024-09-20T21:01:14.984765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984513+0000","last_change":"2024-09-20T21:01:12.214974+0000","last_active":"2024-09-20T21:01:14.984513+0000","last_peered":"2024-09-20T21:01:14.984513+0000","last_clean":"2024-09-20T21:01:14.984513+0000","last_became_active":"2024-09-20T21:01:12.212149+0000","last_became_peered":"2024-09-20T21:01:12.212149+0000","last_unstale":"2024-09-20T21:01:14.984513+0000","last_undegraded":"2024-09-20T21:01:14.984513+0000","last_fullsized":"2024-09-20T21:01:14.984513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825339+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:01:15.825339+0000","last_peered":"2024-09-20T21:01:15.825339+0000","last_clean":"2024-09-20T21:01:15.825339+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:01:15.825339+0000","last_undegraded":"2024-09-20T21:01:15.825339+0000","last_fullsized":"2024-09-20T21:01:15.825339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305951+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:01:15.305951+0000","last_peered":"2024-09-20T21:01:15.305951+0000","last_clean":"2024-09-20T21:01:15.305951+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:01:15.305951+0000","last_undegraded":"2024-09-20T21:01:15.305951+0000","last_fullsized":"2024-09-20T21:01:15.305951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823775+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:01:15.823775+0000","last_peered":"2024-09-20T21:01:15.823775+0000","last_clean":"2024-09-20T21:01:15.823775+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:01:15.823775+0000","last_undegraded":"2024-09-20T21:01:15.823775+0000","last_fullsized":"2024-09-20T21:01:15.823775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986032+0000","last_change":"2024-09-20T21:01:12.212785+0000","last_active":"2024-09-20T21:01:14.986032+0000","last_peered":"2024-09-20T21:01:14.986032+0000","last_clean":"2024-09-20T21:01:14.986032+0000","last_became_active":"2024-09-20T21:01:12.211844+0000","last_became_peered":"2024-09-20T21:01:12.211844+0000","last_unstale":"2024-09-20T21:01:14.986032+0000","last_undegraded":"2024-09-20T21:01:14.986032+0000","last_fullsized":"2024-09-20T21:01:14.986032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:38.821473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986326+0000","last_change":"2024-09-20T21:01:12.210710+0000","last_active":"2024-09-20T21:01:14.986326+0000","last_peered":"2024-09-20T21:01:14.986326+0000","last_clean":"2024-09-20T21:01:14.986326+0000","last_became_active":"2024-09-20T21:01:12.209676+0000","last_became_peered":"2024-09-20T21:01:12.209676+0000","last_unstale":"2024-09-20T21:01:14.986326+0000","last_undegraded":"2024-09-20T21:01:14.986326+0000","last_fullsized":"2024-09-20T21:01:14.986326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:48.442304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304234+0000","last_change":"2024-09-20T21:01:12.230375+0000","last_active":"2024-09-20T21:01:15.304234+0000","last_peered":"2024-09-20T21:01:15.304234+0000","last_clean":"2024-09-20T21:01:15.304234+0000","last_became_active":"2024-09-20T21:01:12.228679+0000","last_became_peered":"2024-09-20T21:01:12.228679+0000","last_unstale":"2024-09-20T21:01:15.304234+0000","last_undegraded":"2024-09-20T21:01:15.304234+0000","last_fullsized":"2024-09-20T21:01:15.304234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822604+0000","last_change":"2024-09-20T21:01:12.214484+0000","last_active":"2024-09-20T21:01:15.822604+0000","last_peered":"2024-09-20T21:01:15.822604+0000","last_clean":"2024-09-20T21:01:15.822604+0000","last_became_active":"2024-09-20T21:01:12.212293+0000","last_became_peered":"2024-09-20T21:01:12.212293+0000","last_unstale":"2024-09-20T21:01:15.822604+0000","last_undegraded":"2024-09-20T21:01:15.822604+0000","last_fullsized":"2024-09-20T21:01:15.822604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304078+0000","last_change":"2024-09-20T21:01:12.229114+0000","last_active":"2024-09-20T21:01:15.304078+0000","last_peered":"2024-09-20T21:01:15.304078+0000","last_clean":"2024-09-20T21:01:15.304078+0000","last_became_active":"2024-09-20T21:01:12.227812+0000","last_became_peered":"2024-09-20T21:01:12.227812+0000","last_unstale":"2024-09-20T21:01:15.304078+0000","last_undegraded":"2024-09-20T21:01:15.304078+0000","last_fullsized":"2024-09-20T21:01:15.304078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:02.638461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306541+0000","last_change":"2024-09-20T21:01:12.237926+0000","last_active":"2024-09-20T21:01:15.306541+0000","last_peered":"2024-09-20T21:01:15.306541+0000","last_clean":"2024-09-20T21:01:15.306541+0000","last_became_active":"2024-09-20T21:01:12.234061+0000","last_became_peered":"2024-09-20T21:01:12.234061+0000","last_unstale":"2024-09-20T21:01:15.306541+0000","last_undegraded":"2024-09-20T21:01:15.306541+0000","last_fullsized":"2024-09-20T21:01:15.306541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824786+0000","last_change":"2024-09-20T21:01:12.214728+0000","last_active":"2024-09-20T21:01:15.824786+0000","last_peered":"2024-09-20T21:01:15.824786+0000","last_clean":"2024-09-20T21:01:15.824786+0000","last_became_active":"2024-09-20T21:01:12.213159+0000","last_became_peered":"2024-09-20T21:01:12.213159+0000","last_unstale":"2024-09-20T21:01:15.824786+0000","last_undegraded":"2024-09-20T21:01:15.824786+0000","last_fullsized":"2024-09-20T21:01:15.824786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985824+0000","last_change":"2024-09-20T21:01:12.227975+0000","last_active":"2024-09-20T21:01:14.985824+0000","last_peered":"2024-09-20T21:01:14.985824+0000","last_clean":"2024-09-20T21:01:14.985824+0000","last_became_active":"2024-09-20T21:01:12.223433+0000","last_became_peered":"2024-09-20T21:01:12.223433+0000","last_unstale":"2024-09-20T21:01:14.985824+0000","last_undegraded":"2024-09-20T21:01:14.985824+0000","last_fullsized":"2024-09-20T21:01:14.985824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:32.017817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305701+0000","last_change":"2024-09-20T21:01:12.227425+0000","last_active":"2024-09-20T21:01:15.305701+0000","last_peered":"2024-09-20T21:01:15.305701+0000","last_clean":"2024-09-20T21:01:15.305701+0000","last_became_active":"2024-09-20T21:01:12.226625+0000","last_became_peered":"2024-09-20T21:01:12.226625+0000","last_unstale":"2024-09-20T21:01:15.305701+0000","last_undegraded":"2024-09-20T21:01:15.305701+0000","last_fullsized":"2024-09-20T21:01:15.305701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824366+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:01:15.824366+0000","last_peered":"2024-09-20T21:01:15.824366+0000","last_clean":"2024-09-20T21:01:15.824366+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:01:15.824366+0000","last_undegraded":"2024-09-20T21:01:15.824366+0000","last_fullsized":"2024-09-20T21:01:15.824366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304558+0000","last_change":"2024-09-20T21:01:12.230684+0000","last_active":"2024-09-20T21:01:15.304558+0000","last_peered":"2024-09-20T21:01:15.304558+0000","last_clean":"2024-09-20T21:01:15.304558+0000","last_became_active":"2024-09-20T21:01:12.229915+0000","last_became_peered":"2024-09-20T21:01:12.229915+0000","last_unstale":"2024-09-20T21:01:15.304558+0000","last_undegraded":"2024-09-20T21:01:15.304558+0000","last_fullsized":"2024-09-20T21:01:15.304558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822770+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:01:15.822770+0000","last_peered":"2024-09-20T21:01:15.822770+0000","last_clean":"2024-09-20T21:01:15.822770+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:01:15.822770+0000","last_undegraded":"2024-09-20T21:01:15.822770+0000","last_fullsized":"2024-09-20T21:01:15.822770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984770+0000","last_change":"2024-09-20T21:01:12.215773+0000","last_active":"2024-09-20T21:01:14.984770+0000","last_peered":"2024-09-20T21:01:14.984770+0000","last_clean":"2024-09-20T21:01:14.984770+0000","last_became_active":"2024-09-20T21:01:12.212199+0000","last_became_peered":"2024-09-20T21:01:12.212199+0000","last_unstale":"2024-09-20T21:01:14.984770+0000","last_undegraded":"2024-09-20T21:01:14.984770+0000","last_fullsized":"2024-09-20T21:01:14.984770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305678+0000","last_change":"2024-09-20T21:01:12.232814+0000","last_active":"2024-09-20T21:01:15.305678+0000","last_peered":"2024-09-20T21:01:15.305678+0000","last_clean":"2024-09-20T21:01:15.305678+0000","last_became_active":"2024-09-20T21:01:12.232026+0000","last_became_peered":"2024-09-20T21:01:12.232026+0000","last_unstale":"2024-09-20T21:01:15.305678+0000","last_undegraded":"2024-09-20T21:01:15.305678+0000","last_fullsized":"2024-09-20T21:01:15.305678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986403+0000","last_change":"2024-09-20T21:01:11.216956+0000","last_active":"2024-09-20T21:01:14.986403+0000","last_peered":"2024-09-20T21:01:14.986403+0000","last_clean":"2024-09-20T21:01:14.986403+0000","last_became_active":"2024-09-20T21:01:11.216462+0000","last_became_peered":"2024-09-20T21:01:11.216462+0000","last_unstale":"2024-09-20T21:01:14.986403+0000","last_undegraded":"2024-09-20T21:01:14.986403+0000","last_fullsized":"2024-09-20T21:01:14.986403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305641+0000","last_change":"2024-09-20T21:01:12.230727+0000","last_active":"2024-09-20T21:01:15.305641+0000","last_peered":"2024-09-20T21:01:15.305641+0000","last_clean":"2024-09-20T21:01:15.305641+0000","last_became_active":"2024-09-20T21:01:12.229987+0000","last_became_peered":"2024-09-20T21:01:12.229987+0000","last_unstale":"2024-09-20T21:01:15.305641+0000","last_undegraded":"2024-09-20T21:01:15.305641+0000","last_fullsized":"2024-09-20T21:01:15.305641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823289+0000","last_change":"2024-09-20T21:01:11.220335+0000","last_active":"2024-09-20T21:01:15.823289+0000","last_peered":"2024-09-20T21:01:15.823289+0000","last_clean":"2024-09-20T21:01:15.823289+0000","last_became_active":"2024-09-20T21:01:11.219506+0000","last_became_peered":"2024-09-20T21:01:11.219506+0000","last_unstale":"2024-09-20T21:01:15.823289+0000","last_undegraded":"2024-09-20T21:01:15.823289+0000","last_fullsized":"2024-09-20T21:01:15.823289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:16:05.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825073+0000","last_change":"2024-09-20T21:01:12.214329+0000","last_active":"2024-09-20T21:01:15.825073+0000","last_peered":"2024-09-20T21:01:15.825073+0000","last_clean":"2024-09-20T21:01:15.825073+0000","last_became_active":"2024-09-20T21:01:12.212104+0000","last_became_peered":"2024-09-20T21:01:12.212104+0000","last_unstale":"2024-09-20T21:01:15.825073+0000","last_undegraded":"2024-09-20T21:01:15.825073+0000","last_fullsized":"2024-09-20T21:01:15.825073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304158+0000","last_change":"2024-09-20T21:01:11.213590+0000","last_active":"2024-09-20T21:01:15.304158+0000","last_peered":"2024-09-20T21:01:15.304158+0000","last_clean":"2024-09-20T21:01:15.304158+0000","last_became_active":"2024-09-20T21:01:11.212919+0000","last_became_peered":"2024-09-20T21:01:11.212919+0000","last_unstale":"2024-09-20T21:01:15.304158+0000","last_undegraded":"2024-09-20T21:01:15.304158+0000","last_fullsized":"2024-09-20T21:01:15.304158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.040754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824531+0000","last_change":"2024-09-20T21:01:12.214556+0000","last_active":"2024-09-20T21:01:15.824531+0000","last_peered":"2024-09-20T21:01:15.824531+0000","last_clean":"2024-09-20T21:01:15.824531+0000","last_became_active":"2024-09-20T21:01:12.212508+0000","last_became_peered":"2024-09-20T21:01:12.212508+0000","last_unstale":"2024-09-20T21:01:15.824531+0000","last_undegraded":"2024-09-20T21:01:15.824531+0000","last_fullsized":"2024-09-20T21:01:15.824531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985051+0000","last_change":"2024-09-20T21:01:11.224946+0000","last_active":"2024-09-20T21:01:14.985051+0000","last_peered":"2024-09-20T21:01:14.985051+0000","last_clean":"2024-09-20T21:01:14.985051+0000","last_became_active":"2024-09-20T21:01:11.224026+0000","last_became_peered":"2024-09-20T21:01:11.224026+0000","last_unstale":"2024-09-20T21:01:14.985051+0000","last_undegraded":"2024-09-20T21:01:14.985051+0000","last_fullsized":"2024-09-20T21:01:14.985051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986492+0000","last_change":"2024-09-20T21:01:11.221253+0000","last_active":"2024-09-20T21:01:14.986492+0000","last_peered":"2024-09-20T21:01:14.986492+0000","last_clean":"2024-09-20T21:01:14.986492+0000","last_became_active":"2024-09-20T21:01:11.220476+0000","last_became_peered":"2024-09-20T21:01:11.220476+0000","last_unstale":"2024-09-20T21:01:14.986492+0000","last_undegraded":"2024-09-20T21:01:14.986492+0000","last_fullsized":"2024-09-20T21:01:14.986492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304115+0000","last_change":"2024-09-20T21:01:12.229503+0000","last_active":"2024-09-20T21:01:15.304115+0000","last_peered":"2024-09-20T21:01:15.304115+0000","last_clean":"2024-09-20T21:01:15.304115+0000","last_became_active":"2024-09-20T21:01:12.228540+0000","last_became_peered":"2024-09-20T21:01:12.228540+0000","last_unstale":"2024-09-20T21:01:15.304115+0000","last_undegraded":"2024-09-20T21:01:15.304115+0000","last_fullsized":"2024-09-20T21:01:15.304115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:13.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305796+0000","last_change":"2024-09-20T21:01:11.214247+0000","last_active":"2024-09-20T21:01:15.305796+0000","last_peered":"2024-09-20T21:01:15.305796+0000","last_clean":"2024-09-20T21:01:15.305796+0000","last_became_active":"2024-09-20T21:01:11.212760+0000","last_became_peered":"2024-09-20T21:01:11.212760+0000","last_unstale":"2024-09-20T21:01:15.305796+0000","last_undegraded":"2024-09-20T21:01:15.305796+0000","last_fullsized":"2024-09-20T21:01:15.305796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:20.108703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.303861+0000","last_change":"2024-09-20T21:01:12.238294+0000","last_active":"2024-09-20T21:01:15.303861+0000","last_peered":"2024-09-20T21:01:15.303861+0000","last_clean":"2024-09-20T21:01:15.303861+0000","last_became_active":"2024-09-20T21:01:12.237461+0000","last_became_peered":"2024-09-20T21:01:12.237461+0000","last_unstale":"2024-09-20T21:01:15.303861+0000","last_undegraded":"2024-09-20T21:01:15.303861+0000","last_fullsized":"2024-09-20T21:01:15.303861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:11.215425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986624+0000","last_change":"2024-09-20T21:01:11.221716+0000","last_active":"2024-09-20T21:01:14.986624+0000","last_peered":"2024-09-20T21:01:14.986624+0000","last_clean":"2024-09-20T21:01:14.986624+0000","last_became_active":"2024-09-20T21:01:11.220620+0000","last_became_peered":"2024-09-20T21:01:11.220620+0000","last_unstale":"2024-09-20T21:01:14.986624+0000","last_undegraded":"2024-09-20T21:01:14.986624+0000","last_fullsized":"2024-09-20T21:01:14.986624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:13.593747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985365+0000","last_change":"2024-09-20T21:01:12.210785+0000","last_active":"2024-09-20T21:01:14.985365+0000","last_peered":"2024-09-20T21:01:14.985365+0000","last_clean":"2024-09-20T21:01:14.985365+0000","last_became_active":"2024-09-20T21:01:12.209489+0000","last_became_peered":"2024-09-20T21:01:12.209489+0000","last_unstale":"2024-09-20T21:01:14.985365+0000","last_undegraded":"2024-09-20T21:01:14.985365+0000","last_fullsized":"2024-09-20T21:01:14.985365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986875+0000","last_change":"2024-09-20T21:01:11.217199+0000","last_active":"2024-09-20T21:01:14.986875+0000","last_peered":"2024-09-20T21:01:14.986875+0000","last_clean":"2024-09-20T21:01:14.986875+0000","last_became_active":"2024-09-20T21:01:11.216370+0000","last_became_peered":"2024-09-20T21:01:11.216370+0000","last_unstale":"2024-09-20T21:01:14.986875+0000","last_undegraded":"2024-09-20T21:01:14.986875+0000","last_fullsized":"2024-09-20T21:01:14.986875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824109+0000","last_change":"2024-09-20T21:01:12.220592+0000","last_active":"2024-09-20T21:01:15.824109+0000","last_peered":"2024-09-20T21:01:15.824109+0000","last_clean":"2024-09-20T21:01:15.824109+0000","last_became_active":"2024-09-20T21:01:12.219682+0000","last_became_peered":"2024-09-20T21:01:12.219682+0000","last_unstale":"2024-09-20T21:01:15.824109+0000","last_undegraded":"2024-09-20T21:01:15.824109+0000","last_fullsized":"2024-09-20T21:01:15.824109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824706+0000","last_change":"2024-09-20T21:01:11.220548+0000","last_active":"2024-09-20T21:01:15.824706+0000","last_peered":"2024-09-20T21:01:15.824706+0000","last_clean":"2024-09-20T21:01:15.824706+0000","last_became_active":"2024-09-20T21:01:11.219847+0000","last_became_peered":"2024-09-20T21:01:11.219847+0000","last_unstale":"2024-09-20T21:01:15.824706+0000","last_undegraded":"2024-09-20T21:01:15.824706+0000","last_fullsized":"2024-09-20T21:01:15.824706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985939+0000","last_change":"2024-09-20T21:01:12.211812+0000","last_active":"2024-09-20T21:01:14.985939+0000","last_peered":"2024-09-20T21:01:14.985939+0000","last_clean":"2024-09-20T21:01:14.985939+0000","last_became_active":"2024-09-20T21:01:12.209826+0000","last_became_peered":"2024-09-20T21:01:12.209826+0000","last_unstale":"2024-09-20T21:01:14.985939+0000","last_undegraded":"2024-09-20T21:01:14.985939+0000","last_fullsized":"2024-09-20T21:01:14.985939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:46:41.210017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986629+0000","last_change":"2024-09-20T21:01:11.219106+0000","last_active":"2024-09-20T21:01:14.986629+0000","last_peered":"2024-09-20T21:01:14.986629+0000","last_clean":"2024-09-20T21:01:14.986629+0000","last_became_active":"2024-09-20T21:01:11.218259+0000","last_became_peered":"2024-09-20T21:01:11.218259+0000","last_unstale":"2024-09-20T21:01:14.986629+0000","last_undegraded":"2024-09-20T21:01:14.986629+0000","last_fullsized":"2024-09-20T21:01:14.986629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986094+0000","last_change":"2024-09-20T21:01:12.225987+0000","last_active":"2024-09-20T21:01:14.986094+0000","last_peered":"2024-09-20T21:01:14.986094+0000","last_clean":"2024-09-20T21:01:14.986094+0000","last_became_active":"2024-09-20T21:01:12.222916+0000","last_became_peered":"2024-09-20T21:01:12.222916+0000","last_unstale":"2024-09-20T21:01:14.986094+0000","last_undegraded":"2024-09-20T21:01:14.986094+0000","last_fullsized":"2024-09-20T21:01:14.986094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:16.681572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304200+0000","last_change":"2024-09-20T21:01:11.213371+0000","last_active":"2024-09-20T21:01:15.304200+0000","last_peered":"2024-09-20T21:01:15.304200+0000","last_clean":"2024-09-20T21:01:15.304200+0000","last_became_active":"2024-09-20T21:01:11.212385+0000","last_became_peered":"2024-09-20T21:01:11.212385+0000","last_unstale":"2024-09-20T21:01:15.304200+0000","last_undegraded":"2024-09-20T21:01:15.304200+0000","last_fullsized":"2024-09-20T21:01:15.304200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:56.734999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985452+0000","last_change":"2024-09-20T21:01:12.202841+0000","last_active":"2024-09-20T21:01:14.985452+0000","last_peered":"2024-09-20T21:01:14.985452+0000","last_clean":"2024-09-20T21:01:14.985452+0000","last_became_active":"2024-09-20T21:01:12.201016+0000","last_became_peered":"2024-09-20T21:01:12.201016+0000","last_unstale":"2024-09-20T21:01:14.985452+0000","last_undegraded":"2024-09-20T21:01:14.985452+0000","last_fullsized":"2024-09-20T21:01:14.985452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:55.984268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304606+0000","last_change":"2024-09-20T21:01:11.220785+0000","last_active":"2024-09-20T21:01:15.304606+0000","last_peered":"2024-09-20T21:01:15.304606+0000","last_clean":"2024-09-20T21:01:15.304606+0000","last_became_active":"2024-09-20T21:01:11.220111+0000","last_became_peered":"2024-09-20T21:01:11.220111+0000","last_unstale":"2024-09-20T21:01:15.304606+0000","last_undegraded":"2024-09-20T21:01:15.304606+0000","last_fullsized":"2024-09-20T21:01:15.304606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.621763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824680+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:01:15.824680+0000","last_peered":"2024-09-20T21:01:15.824680+0000","last_clean":"2024-09-20T21:01:15.824680+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:01:15.824680+0000","last_undegraded":"2024-09-20T21:01:15.824680+0000","last_fullsized":"2024-09-20T21:01:15.824680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986367+0000","last_change":"2024-09-20T21:01:02.293432+0000","last_active":"2024-09-20T21:01:14.986367+0000","last_peered":"2024-09-20T21:01:14.986367+0000","last_clean":"2024-09-20T21:01:14.986367+0000","last_became_active":"2024-09-20T21:01:02.291361+0000","last_became_peered":"2024-09-20T21:01:02.291361+0000","last_unstale":"2024-09-20T21:01:14.986367+0000","last_undegraded":"2024-09-20T21:01:14.986367+0000","last_fullsized":"2024-09-20T21:01:14.986367+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:52.935898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986794+0000","last_change":"2024-09-20T21:01:09.031119+0000","last_active":"2024-09-20T21:01:14.986794+0000","last_peered":"2024-09-20T21:01:14.986794+0000","last_clean":"2024-09-20T21:01:14.986794+0000","last_became_active":"2024-09-20T21:01:06.994429+0000","last_became_peered":"2024-09-20T21:01:06.994429+0000","last_unstale":"2024-09-20T21:01:14.986794+0000","last_undegraded":"2024-09-20T21:01:14.986794+0000","last_fullsized":"2024-09-20T21:01:14.986794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:47.585068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025064900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823578+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:01:15.823578+0000","last_peered":"2024-09-20T21:01:15.823578+0000","last_clean":"2024-09-20T21:01:15.823578+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:01:15.823578+0000","last_undegraded":"2024-09-20T21:01:15.823578+0000","last_fullsized":"2024-09-20T21:01:15.823578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986350+0000","last_change":"2024-09-20T21:01:12.224024+0000","last_active":"2024-09-20T21:01:14.986350+0000","last_peered":"2024-09-20T21:01:14.986350+0000","last_clean":"2024-09-20T21:01:14.986350+0000","last_became_active":"2024-09-20T21:01:12.222433+0000","last_became_peered":"2024-09-20T21:01:12.222433+0000","last_unstale":"2024-09-20T21:01:14.986350+0000","last_undegraded":"2024-09-20T21:01:14.986350+0000","last_fullsized":"2024-09-20T21:01:14.986350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:23.486608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.987258+0000","last_change":"2024-09-20T21:01:09.029382+0000","last_active":"2024-09-20T21:01:14.987258+0000","last_peered":"2024-09-20T21:01:14.987258+0000","last_clean":"2024-09-20T21:01:14.987258+0000","last_became_active":"2024-09-20T21:01:06.997340+0000","last_became_peered":"2024-09-20T21:01:06.997340+0000","last_unstale":"2024-09-20T21:01:14.987258+0000","last_undegraded":"2024-09-20T21:01:14.987258+0000","last_fullsized":"2024-09-20T21:01:14.987258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:25:22.179131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081948399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823666+0000","last_change":"2024-09-20T21:01:11.220462+0000","last_active":"2024-09-20T21:01:15.823666+0000","last_peered":"2024-09-20T21:01:15.823666+0000","last_clean":"2024-09-20T21:01:15.823666+0000","last_became_active":"2024-09-20T21:01:11.219778+0000","last_became_peered":"2024-09-20T21:01:11.219778+0000","last_unstale":"2024-09-20T21:01:15.823666+0000","last_undegraded":"2024-09-20T21:01:15.823666+0000","last_fullsized":"2024-09-20T21:01:15.823666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:08.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305546+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:01:15.305546+0000","last_peered":"2024-09-20T21:01:15.305546+0000","last_clean":"2024-09-20T21:01:15.305546+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:01:15.305546+0000","last_undegraded":"2024-09-20T21:01:15.305546+0000","last_fullsized":"2024-09-20T21:01:15.305546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824232+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:01:15.824232+0000","last_peered":"2024-09-20T21:01:15.824232+0000","last_clean":"2024-09-20T21:01:15.824232+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:01:15.824232+0000","last_undegraded":"2024-09-20T21:01:15.824232+0000","last_fullsized":"2024-09-20T21:01:15.824232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304870+0000","last_change":"2024-09-20T21:01:11.217295+0000","last_active":"2024-09-20T21:01:15.304870+0000","last_peered":"2024-09-20T21:01:15.304870+0000","last_clean":"2024-09-20T21:01:15.304870+0000","last_became_active":"2024-09-20T21:01:11.216350+0000","last_became_peered":"2024-09-20T21:01:11.216350+0000","last_unstale":"2024-09-20T21:01:15.304870+0000","last_undegraded":"2024-09-20T21:01:15.304870+0000","last_fullsized":"2024-09-20T21:01:15.304870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:59.661622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824867+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:01:15.824867+0000","last_peered":"2024-09-20T21:01:15.824867+0000","last_clean":"2024-09-20T21:01:15.824867+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:01:15.824867+0000","last_undegraded":"2024-09-20T21:01:15.824867+0000","last_fullsized":"2024-09-20T21:01:15.824867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986806+0000","last_change":"2024-09-20T21:01:09.030841+0000","last_active":"2024-09-20T21:01:14.986806+0000","last_peered":"2024-09-20T21:01:14.986806+0000","last_clean":"2024-09-20T21:01:14.986806+0000","last_became_active":"2024-09-20T21:01:06.994033+0000","last_became_peered":"2024-09-20T21:01:06.994033+0000","last_unstale":"2024-09-20T21:01:14.986806+0000","last_undegraded":"2024-09-20T21:01:14.986806+0000","last_fullsized":"2024-09-20T21:01:14.986806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:57.919077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022137329999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986580+0000","last_change":"2024-09-20T21:01:11.217114+0000","last_active":"2024-09-20T21:01:14.986580+0000","last_peered":"2024-09-20T21:01:14.986580+0000","last_clean":"2024-09-20T21:01:14.986580+0000","last_became_active":"2024-09-20T21:01:11.215974+0000","last_became_peered":"2024-09-20T21:01:11.215974+0000","last_unstale":"2024-09-20T21:01:14.986580+0000","last_undegraded":"2024-09-20T21:01:14.986580+0000","last_fullsized":"2024-09-20T21:01:14.986580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824363+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:01:15.824363+0000","last_peered":"2024-09-20T21:01:15.824363+0000","last_clean":"2024-09-20T21:01:15.824363+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:01:15.824363+0000","last_undegraded":"2024-09-20T21:01:15.824363+0000","last_fullsized":"2024-09-20T21:01:15.824363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986856+0000","last_change":"2024-09-20T21:01:11.217713+0000","last_active":"2024-09-20T21:01:14.986856+0000","last_peered":"2024-09-20T21:01:14.986856+0000","last_clean":"2024-09-20T21:01:14.986856+0000","last_became_active":"2024-09-20T21:01:11.215699+0000","last_became_peered":"2024-09-20T21:01:11.215699+0000","last_unstale":"2024-09-20T21:01:14.986856+0000","last_undegraded":"2024-09-20T21:01:14.986856+0000","last_fullsized":"2024-09-20T21:01:14.986856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:06.986446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824922+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:01:15.824922+0000","last_peered":"2024-09-20T21:01:15.824922+0000","last_clean":"2024-09-20T21:01:15.824922+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:01:15.824922+0000","last_undegraded":"2024-09-20T21:01:15.824922+0000","last_fullsized":"2024-09-20T21:01:15.824922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304465+0000","last_change":"2024-09-20T21:01:12.227746+0000","last_active":"2024-09-20T21:01:15.304465+0000","last_peered":"2024-09-20T21:01:15.304465+0000","last_clean":"2024-09-20T21:01:15.304465+0000","last_became_active":"2024-09-20T21:01:12.226860+0000","last_became_peered":"2024-09-20T21:01:12.226860+0000","last_unstale":"2024-09-20T21:01:15.304465+0000","last_undegraded":"2024-09-20T21:01:15.304465+0000","last_fullsized":"2024-09-20T21:01:15.304465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:02.144980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824585+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:01:15.824585+0000","last_peered":"2024-09-20T21:01:15.824585+0000","last_clean":"2024-09-20T21:01:15.824585+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:01:15.824585+0000","last_undegraded":"2024-09-20T21:01:15.824585+0000","last_fullsized":"2024-09-20T21:01:15.824585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306339+0000","last_change":"2024-09-20T21:01:09.385616+0000","last_active":"2024-09-20T21:01:15.306339+0000","last_peered":"2024-09-20T21:01:15.306339+0000","last_clean":"2024-09-20T21:01:15.306339+0000","last_became_active":"2024-09-20T21:01:07.000811+0000","last_became_peered":"2024-09-20T21:01:07.000811+0000","last_unstale":"2024-09-20T21:01:15.306339+0000","last_undegraded":"2024-09-20T21:01:15.306339+0000","last_fullsized":"2024-09-20T21:01:15.306339+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:03.917240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077098100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304881+0000","last_change":"2024-09-20T21:01:12.227533+0000","last_active":"2024-09-20T21:01:15.304881+0000","last_peered":"2024-09-20T21:01:15.304881+0000","last_clean":"2024-09-20T21:01:15.304881+0000","last_became_active":"2024-09-20T21:01:12.226676+0000","last_became_peered":"2024-09-20T21:01:12.226676+0000","last_unstale":"2024-09-20T21:01:15.304881+0000","last_undegraded":"2024-09-20T21:01:15.304881+0000","last_fullsized":"2024-09-20T21:01:15.304881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825579+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:01:15.825579+0000","last_peered":"2024-09-20T21:01:15.825579+0000","last_clean":"2024-09-20T21:01:15.825579+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:01:15.825579+0000","last_undegraded":"2024-09-20T21:01:15.825579+0000","last_fullsized":"2024-09-20T21:01:15.825579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825452+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:01:15.825452+0000","last_peered":"2024-09-20T21:01:15.825452+0000","last_clean":"2024-09-20T21:01:15.825452+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:01:15.825452+0000","last_undegraded":"2024-09-20T21:01:15.825452+0000","last_fullsized":"2024-09-20T21:01:15.825452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823700+0000","last_change":"2024-09-20T21:01:12.227354+0000","last_active":"2024-09-20T21:01:15.823700+0000","last_peered":"2024-09-20T21:01:15.823700+0000","last_clean":"2024-09-20T21:01:15.823700+0000","last_became_active":"2024-09-20T21:01:12.226078+0000","last_became_peered":"2024-09-20T21:01:12.226078+0000","last_unstale":"2024-09-20T21:01:15.823700+0000","last_undegraded":"2024-09-20T21:01:15.823700+0000","last_fullsized":"2024-09-20T21:01:15.823700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825269+0000","last_change":"2024-09-20T21:01:11.220479+0000","last_active":"2024-09-20T21:01:15.825269+0000","last_peered":"2024-09-20T21:01:15.825269+0000","last_clean":"2024-09-20T21:01:15.825269+0000","last_became_active":"2024-09-20T21:01:11.219658+0000","last_became_peered":"2024-09-20T21:01:11.219658+0000","last_unstale":"2024-09-20T21:01:15.825269+0000","last_undegraded":"2024-09-20T21:01:15.825269+0000","last_fullsized":"2024-09-20T21:01:15.825269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986873+0000","last_change":"2024-09-20T21:01:09.029413+0000","last_active":"2024-09-20T21:01:14.986873+0000","last_peered":"2024-09-20T21:01:14.986873+0000","last_clean":"2024-09-20T21:01:14.986873+0000","last_became_active":"2024-09-20T21:01:06.997186+0000","last_became_peered":"2024-09-20T21:01:06.997186+0000","last_unstale":"2024-09-20T21:01:14.986873+0000","last_undegraded":"2024-09-20T21:01:14.986873+0000","last_fullsized":"2024-09-20T21:01:14.986873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:09:55.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.303941+0000","last_change":"2024-09-20T21:01:12.228307+0000","last_active":"2024-09-20T21:01:15.303941+0000","last_peered":"2024-09-20T21:01:15.303941+0000","last_clean":"2024-09-20T21:01:15.303941+0000","last_became_active":"2024-09-20T21:01:12.226322+0000","last_became_peered":"2024-09-20T21:01:12.226322+0000","last_unstale":"2024-09-20T21:01:15.303941+0000","last_undegraded":"2024-09-20T21:01:15.303941+0000","last_fullsized":"2024-09-20T21:01:15.303941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:52.194070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985673+0000","last_change":"2024-09-20T21:01:12.220324+0000","last_active":"2024-09-20T21:01:14.985673+0000","last_peered":"2024-09-20T21:01:14.985673+0000","last_clean":"2024-09-20T21:01:14.985673+0000","last_became_active":"2024-09-20T21:01:12.219327+0000","last_became_peered":"2024-09-20T21:01:12.219327+0000","last_unstale":"2024-09-20T21:01:14.985673+0000","last_undegraded":"2024-09-20T21:01:14.985673+0000","last_fullsized":"2024-09-20T21:01:14.985673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:56.030003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986595+0000","last_change":"2024-09-20T21:01:11.221231+0000","last_active":"2024-09-20T21:01:14.986595+0000","last_peered":"2024-09-20T21:01:14.986595+0000","last_clean":"2024-09-20T21:01:14.986595+0000","last_became_active":"2024-09-20T21:01:11.220426+0000","last_became_peered":"2024-09-20T21:01:11.220426+0000","last_unstale":"2024-09-20T21:01:14.986595+0000","last_undegraded":"2024-09-20T21:01:14.986595+0000","last_fullsized":"2024-09-20T21:01:14.986595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822977+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:01:15.822977+0000","last_peered":"2024-09-20T21:01:15.822977+0000","last_clean":"2024-09-20T21:01:15.822977+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:01:15.822977+0000","last_undegraded":"2024-09-20T21:01:15.822977+0000","last_fullsized":"2024-09-20T21:01:15.822977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305982+0000","last_change":"2024-09-20T21:01:11.220027+0000","last_active":"2024-09-20T21:01:15.305982+0000","last_peered":"2024-09-20T21:01:15.305982+0000","last_clean":"2024-09-20T21:01:15.305982+0000","last_became_active":"2024-09-20T21:01:11.218551+0000","last_became_peered":"2024-09-20T21:01:11.218551+0000","last_unstale":"2024-09-20T21:01:15.305982+0000","last_undegraded":"2024-09-20T21:01:15.305982+0000","last_fullsized":"2024-09-20T21:01:15.305982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:47:59.918561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986048+0000","last_change":"2024-09-20T21:01:11.218922+0000","last_active":"2024-09-20T21:01:14.986048+0000","last_peered":"2024-09-20T21:01:14.986048+0000","last_clean":"2024-09-20T21:01:14.986048+0000","last_became_active":"2024-09-20T21:01:11.218028+0000","last_became_peered":"2024-09-20T21:01:11.218028+0000","last_unstale":"2024-09-20T21:01:14.986048+0000","last_undegraded":"2024-09-20T21:01:14.986048+0000","last_fullsized":"2024-09-20T21:01:14.986048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822895+0000","last_change":"2024-09-20T21:01:12.211553+0000","last_active":"2024-09-20T21:01:15.822895+0000","last_peered":"2024-09-20T21:01:15.822895+0000","last_clean":"2024-09-20T21:01:15.822895+0000","last_became_active":"2024-09-20T21:01:12.210101+0000","last_became_peered":"2024-09-20T21:01:12.210101+0000","last_unstale":"2024-09-20T21:01:15.822895+0000","last_undegraded":"2024-09-20T21:01:15.822895+0000","last_fullsized":"2024-09-20T21:01:15.822895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825324+0000","last_change":"2024-09-20T21:01:11.221867+0000","last_active":"2024-09-20T21:01:15.825324+0000","last_peered":"2024-09-20T21:01:15.825324+0000","last_clean":"2024-09-20T21:01:15.825324+0000","last_became_active":"2024-09-20T21:01:11.220980+0000","last_became_peered":"2024-09-20T21:01:11.220980+0000","last_unstale":"2024-09-20T21:01:15.825324+0000","last_undegraded":"2024-09-20T21:01:15.825324+0000","last_fullsized":"2024-09-20T21:01:15.825324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823018+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:01:15.823018+0000","last_peered":"2024-09-20T21:01:15.823018+0000","last_clean":"2024-09-20T21:01:15.823018+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:01:15.823018+0000","last_undegraded":"2024-09-20T21:01:15.823018+0000","last_fullsized":"2024-09-20T21:01:15.823018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306640+0000","last_change":"2024-09-20T21:01:12.236819+0000","last_active":"2024-09-20T21:01:15.306640+0000","last_peered":"2024-09-20T21:01:15.306640+0000","last_clean":"2024-09-20T21:01:15.306640+0000","last_became_active":"2024-09-20T21:01:12.233922+0000","last_became_peered":"2024-09-20T21:01:12.233922+0000","last_unstale":"2024-09-20T21:01:15.306640+0000","last_undegraded":"2024-09-20T21:01:15.306640+0000","last_fullsized":"2024-09-20T21:01:15.306640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823315+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:01:15.823315+0000","last_peered":"2024-09-20T21:01:15.823315+0000","last_clean":"2024-09-20T21:01:15.823315+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:01:15.823315+0000","last_undegraded":"2024-09-20T21:01:15.823315+0000","last_fullsized":"2024-09-20T21:01:15.823315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824535+0000","last_change":"2024-09-20T21:01:12.227395+0000","last_active":"2024-09-20T21:01:15.824535+0000","last_peered":"2024-09-20T21:01:15.824535+0000","last_clean":"2024-09-20T21:01:15.824535+0000","last_became_active":"2024-09-20T21:01:12.226122+0000","last_became_peered":"2024-09-20T21:01:12.226122+0000","last_unstale":"2024-09-20T21:01:15.824535+0000","last_undegraded":"2024-09-20T21:01:15.824535+0000","last_fullsized":"2024-09-20T21:01:15.824535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823918+0000","last_change":"2024-09-20T21:01:11.220367+0000","last_active":"2024-09-20T21:01:15.823918+0000","last_peered":"2024-09-20T21:01:15.823918+0000","last_clean":"2024-09-20T21:01:15.823918+0000","last_became_active":"2024-09-20T21:01:11.219090+0000","last_became_peered":"2024-09-20T21:01:11.219090+0000","last_unstale":"2024-09-20T21:01:15.823918+0000","last_undegraded":"2024-09-20T21:01:15.823918+0000","last_fullsized":"2024-09-20T21:01:15.823918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305423+0000","last_change":"2024-09-20T21:01:12.238895+0000","last_active":"2024-09-20T21:01:15.305423+0000","last_peered":"2024-09-20T21:01:15.305423+0000","last_clean":"2024-09-20T21:01:15.305423+0000","last_became_active":"2024-09-20T21:01:12.235481+0000","last_became_peered":"2024-09-20T21:01:12.235481+0000","last_unstale":"2024-09-20T21:01:15.305423+0000","last_undegraded":"2024-09-20T21:01:15.305423+0000","last_fullsized":"2024-09-20T21:01:15.305423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304734+0000","last_change":"2024-09-20T21:01:11.217493+0000","last_active":"2024-09-20T21:01:15.304734+0000","last_peered":"2024-09-20T21:01:15.304734+0000","last_clean":"2024-09-20T21:01:15.304734+0000","last_became_active":"2024-09-20T21:01:11.216073+0000","last_became_peered":"2024-09-20T21:01:11.216073+0000","last_unstale":"2024-09-20T21:01:15.304734+0000","last_undegraded":"2024-09-20T21:01:15.304734+0000","last_fullsized":"2024-09-20T21:01:15.304734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:23:30.512126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305358+0000","last_change":"2024-09-20T21:01:12.232371+0000","last_active":"2024-09-20T21:01:15.305358+0000","last_peered":"2024-09-20T21:01:15.305358+0000","last_clean":"2024-09-20T21:01:15.305358+0000","last_became_active":"2024-09-20T21:01:12.231450+0000","last_became_peered":"2024-09-20T21:01:12.231450+0000","last_unstale":"2024-09-20T21:01:15.305358+0000","last_undegraded":"2024-09-20T21:01:15.305358+0000","last_fullsized":"2024-09-20T21:01:15.305358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305184+0000","last_change":"2024-09-20T21:01:11.218440+0000","last_active":"2024-09-20T21:01:15.305184+0000","last_peered":"2024-09-20T21:01:15.305184+0000","last_clean":"2024-09-20T21:01:15.305184+0000","last_became_active":"2024-09-20T21:01:11.217722+0000","last_became_peered":"2024-09-20T21:01:11.217722+0000","last_unstale":"2024-09-20T21:01:15.305184+0000","last_undegraded":"2024-09-20T21:01:15.305184+0000","last_fullsized":"2024-09-20T21:01:15.305184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:11:02.101254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985035+0000","last_change":"2024-09-20T21:01:12.212994+0000","last_active":"2024-09-20T21:01:14.985035+0000","last_peered":"2024-09-20T21:01:14.985035+0000","last_clean":"2024-09-20T21:01:14.985035+0000","last_became_active":"2024-09-20T21:01:12.211080+0000","last_became_peered":"2024-09-20T21:01:12.211080+0000","last_unstale":"2024-09-20T21:01:14.985035+0000","last_undegraded":"2024-09-20T21:01:14.985035+0000","last_fullsized":"2024-09-20T21:01:14.985035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986320+0000","last_change":"2024-09-20T21:01:11.217211+0000","last_active":"2024-09-20T21:01:14.986320+0000","last_peered":"2024-09-20T21:01:14.986320+0000","last_clean":"2024-09-20T21:01:14.986320+0000","last_became_active":"2024-09-20T21:01:11.216428+0000","last_became_peered":"2024-09-20T21:01:11.216428+0000","last_unstale":"2024-09-20T21:01:14.986320+0000","last_undegraded":"2024-09-20T21:01:14.986320+0000","last_fullsized":"2024-09-20T21:01:14.986320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986366+0000","last_change":"2024-09-20T21:01:12.214965+0000","last_active":"2024-09-20T21:01:14.986366+0000","last_peered":"2024-09-20T21:01:14.986366+0000","last_clean":"2024-09-20T21:01:14.986366+0000","last_became_active":"2024-09-20T21:01:12.211534+0000","last_became_peered":"2024-09-20T21:01:12.211534+0000","last_unstale":"2024-09-20T21:01:14.986366+0000","last_undegraded":"2024-09-20T21:01:14.986366+0000","last_fullsized":"2024-09-20T21:01:14.986366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305711+0000","last_change":"2024-09-20T21:01:11.220332+0000","last_active":"2024-09-20T21:01:15.305711+0000","last_peered":"2024-09-20T21:01:15.305711+0000","last_clean":"2024-09-20T21:01:15.305711+0000","last_became_active":"2024-09-20T21:01:11.219022+0000","last_became_peered":"2024-09-20T21:01:11.219022+0000","last_unstale":"2024-09-20T21:01:15.305711+0000","last_undegraded":"2024-09-20T21:01:15.305711+0000","last_fullsized":"2024-09-20T21:01:15.305711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.928114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304479+0000","last_change":"2024-09-20T21:01:12.238819+0000","last_active":"2024-09-20T21:01:15.304479+0000","last_peered":"2024-09-20T21:01:15.304479+0000","last_clean":"2024-09-20T21:01:15.304479+0000","last_became_active":"2024-09-20T21:01:12.237939+0000","last_became_peered":"2024-09-20T21:01:12.237939+0000","last_unstale":"2024-09-20T21:01:15.304479+0000","last_undegraded":"2024-09-20T21:01:15.304479+0000","last_fullsized":"2024-09-20T21:01:15.304479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825078+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:01:15.825078+0000","last_peered":"2024-09-20T21:01:15.825078+0000","last_clean":"2024-09-20T21:01:15.825078+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:01:15.825078+0000","last_undegraded":"2024-09-20T21:01:15.825078+0000","last_fullsized":"2024-09-20T21:01:15.825078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986017+0000","last_change":"2024-09-20T21:01:12.213562+0000","last_active":"2024-09-20T21:01:14.986017+0000","last_peered":"2024-09-20T21:01:14.986017+0000","last_clean":"2024-09-20T21:01:14.986017+0000","last_became_active":"2024-09-20T21:01:12.210781+0000","last_became_peered":"2024-09-20T21:01:12.210781+0000","last_unstale":"2024-09-20T21:01:14.986017+0000","last_undegraded":"2024-09-20T21:01:14.986017+0000","last_fullsized":"2024-09-20T21:01:14.986017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825003+0000","last_change":"2024-09-20T21:01:11.222738+0000","last_active":"2024-09-20T21:01:15.825003+0000","last_peered":"2024-09-20T21:01:15.825003+0000","last_clean":"2024-09-20T21:01:15.825003+0000","last_became_active":"2024-09-20T21:01:11.221990+0000","last_became_peered":"2024-09-20T21:01:11.221990+0000","last_unstale":"2024-09-20T21:01:15.825003+0000","last_undegraded":"2024-09-20T21:01:15.825003+0000","last_fullsized":"2024-09-20T21:01:15.825003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":258048,"data_stored":655436,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":270336,"data_stored":656071,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:01:23.469 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:01:23.808 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:01:23.825 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-20T21:01:22.860551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90108,"kb_used_data":696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025412,"statfs":{"total":289910292480,"available":289818021888,"internally_reserved":0,"allocated":712704,"data_stored":1375416,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4788,"internal_metadata":91483468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.652940"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306410+0000","last_change":"2024-09-20T21:01:12.240709+0000","last_active":"2024-09-20T21:01:15.306410+0000","last_peered":"2024-09-20T21:01:15.306410+0000","last_clean":"2024-09-20T21:01:15.306410+0000","last_became_active":"2024-09-20T21:01:12.239599+0000","last_became_peered":"2024-09-20T21:01:12.239599+0000","last_unstale":"2024-09-20T21:01:15.306410+0000","last_undegraded":"2024-09-20T21:01:15.306410+0000","last_fullsized":"2024-09-20T21:01:15.306410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304904+0000","last_change":"2024-09-20T21:01:12.236761+0000","last_active":"2024-09-20T21:01:15.304904+0000","last_peered":"2024-09-20T21:01:15.304904+0000","last_clean":"2024-09-20T21:01:15.304904+0000","last_became_active":"2024-09-20T21:01:12.235613+0000","last_became_peered":"2024-09-20T21:01:12.235613+0000","last_unstale":"2024-09-20T21:01:15.304904+0000","last_undegraded":"2024-09-20T21:01:15.304904+0000","last_fullsized":"2024-09-20T21:01:15.304904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985464+0000","last_change":"2024-09-20T21:01:12.228562+0000","last_active":"2024-09-20T21:01:14.985464+0000","last_peered":"2024-09-20T21:01:14.985464+0000","last_clean":"2024-09-20T21:01:14.985464+0000","last_became_active":"2024-09-20T21:01:12.224894+0000","last_became_peered":"2024-09-20T21:01:12.224894+0000","last_unstale":"2024-09-20T21:01:14.985464+0000","last_undegraded":"2024-09-20T21:01:14.985464+0000","last_fullsized":"2024-09-20T21:01:14.985464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.657192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985376+0000","last_change":"2024-09-20T21:01:12.227789+0000","last_active":"2024-09-20T21:01:14.985376+0000","last_peered":"2024-09-20T21:01:14.985376+0000","last_clean":"2024-09-20T21:01:14.985376+0000","last_became_active":"2024-09-20T21:01:12.225718+0000","last_became_peered":"2024-09-20T21:01:12.225718+0000","last_unstale":"2024-09-20T21:01:14.985376+0000","last_undegraded":"2024-09-20T21:01:14.985376+0000","last_fullsized":"2024-09-20T21:01:14.985376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:15.226852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305052+0000","last_change":"2024-09-20T21:01:12.232080+0000","last_active":"2024-09-20T21:01:15.305052+0000","last_peered":"2024-09-20T21:01:15.305052+0000","last_clean":"2024-09-20T21:01:15.305052+0000","last_became_active":"2024-09-20T21:01:12.231429+0000","last_became_peered":"2024-09-20T21:01:12.231429+0000","last_unstale":"2024-09-20T21:01:15.305052+0000","last_undegraded":"2024-09-20T21:01:15.305052+0000","last_fullsized":"2024-09-20T21:01:15.305052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984770+0000","last_change":"2024-09-20T21:01:12.231871+0000","last_active":"2024-09-20T21:01:14.984770+0000","last_peered":"2024-09-20T21:01:14.984770+0000","last_clean":"2024-09-20T21:01:14.984770+0000","last_became_active":"2024-09-20T21:01:12.229463+0000","last_became_peered":"2024-09-20T21:01:12.229463+0000","last_unstale":"2024-09-20T21:01:14.984770+0000","last_undegraded":"2024-09-20T21:01:14.984770+0000","last_fullsized":"2024-09-20T21:01:14.984770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984571+0000","last_change":"2024-09-20T21:01:12.226969+0000","last_active":"2024-09-20T21:01:14.984571+0000","last_peered":"2024-09-20T21:01:14.984571+0000","last_clean":"2024-09-20T21:01:14.984571+0000","last_became_active":"2024-09-20T21:01:12.225800+0000","last_became_peered":"2024-09-20T21:01:12.225800+0000","last_unstale":"2024-09-20T21:01:14.984571+0000","last_undegraded":"2024-09-20T21:01:14.984571+0000","last_fullsized":"2024-09-20T21:01:14.984571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984474+0000","last_change":"2024-09-20T21:01:12.217357+0000","last_active":"2024-09-20T21:01:14.984474+0000","last_peered":"2024-09-20T21:01:14.984474+0000","last_clean":"2024-09-20T21:01:14.984474+0000","last_became_active":"2024-09-20T21:01:12.213483+0000","last_became_peered":"2024-09-20T21:01:12.213483+0000","last_unstale":"2024-09-20T21:01:14.984474+0000","last_undegraded":"2024-09-20T21:01:14.984474+0000","last_fullsized":"2024-09-20T21:01:14.984474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824366+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:01:15.824366+0000","last_peered":"2024-09-20T21:01:15.824366+0000","last_clean":"2024-09-20T21:01:15.824366+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:01:15.824366+0000","last_undegraded":"2024-09-20T21:01:15.824366+0000","last_fullsized":"2024-09-20T21:01:15.824366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305301+0000","last_change":"2024-09-20T21:01:12.240432+0000","last_active":"2024-09-20T21:01:15.305301+0000","last_peered":"2024-09-20T21:01:15.305301+0000","last_clean":"2024-09-20T21:01:15.305301+0000","last_became_active":"2024-09-20T21:01:12.238826+0000","last_became_peered":"2024-09-20T21:01:12.238826+0000","last_unstale":"2024-09-20T21:01:15.305301+0000","last_undegraded":"2024-09-20T21:01:15.305301+0000","last_fullsized":"2024-09-20T21:01:15.305301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985723+0000","last_change":"2024-09-20T21:01:12.213062+0000","last_active":"2024-09-20T21:01:14.985723+0000","last_peered":"2024-09-20T21:01:14.985723+0000","last_clean":"2024-09-20T21:01:14.985723+0000","last_became_active":"2024-09-20T21:01:12.211953+0000","last_became_peered":"2024-09-20T21:01:12.211953+0000","last_unstale":"2024-09-20T21:01:14.985723+0000","last_undegraded":"2024-09-20T21:01:14.985723+0000","last_fullsized":"2024-09-20T21:01:14.985723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.052874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304989+0000","last_change":"2024-09-20T21:01:12.229580+0000","last_active":"2024-09-20T21:01:15.304989+0000","last_peered":"2024-09-20T21:01:15.304989+0000","last_clean":"2024-09-20T21:01:15.304989+0000","last_became_active":"2024-09-20T21:01:12.226915+0000","last_became_peered":"2024-09-20T21:01:12.226915+0000","last_unstale":"2024-09-20T21:01:15.304989+0000","last_undegraded":"2024-09-20T21:01:15.304989+0000","last_fullsized":"2024-09-20T21:01:15.304989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.985765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304611+0000","last_change":"2024-09-20T21:01:12.230410+0000","last_active":"2024-09-20T21:01:15.304611+0000","last_peered":"2024-09-20T21:01:15.304611+0000","last_clean":"2024-09-20T21:01:15.304611+0000","last_became_active":"2024-09-20T21:01:12.229859+0000","last_became_peered":"2024-09-20T21:01:12.229859+0000","last_unstale":"2024-09-20T21:01:15.304611+0000","last_undegraded":"2024-09-20T21:01:15.304611+0000","last_fullsized":"2024-09-20T21:01:15.304611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985035+0000","last_change":"2024-09-20T21:01:12.220376+0000","last_active":"2024-09-20T21:01:14.985035+0000","last_peered":"2024-09-20T21:01:14.985035+0000","last_clean":"2024-09-20T21:01:14.985035+0000","last_became_active":"2024-09-20T21:01:12.219338+0000","last_became_peered":"2024-09-20T21:01:12.219338+0000","last_unstale":"2024-09-20T21:01:14.985035+0000","last_undegraded":"2024-09-20T21:01:14.985035+0000","last_fullsized":"2024-09-20T21:01:14.985035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984765+0000","last_change":"2024-09-20T21:01:12.218884+0000","last_active":"2024-09-20T21:01:14.984765+0000","last_peered":"2024-09-20T21:01:14.984765+0000","last_clean":"2024-09-20T21:01:14.984765+0000","last_became_active":"2024-09-20T21:01:12.218225+0000","last_became_peered":"2024-09-20T21:01:12.218225+0000","last_unstale":"2024-09-20T21:01:14.984765+0000","last_undegraded":"2024-09-20T21:01:14.984765+0000","last_fullsized":"2024-09-20T21:01:14.984765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984513+0000","last_change":"2024-09-20T21:01:12.214974+0000","last_active":"2024-09-20T21:01:14.984513+0000","last_peered":"2024-09-20T21:01:14.984513+0000","last_clean":"2024-09-20T21:01:14.984513+0000","last_became_active":"2024-09-20T21:01:12.212149+0000","last_became_peered":"2024-09-20T21:01:12.212149+0000","last_unstale":"2024-09-20T21:01:14.984513+0000","last_undegraded":"2024-09-20T21:01:14.984513+0000","last_fullsized":"2024-09-20T21:01:14.984513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825339+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:01:15.825339+0000","last_peered":"2024-09-20T21:01:15.825339+0000","last_clean":"2024-09-20T21:01:15.825339+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:01:15.825339+0000","last_undegraded":"2024-09-20T21:01:15.825339+0000","last_fullsized":"2024-09-20T21:01:15.825339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305951+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:01:15.305951+0000","last_peered":"2024-09-20T21:01:15.305951+0000","last_clean":"2024-09-20T21:01:15.305951+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:01:15.305951+0000","last_undegraded":"2024-09-20T21:01:15.305951+0000","last_fullsized":"2024-09-20T21:01:15.305951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823775+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:01:15.823775+0000","last_peered":"2024-09-20T21:01:15.823775+0000","last_clean":"2024-09-20T21:01:15.823775+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:01:15.823775+0000","last_undegraded":"2024-09-20T21:01:15.823775+0000","last_fullsized":"2024-09-20T21:01:15.823775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986032+0000","last_change":"2024-09-20T21:01:12.212785+0000","last_active":"2024-09-20T21:01:14.986032+0000","last_peered":"2024-09-20T21:01:14.986032+0000","last_clean":"2024-09-20T21:01:14.986032+0000","last_became_active":"2024-09-20T21:01:12.211844+0000","last_became_peered":"2024-09-20T21:01:12.211844+0000","last_unstale":"2024-09-20T21:01:14.986032+0000","last_undegraded":"2024-09-20T21:01:14.986032+0000","last_fullsized":"2024-09-20T21:01:14.986032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:38.821473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986326+0000","last_change":"2024-09-20T21:01:12.210710+0000","last_active":"2024-09-20T21:01:14.986326+0000","last_peered":"2024-09-20T21:01:14.986326+0000","last_clean":"2024-09-20T21:01:14.986326+0000","last_became_active":"2024-09-20T21:01:12.209676+0000","last_became_peered":"2024-09-20T21:01:12.209676+0000","last_unstale":"2024-09-20T21:01:14.986326+0000","last_undegraded":"2024-09-20T21:01:14.986326+0000","last_fullsized":"2024-09-20T21:01:14.986326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:48.442304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304234+0000","last_change":"2024-09-20T21:01:12.230375+0000","last_active":"2024-09-20T21:01:15.304234+0000","last_peered":"2024-09-20T21:01:15.304234+0000","last_clean":"2024-09-20T21:01:15.304234+0000","last_became_active":"2024-09-20T21:01:12.228679+0000","last_became_peered":"2024-09-20T21:01:12.228679+0000","last_unstale":"2024-09-20T21:01:15.304234+0000","last_undegraded":"2024-09-20T21:01:15.304234+0000","last_fullsized":"2024-09-20T21:01:15.304234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822604+0000","last_change":"2024-09-20T21:01:12.214484+0000","last_active":"2024-09-20T21:01:15.822604+0000","last_peered":"2024-09-20T21:01:15.822604+0000","last_clean":"2024-09-20T21:01:15.822604+0000","last_became_active":"2024-09-20T21:01:12.212293+0000","last_became_peered":"2024-09-20T21:01:12.212293+0000","last_unstale":"2024-09-20T21:01:15.822604+0000","last_undegraded":"2024-09-20T21:01:15.822604+0000","last_fullsized":"2024-09-20T21:01:15.822604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304078+0000","last_change":"2024-09-20T21:01:12.229114+0000","last_active":"2024-09-20T21:01:15.304078+0000","last_peered":"2024-09-20T21:01:15.304078+0000","last_clean":"2024-09-20T21:01:15.304078+0000","last_became_active":"2024-09-20T21:01:12.227812+0000","last_became_peered":"2024-09-20T21:01:12.227812+0000","last_unstale":"2024-09-20T21:01:15.304078+0000","last_undegraded":"2024-09-20T21:01:15.304078+0000","last_fullsized":"2024-09-20T21:01:15.304078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:02.638461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306541+0000","last_change":"2024-09-20T21:01:12.237926+0000","last_active":"2024-09-20T21:01:15.306541+0000","last_peered":"2024-09-20T21:01:15.306541+0000","last_clean":"2024-09-20T21:01:15.306541+0000","last_became_active":"2024-09-20T21:01:12.234061+0000","last_became_peered":"2024-09-20T21:01:12.234061+0000","last_unstale":"2024-09-20T21:01:15.306541+0000","last_undegraded":"2024-09-20T21:01:15.306541+0000","last_fullsized":"2024-09-20T21:01:15.306541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824786+0000","last_change":"2024-09-20T21:01:12.214728+0000","last_active":"2024-09-20T21:01:15.824786+0000","last_peered":"2024-09-20T21:01:15.824786+0000","last_clean":"2024-09-20T21:01:15.824786+0000","last_became_active":"2024-09-20T21:01:12.213159+0000","last_became_peered":"2024-09-20T21:01:12.213159+0000","last_unstale":"2024-09-20T21:01:15.824786+0000","last_undegraded":"2024-09-20T21:01:15.824786+0000","last_fullsized":"2024-09-20T21:01:15.824786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985824+0000","last_change":"2024-09-20T21:01:12.227975+0000","last_active":"2024-09-20T21:01:14.985824+0000","last_peered":"2024-09-20T21:01:14.985824+0000","last_clean":"2024-09-20T21:01:14.985824+0000","last_became_active":"2024-09-20T21:01:12.223433+0000","last_became_peered":"2024-09-20T21:01:12.223433+0000","last_unstale":"2024-09-20T21:01:14.985824+0000","last_undegraded":"2024-09-20T21:01:14.985824+0000","last_fullsized":"2024-09-20T21:01:14.985824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:32.017817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305701+0000","last_change":"2024-09-20T21:01:12.227425+0000","last_active":"2024-09-20T21:01:15.305701+0000","last_peered":"2024-09-20T21:01:15.305701+0000","last_clean":"2024-09-20T21:01:15.305701+0000","last_became_active":"2024-09-20T21:01:12.226625+0000","last_became_peered":"2024-09-20T21:01:12.226625+0000","last_unstale":"2024-09-20T21:01:15.305701+0000","last_undegraded":"2024-09-20T21:01:15.305701+0000","last_fullsized":"2024-09-20T21:01:15.305701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824366+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:01:15.824366+0000","last_peered":"2024-09-20T21:01:15.824366+0000","last_clean":"2024-09-20T21:01:15.824366+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:01:15.824366+0000","last_undegraded":"2024-09-20T21:01:15.824366+0000","last_fullsized":"2024-09-20T21:01:15.824366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304558+0000","last_change":"2024-09-20T21:01:12.230684+0000","last_active":"2024-09-20T21:01:15.304558+0000","last_peered":"2024-09-20T21:01:15.304558+0000","last_clean":"2024-09-20T21:01:15.304558+0000","last_became_active":"2024-09-20T21:01:12.229915+0000","last_became_peered":"2024-09-20T21:01:12.229915+0000","last_unstale":"2024-09-20T21:01:15.304558+0000","last_undegraded":"2024-09-20T21:01:15.304558+0000","last_fullsized":"2024-09-20T21:01:15.304558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822770+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:01:15.822770+0000","last_peered":"2024-09-20T21:01:15.822770+0000","last_clean":"2024-09-20T21:01:15.822770+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:01:15.822770+0000","last_undegraded":"2024-09-20T21:01:15.822770+0000","last_fullsized":"2024-09-20T21:01:15.822770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.984770+0000","last_change":"2024-09-20T21:01:12.215773+0000","last_active":"2024-09-20T21:01:14.984770+0000","last_peered":"2024-09-20T21:01:14.984770+0000","last_clean":"2024-09-20T21:01:14.984770+0000","last_became_active":"2024-09-20T21:01:12.212199+0000","last_became_peered":"2024-09-20T21:01:12.212199+0000","last_unstale":"2024-09-20T21:01:14.984770+0000","last_undegraded":"2024-09-20T21:01:14.984770+0000","last_fullsized":"2024-09-20T21:01:14.984770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305678+0000","last_change":"2024-09-20T21:01:12.232814+0000","last_active":"2024-09-20T21:01:15.305678+0000","last_peered":"2024-09-20T21:01:15.305678+0000","last_clean":"2024-09-20T21:01:15.305678+0000","last_became_active":"2024-09-20T21:01:12.232026+0000","last_became_peered":"2024-09-20T21:01:12.232026+0000","last_unstale":"2024-09-20T21:01:15.305678+0000","last_undegraded":"2024-09-20T21:01:15.305678+0000","last_fullsized":"2024-09-20T21:01:15.305678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986403+0000","last_change":"2024-09-20T21:01:11.216956+0000","last_active":"2024-09-20T21:01:14.986403+0000","last_peered":"2024-09-20T21:01:14.986403+0000","last_clean":"2024-09-20T21:01:14.986403+0000","last_became_active":"2024-09-20T21:01:11.216462+0000","last_became_peered":"2024-09-20T21:01:11.216462+0000","last_unstale":"2024-09-20T21:01:14.986403+0000","last_undegraded":"2024-09-20T21:01:14.986403+0000","last_fullsized":"2024-09-20T21:01:14.986403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305641+0000","last_change":"2024-09-20T21:01:12.230727+0000","last_active":"2024-09-20T21:01:15.305641+0000","last_peered":"2024-09-20T21:01:15.305641+0000","last_clean":"2024-09-20T21:01:15.305641+0000","last_became_active":"2024-09-20T21:01:12.229987+0000","last_became_peered":"2024-09-20T21:01:12.229987+0000","last_unstale":"2024-09-20T21:01:15.305641+0000","last_undegraded":"2024-09-20T21:01:15.305641+0000","last_fullsized":"2024-09-20T21:01:15.305641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823289+0000","last_change":"2024-09-20T21:01:11.220335+0000","last_active":"2024-09-20T21:01:15.823289+0000","last_peered":"2024-09-20T21:01:15.823289+0000","last_clean":"2024-09-20T21:01:15.823289+0000","last_became_active":"2024-09-20T21:01:11.219506+0000","last_became_peered":"2024-09-20T21:01:11.219506+0000","last_unstale":"2024-09-20T21:01:15.823289+0000","last_undegraded":"2024-09-20T21:01:15.823289+0000","last_fullsized":"2024-09-20T21:01:15.823289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:16:05.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825073+0000","last_change":"2024-09-20T21:01:12.214329+0000","last_active":"2024-09-20T21:01:15.825073+0000","last_peered":"2024-09-20T21:01:15.825073+0000","last_clean":"2024-09-20T21:01:15.825073+0000","last_became_active":"2024-09-20T21:01:12.212104+0000","last_became_peered":"2024-09-20T21:01:12.212104+0000","last_unstale":"2024-09-20T21:01:15.825073+0000","last_undegraded":"2024-09-20T21:01:15.825073+0000","last_fullsized":"2024-09-20T21:01:15.825073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304158+0000","last_change":"2024-09-20T21:01:11.213590+0000","last_active":"2024-09-20T21:01:15.304158+0000","last_peered":"2024-09-20T21:01:15.304158+0000","last_clean":"2024-09-20T21:01:15.304158+0000","last_became_active":"2024-09-20T21:01:11.212919+0000","last_became_peered":"2024-09-20T21:01:11.212919+0000","last_unstale":"2024-09-20T21:01:15.304158+0000","last_undegraded":"2024-09-20T21:01:15.304158+0000","last_fullsized":"2024-09-20T21:01:15.304158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.040754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824531+0000","last_change":"2024-09-20T21:01:12.214556+0000","last_active":"2024-09-20T21:01:15.824531+0000","last_peered":"2024-09-20T21:01:15.824531+0000","last_clean":"2024-09-20T21:01:15.824531+0000","last_became_active":"2024-09-20T21:01:12.212508+0000","last_became_peered":"2024-09-20T21:01:12.212508+0000","last_unstale":"2024-09-20T21:01:15.824531+0000","last_undegraded":"2024-09-20T21:01:15.824531+0000","last_fullsized":"2024-09-20T21:01:15.824531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985051+0000","last_change":"2024-09-20T21:01:11.224946+0000","last_active":"2024-09-20T21:01:14.985051+0000","last_peered":"2024-09-20T21:01:14.985051+0000","last_clean":"2024-09-20T21:01:14.985051+0000","last_became_active":"2024-09-20T21:01:11.224026+0000","last_became_peered":"2024-09-20T21:01:11.224026+0000","last_unstale":"2024-09-20T21:01:14.985051+0000","last_undegraded":"2024-09-20T21:01:14.985051+0000","last_fullsized":"2024-09-20T21:01:14.985051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986492+0000","last_change":"2024-09-20T21:01:11.221253+0000","last_active":"2024-09-20T21:01:14.986492+0000","last_peered":"2024-09-20T21:01:14.986492+0000","last_clean":"2024-09-20T21:01:14.986492+0000","last_became_active":"2024-09-20T21:01:11.220476+0000","last_became_peered":"2024-09-20T21:01:11.220476+0000","last_unstale":"2024-09-20T21:01:14.986492+0000","last_undegraded":"2024-09-20T21:01:14.986492+0000","last_fullsized":"2024-09-20T21:01:14.986492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304115+0000","last_change":"2024-09-20T21:01:12.229503+0000","last_active":"2024-09-20T21:01:15.304115+0000","last_peered":"2024-09-20T21:01:15.304115+0000","last_clean":"2024-09-20T21:01:15.304115+0000","last_became_active":"2024-09-20T21:01:12.228540+0000","last_became_peered":"2024-09-20T21:01:12.228540+0000","last_unstale":"2024-09-20T21:01:15.304115+0000","last_undegraded":"2024-09-20T21:01:15.304115+0000","last_fullsized":"2024-09-20T21:01:15.304115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:13.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305796+0000","last_change":"2024-09-20T21:01:11.214247+0000","last_active":"2024-09-20T21:01:15.305796+0000","last_peered":"2024-09-20T21:01:15.305796+0000","last_clean":"2024-09-20T21:01:15.305796+0000","last_became_active":"2024-09-20T21:01:11.212760+0000","last_became_peered":"2024-09-20T21:01:11.212760+0000","last_unstale":"2024-09-20T21:01:15.305796+0000","last_undegraded":"2024-09-20T21:01:15.305796+0000","last_fullsized":"2024-09-20T21:01:15.305796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:20.108703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.303861+0000","last_change":"2024-09-20T21:01:12.238294+0000","last_active":"2024-09-20T21:01:15.303861+0000","last_peered":"2024-09-20T21:01:15.303861+0000","last_clean":"2024-09-20T21:01:15.303861+0000","last_became_active":"2024-09-20T21:01:12.237461+0000","last_became_peered":"2024-09-20T21:01:12.237461+0000","last_unstale":"2024-09-20T21:01:15.303861+0000","last_undegraded":"2024-09-20T21:01:15.303861+0000","last_fullsized":"2024-09-20T21:01:15.303861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:11.215425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986624+0000","last_change":"2024-09-20T21:01:11.221716+0000","last_active":"2024-09-20T21:01:14.986624+0000","last_peered":"2024-09-20T21:01:14.986624+0000","last_clean":"2024-09-20T21:01:14.986624+0000","last_became_active":"2024-09-20T21:01:11.220620+0000","last_became_peered":"2024-09-20T21:01:11.220620+0000","last_unstale":"2024-09-20T21:01:14.986624+0000","last_undegraded":"2024-09-20T21:01:14.986624+0000","last_fullsized":"2024-09-20T21:01:14.986624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:13.593747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985365+0000","last_change":"2024-09-20T21:01:12.210785+0000","last_active":"2024-09-20T21:01:14.985365+0000","last_peered":"2024-09-20T21:01:14.985365+0000","last_clean":"2024-09-20T21:01:14.985365+0000","last_became_active":"2024-09-20T21:01:12.209489+0000","last_became_peered":"2024-09-20T21:01:12.209489+0000","last_unstale":"2024-09-20T21:01:14.985365+0000","last_undegraded":"2024-09-20T21:01:14.985365+0000","last_fullsized":"2024-09-20T21:01:14.985365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986875+0000","last_change":"2024-09-20T21:01:11.217199+0000","last_active":"2024-09-20T21:01:14.986875+0000","last_peered":"2024-09-20T21:01:14.986875+0000","last_clean":"2024-09-20T21:01:14.986875+0000","last_became_active":"2024-09-20T21:01:11.216370+0000","last_became_peered":"2024-09-20T21:01:11.216370+0000","last_unstale":"2024-09-20T21:01:14.986875+0000","last_undegraded":"2024-09-20T21:01:14.986875+0000","last_fullsized":"2024-09-20T21:01:14.986875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824109+0000","last_change":"2024-09-20T21:01:12.220592+0000","last_active":"2024-09-20T21:01:15.824109+0000","last_peered":"2024-09-20T21:01:15.824109+0000","last_clean":"2024-09-20T21:01:15.824109+0000","last_became_active":"2024-09-20T21:01:12.219682+0000","last_became_peered":"2024-09-20T21:01:12.219682+0000","last_unstale":"2024-09-20T21:01:15.824109+0000","last_undegraded":"2024-09-20T21:01:15.824109+0000","last_fullsized":"2024-09-20T21:01:15.824109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824706+0000","last_change":"2024-09-20T21:01:11.220548+0000","last_active":"2024-09-20T21:01:15.824706+0000","last_peered":"2024-09-20T21:01:15.824706+0000","last_clean":"2024-09-20T21:01:15.824706+0000","last_became_active":"2024-09-20T21:01:11.219847+0000","last_became_peered":"2024-09-20T21:01:11.219847+0000","last_unstale":"2024-09-20T21:01:15.824706+0000","last_undegraded":"2024-09-20T21:01:15.824706+0000","last_fullsized":"2024-09-20T21:01:15.824706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985939+0000","last_change":"2024-09-20T21:01:12.211812+0000","last_active":"2024-09-20T21:01:14.985939+0000","last_peered":"2024-09-20T21:01:14.985939+0000","last_clean":"2024-09-20T21:01:14.985939+0000","last_became_active":"2024-09-20T21:01:12.209826+0000","last_became_peered":"2024-09-20T21:01:12.209826+0000","last_unstale":"2024-09-20T21:01:14.985939+0000","last_undegraded":"2024-09-20T21:01:14.985939+0000","last_fullsized":"2024-09-20T21:01:14.985939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:46:41.210017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986629+0000","last_change":"2024-09-20T21:01:11.219106+0000","last_active":"2024-09-20T21:01:14.986629+0000","last_peered":"2024-09-20T21:01:14.986629+0000","last_clean":"2024-09-20T21:01:14.986629+0000","last_became_active":"2024-09-20T21:01:11.218259+0000","last_became_peered":"2024-09-20T21:01:11.218259+0000","last_unstale":"2024-09-20T21:01:14.986629+0000","last_undegraded":"2024-09-20T21:01:14.986629+0000","last_fullsized":"2024-09-20T21:01:14.986629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986094+0000","last_change":"2024-09-20T21:01:12.225987+0000","last_active":"2024-09-20T21:01:14.986094+0000","last_peered":"2024-09-20T21:01:14.986094+0000","last_clean":"2024-09-20T21:01:14.986094+0000","last_became_active":"2024-09-20T21:01:12.222916+0000","last_became_peered":"2024-09-20T21:01:12.222916+0000","last_unstale":"2024-09-20T21:01:14.986094+0000","last_undegraded":"2024-09-20T21:01:14.986094+0000","last_fullsized":"2024-09-20T21:01:14.986094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:16.681572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304200+0000","last_change":"2024-09-20T21:01:11.213371+0000","last_active":"2024-09-20T21:01:15.304200+0000","last_peered":"2024-09-20T21:01:15.304200+0000","last_clean":"2024-09-20T21:01:15.304200+0000","last_became_active":"2024-09-20T21:01:11.212385+0000","last_became_peered":"2024-09-20T21:01:11.212385+0000","last_unstale":"2024-09-20T21:01:15.304200+0000","last_undegraded":"2024-09-20T21:01:15.304200+0000","last_fullsized":"2024-09-20T21:01:15.304200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:56.734999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985452+0000","last_change":"2024-09-20T21:01:12.202841+0000","last_active":"2024-09-20T21:01:14.985452+0000","last_peered":"2024-09-20T21:01:14.985452+0000","last_clean":"2024-09-20T21:01:14.985452+0000","last_became_active":"2024-09-20T21:01:12.201016+0000","last_became_peered":"2024-09-20T21:01:12.201016+0000","last_unstale":"2024-09-20T21:01:14.985452+0000","last_undegraded":"2024-09-20T21:01:14.985452+0000","last_fullsized":"2024-09-20T21:01:14.985452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:55.984268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304606+0000","last_change":"2024-09-20T21:01:11.220785+0000","last_active":"2024-09-20T21:01:15.304606+0000","last_peered":"2024-09-20T21:01:15.304606+0000","last_clean":"2024-09-20T21:01:15.304606+0000","last_became_active":"2024-09-20T21:01:11.220111+0000","last_became_peered":"2024-09-20T21:01:11.220111+0000","last_unstale":"2024-09-20T21:01:15.304606+0000","last_undegraded":"2024-09-20T21:01:15.304606+0000","last_fullsized":"2024-09-20T21:01:15.304606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.621763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824680+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:01:15.824680+0000","last_peered":"2024-09-20T21:01:15.824680+0000","last_clean":"2024-09-20T21:01:15.824680+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:01:15.824680+0000","last_undegraded":"2024-09-20T21:01:15.824680+0000","last_fullsized":"2024-09-20T21:01:15.824680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986367+0000","last_change":"2024-09-20T21:01:02.293432+0000","last_active":"2024-09-20T21:01:14.986367+0000","last_peered":"2024-09-20T21:01:14.986367+0000","last_clean":"2024-09-20T21:01:14.986367+0000","last_became_active":"2024-09-20T21:01:02.291361+0000","last_became_peered":"2024-09-20T21:01:02.291361+0000","last_unstale":"2024-09-20T21:01:14.986367+0000","last_undegraded":"2024-09-20T21:01:14.986367+0000","last_fullsized":"2024-09-20T21:01:14.986367+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:52.935898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986794+0000","last_change":"2024-09-20T21:01:09.031119+0000","last_active":"2024-09-20T21:01:14.986794+0000","last_peered":"2024-09-20T21:01:14.986794+0000","last_clean":"2024-09-20T21:01:14.986794+0000","last_became_active":"2024-09-20T21:01:06.994429+0000","last_became_peered":"2024-09-20T21:01:06.994429+0000","last_unstale":"2024-09-20T21:01:14.986794+0000","last_undegraded":"2024-09-20T21:01:14.986794+0000","last_fullsized":"2024-09-20T21:01:14.986794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:47.585068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025064900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823578+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:01:15.823578+0000","last_peered":"2024-09-20T21:01:15.823578+0000","last_clean":"2024-09-20T21:01:15.823578+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:01:15.823578+0000","last_undegraded":"2024-09-20T21:01:15.823578+0000","last_fullsized":"2024-09-20T21:01:15.823578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986350+0000","last_change":"2024-09-20T21:01:12.224024+0000","last_active":"2024-09-20T21:01:14.986350+0000","last_peered":"2024-09-20T21:01:14.986350+0000","last_clean":"2024-09-20T21:01:14.986350+0000","last_became_active":"2024-09-20T21:01:12.222433+0000","last_became_peered":"2024-09-20T21:01:12.222433+0000","last_unstale":"2024-09-20T21:01:14.986350+0000","last_undegraded":"2024-09-20T21:01:14.986350+0000","last_fullsized":"2024-09-20T21:01:14.986350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:23.486608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.987258+0000","last_change":"2024-09-20T21:01:09.029382+0000","last_active":"2024-09-20T21:01:14.987258+0000","last_peered":"2024-09-20T21:01:14.987258+0000","last_clean":"2024-09-20T21:01:14.987258+0000","last_became_active":"2024-09-20T21:01:06.997340+0000","last_became_peered":"2024-09-20T21:01:06.997340+0000","last_unstale":"2024-09-20T21:01:14.987258+0000","last_undegraded":"2024-09-20T21:01:14.987258+0000","last_fullsized":"2024-09-20T21:01:14.987258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:25:22.179131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081948399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823666+0000","last_change":"2024-09-20T21:01:11.220462+0000","last_active":"2024-09-20T21:01:15.823666+0000","last_peered":"2024-09-20T21:01:15.823666+0000","last_clean":"2024-09-20T21:01:15.823666+0000","last_became_active":"2024-09-20T21:01:11.219778+0000","last_became_peered":"2024-09-20T21:01:11.219778+0000","last_unstale":"2024-09-20T21:01:15.823666+0000","last_undegraded":"2024-09-20T21:01:15.823666+0000","last_fullsized":"2024-09-20T21:01:15.823666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:08.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305546+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:01:15.305546+0000","last_peered":"2024-09-20T21:01:15.305546+0000","last_clean":"2024-09-20T21:01:15.305546+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:01:15.305546+0000","last_undegraded":"2024-09-20T21:01:15.305546+0000","last_fullsized":"2024-09-20T21:01:15.305546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824232+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:01:15.824232+0000","last_peered":"2024-09-20T21:01:15.824232+0000","last_clean":"2024-09-20T21:01:15.824232+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:01:15.824232+0000","last_undegraded":"2024-09-20T21:01:15.824232+0000","last_fullsized":"2024-09-20T21:01:15.824232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304870+0000","last_change":"2024-09-20T21:01:11.217295+0000","last_active":"2024-09-20T21:01:15.304870+0000","last_peered":"2024-09-20T21:01:15.304870+0000","last_clean":"2024-09-20T21:01:15.304870+0000","last_became_active":"2024-09-20T21:01:11.216350+0000","last_became_peered":"2024-09-20T21:01:11.216350+0000","last_unstale":"2024-09-20T21:01:15.304870+0000","last_undegraded":"2024-09-20T21:01:15.304870+0000","last_fullsized":"2024-09-20T21:01:15.304870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:59.661622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824867+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:01:15.824867+0000","last_peered":"2024-09-20T21:01:15.824867+0000","last_clean":"2024-09-20T21:01:15.824867+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:01:15.824867+0000","last_undegraded":"2024-09-20T21:01:15.824867+0000","last_fullsized":"2024-09-20T21:01:15.824867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986806+0000","last_change":"2024-09-20T21:01:09.030841+0000","last_active":"2024-09-20T21:01:14.986806+0000","last_peered":"2024-09-20T21:01:14.986806+0000","last_clean":"2024-09-20T21:01:14.986806+0000","last_became_active":"2024-09-20T21:01:06.994033+0000","last_became_peered":"2024-09-20T21:01:06.994033+0000","last_unstale":"2024-09-20T21:01:14.986806+0000","last_undegraded":"2024-09-20T21:01:14.986806+0000","last_fullsized":"2024-09-20T21:01:14.986806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:57.919077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022137329999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986580+0000","last_change":"2024-09-20T21:01:11.217114+0000","last_active":"2024-09-20T21:01:14.986580+0000","last_peered":"2024-09-20T21:01:14.986580+0000","last_clean":"2024-09-20T21:01:14.986580+0000","last_became_active":"2024-09-20T21:01:11.215974+0000","last_became_peered":"2024-09-20T21:01:11.215974+0000","last_unstale":"2024-09-20T21:01:14.986580+0000","last_undegraded":"2024-09-20T21:01:14.986580+0000","last_fullsized":"2024-09-20T21:01:14.986580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824363+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:01:15.824363+0000","last_peered":"2024-09-20T21:01:15.824363+0000","last_clean":"2024-09-20T21:01:15.824363+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:01:15.824363+0000","last_undegraded":"2024-09-20T21:01:15.824363+0000","last_fullsized":"2024-09-20T21:01:15.824363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986856+0000","last_change":"2024-09-20T21:01:11.217713+0000","last_active":"2024-09-20T21:01:14.986856+0000","last_peered":"2024-09-20T21:01:14.986856+0000","last_clean":"2024-09-20T21:01:14.986856+0000","last_became_active":"2024-09-20T21:01:11.215699+0000","last_became_peered":"2024-09-20T21:01:11.215699+0000","last_unstale":"2024-09-20T21:01:14.986856+0000","last_undegraded":"2024-09-20T21:01:14.986856+0000","last_fullsized":"2024-09-20T21:01:14.986856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:06.986446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824922+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:01:15.824922+0000","last_peered":"2024-09-20T21:01:15.824922+0000","last_clean":"2024-09-20T21:01:15.824922+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:01:15.824922+0000","last_undegraded":"2024-09-20T21:01:15.824922+0000","last_fullsized":"2024-09-20T21:01:15.824922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304465+0000","last_change":"2024-09-20T21:01:12.227746+0000","last_active":"2024-09-20T21:01:15.304465+0000","last_peered":"2024-09-20T21:01:15.304465+0000","last_clean":"2024-09-20T21:01:15.304465+0000","last_became_active":"2024-09-20T21:01:12.226860+0000","last_became_peered":"2024-09-20T21:01:12.226860+0000","last_unstale":"2024-09-20T21:01:15.304465+0000","last_undegraded":"2024-09-20T21:01:15.304465+0000","last_fullsized":"2024-09-20T21:01:15.304465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:02.144980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824585+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:01:15.824585+0000","last_peered":"2024-09-20T21:01:15.824585+0000","last_clean":"2024-09-20T21:01:15.824585+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:01:15.824585+0000","last_undegraded":"2024-09-20T21:01:15.824585+0000","last_fullsized":"2024-09-20T21:01:15.824585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306339+0000","last_change":"2024-09-20T21:01:09.385616+0000","last_active":"2024-09-20T21:01:15.306339+0000","last_peered":"2024-09-20T21:01:15.306339+0000","last_clean":"2024-09-20T21:01:15.306339+0000","last_became_active":"2024-09-20T21:01:07.000811+0000","last_became_peered":"2024-09-20T21:01:07.000811+0000","last_unstale":"2024-09-20T21:01:15.306339+0000","last_undegraded":"2024-09-20T21:01:15.306339+0000","last_fullsized":"2024-09-20T21:01:15.306339+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:03.917240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077098100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304881+0000","last_change":"2024-09-20T21:01:12.227533+0000","last_active":"2024-09-20T21:01:15.304881+0000","last_peered":"2024-09-20T21:01:15.304881+0000","last_clean":"2024-09-20T21:01:15.304881+0000","last_became_active":"2024-09-20T21:01:12.226676+0000","last_became_peered":"2024-09-20T21:01:12.226676+0000","last_unstale":"2024-09-20T21:01:15.304881+0000","last_undegraded":"2024-09-20T21:01:15.304881+0000","last_fullsized":"2024-09-20T21:01:15.304881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825579+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:01:15.825579+0000","last_peered":"2024-09-20T21:01:15.825579+0000","last_clean":"2024-09-20T21:01:15.825579+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:01:15.825579+0000","last_undegraded":"2024-09-20T21:01:15.825579+0000","last_fullsized":"2024-09-20T21:01:15.825579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825452+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:01:15.825452+0000","last_peered":"2024-09-20T21:01:15.825452+0000","last_clean":"2024-09-20T21:01:15.825452+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:01:15.825452+0000","last_undegraded":"2024-09-20T21:01:15.825452+0000","last_fullsized":"2024-09-20T21:01:15.825452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823700+0000","last_change":"2024-09-20T21:01:12.227354+0000","last_active":"2024-09-20T21:01:15.823700+0000","last_peered":"2024-09-20T21:01:15.823700+0000","last_clean":"2024-09-20T21:01:15.823700+0000","last_became_active":"2024-09-20T21:01:12.226078+0000","last_became_peered":"2024-09-20T21:01:12.226078+0000","last_unstale":"2024-09-20T21:01:15.823700+0000","last_undegraded":"2024-09-20T21:01:15.823700+0000","last_fullsized":"2024-09-20T21:01:15.823700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825269+0000","last_change":"2024-09-20T21:01:11.220479+0000","last_active":"2024-09-20T21:01:15.825269+0000","last_peered":"2024-09-20T21:01:15.825269+0000","last_clean":"2024-09-20T21:01:15.825269+0000","last_became_active":"2024-09-20T21:01:11.219658+0000","last_became_peered":"2024-09-20T21:01:11.219658+0000","last_unstale":"2024-09-20T21:01:15.825269+0000","last_undegraded":"2024-09-20T21:01:15.825269+0000","last_fullsized":"2024-09-20T21:01:15.825269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986873+0000","last_change":"2024-09-20T21:01:09.029413+0000","last_active":"2024-09-20T21:01:14.986873+0000","last_peered":"2024-09-20T21:01:14.986873+0000","last_clean":"2024-09-20T21:01:14.986873+0000","last_became_active":"2024-09-20T21:01:06.997186+0000","last_became_peered":"2024-09-20T21:01:06.997186+0000","last_unstale":"2024-09-20T21:01:14.986873+0000","last_undegraded":"2024-09-20T21:01:14.986873+0000","last_fullsized":"2024-09-20T21:01:14.986873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:09:55.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883393,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.303941+0000","last_change":"2024-09-20T21:01:12.228307+0000","last_active":"2024-09-20T21:01:15.303941+0000","last_peered":"2024-09-20T21:01:15.303941+0000","last_clean":"2024-09-20T21:01:15.303941+0000","last_became_active":"2024-09-20T21:01:12.226322+0000","last_became_peered":"2024-09-20T21:01:12.226322+0000","last_unstale":"2024-09-20T21:01:15.303941+0000","last_undegraded":"2024-09-20T21:01:15.303941+0000","last_fullsized":"2024-09-20T21:01:15.303941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:52.194070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985673+0000","last_change":"2024-09-20T21:01:12.220324+0000","last_active":"2024-09-20T21:01:14.985673+0000","last_peered":"2024-09-20T21:01:14.985673+0000","last_clean":"2024-09-20T21:01:14.985673+0000","last_became_active":"2024-09-20T21:01:12.219327+0000","last_became_peered":"2024-09-20T21:01:12.219327+0000","last_unstale":"2024-09-20T21:01:14.985673+0000","last_undegraded":"2024-09-20T21:01:14.985673+0000","last_fullsized":"2024-09-20T21:01:14.985673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:56.030003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986595+0000","last_change":"2024-09-20T21:01:11.221231+0000","last_active":"2024-09-20T21:01:14.986595+0000","last_peered":"2024-09-20T21:01:14.986595+0000","last_clean":"2024-09-20T21:01:14.986595+0000","last_became_active":"2024-09-20T21:01:11.220426+0000","last_became_peered":"2024-09-20T21:01:11.220426+0000","last_unstale":"2024-09-20T21:01:14.986595+0000","last_undegraded":"2024-09-20T21:01:14.986595+0000","last_fullsized":"2024-09-20T21:01:14.986595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822977+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:01:15.822977+0000","last_peered":"2024-09-20T21:01:15.822977+0000","last_clean":"2024-09-20T21:01:15.822977+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:01:15.822977+0000","last_undegraded":"2024-09-20T21:01:15.822977+0000","last_fullsized":"2024-09-20T21:01:15.822977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305982+0000","last_change":"2024-09-20T21:01:11.220027+0000","last_active":"2024-09-20T21:01:15.305982+0000","last_peered":"2024-09-20T21:01:15.305982+0000","last_clean":"2024-09-20T21:01:15.305982+0000","last_became_active":"2024-09-20T21:01:11.218551+0000","last_became_peered":"2024-09-20T21:01:11.218551+0000","last_unstale":"2024-09-20T21:01:15.305982+0000","last_undegraded":"2024-09-20T21:01:15.305982+0000","last_fullsized":"2024-09-20T21:01:15.305982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:47:59.918561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986048+0000","last_change":"2024-09-20T21:01:11.218922+0000","last_active":"2024-09-20T21:01:14.986048+0000","last_peered":"2024-09-20T21:01:14.986048+0000","last_clean":"2024-09-20T21:01:14.986048+0000","last_became_active":"2024-09-20T21:01:11.218028+0000","last_became_peered":"2024-09-20T21:01:11.218028+0000","last_unstale":"2024-09-20T21:01:14.986048+0000","last_undegraded":"2024-09-20T21:01:14.986048+0000","last_fullsized":"2024-09-20T21:01:14.986048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.822895+0000","last_change":"2024-09-20T21:01:12.211553+0000","last_active":"2024-09-20T21:01:15.822895+0000","last_peered":"2024-09-20T21:01:15.822895+0000","last_clean":"2024-09-20T21:01:15.822895+0000","last_became_active":"2024-09-20T21:01:12.210101+0000","last_became_peered":"2024-09-20T21:01:12.210101+0000","last_unstale":"2024-09-20T21:01:15.822895+0000","last_undegraded":"2024-09-20T21:01:15.822895+0000","last_fullsized":"2024-09-20T21:01:15.822895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825324+0000","last_change":"2024-09-20T21:01:11.221867+0000","last_active":"2024-09-20T21:01:15.825324+0000","last_peered":"2024-09-20T21:01:15.825324+0000","last_clean":"2024-09-20T21:01:15.825324+0000","last_became_active":"2024-09-20T21:01:11.220980+0000","last_became_peered":"2024-09-20T21:01:11.220980+0000","last_unstale":"2024-09-20T21:01:15.825324+0000","last_undegraded":"2024-09-20T21:01:15.825324+0000","last_fullsized":"2024-09-20T21:01:15.825324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823018+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:01:15.823018+0000","last_peered":"2024-09-20T21:01:15.823018+0000","last_clean":"2024-09-20T21:01:15.823018+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:01:15.823018+0000","last_undegraded":"2024-09-20T21:01:15.823018+0000","last_fullsized":"2024-09-20T21:01:15.823018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.306640+0000","last_change":"2024-09-20T21:01:12.236819+0000","last_active":"2024-09-20T21:01:15.306640+0000","last_peered":"2024-09-20T21:01:15.306640+0000","last_clean":"2024-09-20T21:01:15.306640+0000","last_became_active":"2024-09-20T21:01:12.233922+0000","last_became_peered":"2024-09-20T21:01:12.233922+0000","last_unstale":"2024-09-20T21:01:15.306640+0000","last_undegraded":"2024-09-20T21:01:15.306640+0000","last_fullsized":"2024-09-20T21:01:15.306640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823315+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:01:15.823315+0000","last_peered":"2024-09-20T21:01:15.823315+0000","last_clean":"2024-09-20T21:01:15.823315+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:01:15.823315+0000","last_undegraded":"2024-09-20T21:01:15.823315+0000","last_fullsized":"2024-09-20T21:01:15.823315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.824535+0000","last_change":"2024-09-20T21:01:12.227395+0000","last_active":"2024-09-20T21:01:15.824535+0000","last_peered":"2024-09-20T21:01:15.824535+0000","last_clean":"2024-09-20T21:01:15.824535+0000","last_became_active":"2024-09-20T21:01:12.226122+0000","last_became_peered":"2024-09-20T21:01:12.226122+0000","last_unstale":"2024-09-20T21:01:15.824535+0000","last_undegraded":"2024-09-20T21:01:15.824535+0000","last_fullsized":"2024-09-20T21:01:15.824535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.823918+0000","last_change":"2024-09-20T21:01:11.220367+0000","last_active":"2024-09-20T21:01:15.823918+0000","last_peered":"2024-09-20T21:01:15.823918+0000","last_clean":"2024-09-20T21:01:15.823918+0000","last_became_active":"2024-09-20T21:01:11.219090+0000","last_became_peered":"2024-09-20T21:01:11.219090+0000","last_unstale":"2024-09-20T21:01:15.823918+0000","last_undegraded":"2024-09-20T21:01:15.823918+0000","last_fullsized":"2024-09-20T21:01:15.823918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305423+0000","last_change":"2024-09-20T21:01:12.238895+0000","last_active":"2024-09-20T21:01:15.305423+0000","last_peered":"2024-09-20T21:01:15.305423+0000","last_clean":"2024-09-20T21:01:15.305423+0000","last_became_active":"2024-09-20T21:01:12.235481+0000","last_became_peered":"2024-09-20T21:01:12.235481+0000","last_unstale":"2024-09-20T21:01:15.305423+0000","last_undegraded":"2024-09-20T21:01:15.305423+0000","last_fullsized":"2024-09-20T21:01:15.305423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304734+0000","last_change":"2024-09-20T21:01:11.217493+0000","last_active":"2024-09-20T21:01:15.304734+0000","last_peered":"2024-09-20T21:01:15.304734+0000","last_clean":"2024-09-20T21:01:15.304734+0000","last_became_active":"2024-09-20T21:01:11.216073+0000","last_became_peered":"2024-09-20T21:01:11.216073+0000","last_unstale":"2024-09-20T21:01:15.304734+0000","last_undegraded":"2024-09-20T21:01:15.304734+0000","last_fullsized":"2024-09-20T21:01:15.304734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:23:30.512126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305358+0000","last_change":"2024-09-20T21:01:12.232371+0000","last_active":"2024-09-20T21:01:15.305358+0000","last_peered":"2024-09-20T21:01:15.305358+0000","last_clean":"2024-09-20T21:01:15.305358+0000","last_became_active":"2024-09-20T21:01:12.231450+0000","last_became_peered":"2024-09-20T21:01:12.231450+0000","last_unstale":"2024-09-20T21:01:15.305358+0000","last_undegraded":"2024-09-20T21:01:15.305358+0000","last_fullsized":"2024-09-20T21:01:15.305358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305184+0000","last_change":"2024-09-20T21:01:11.218440+0000","last_active":"2024-09-20T21:01:15.305184+0000","last_peered":"2024-09-20T21:01:15.305184+0000","last_clean":"2024-09-20T21:01:15.305184+0000","last_became_active":"2024-09-20T21:01:11.217722+0000","last_became_peered":"2024-09-20T21:01:11.217722+0000","last_unstale":"2024-09-20T21:01:15.305184+0000","last_undegraded":"2024-09-20T21:01:15.305184+0000","last_fullsized":"2024-09-20T21:01:15.305184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:11:02.101254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.985035+0000","last_change":"2024-09-20T21:01:12.212994+0000","last_active":"2024-09-20T21:01:14.985035+0000","last_peered":"2024-09-20T21:01:14.985035+0000","last_clean":"2024-09-20T21:01:14.985035+0000","last_became_active":"2024-09-20T21:01:12.211080+0000","last_became_peered":"2024-09-20T21:01:12.211080+0000","last_unstale":"2024-09-20T21:01:14.985035+0000","last_undegraded":"2024-09-20T21:01:14.985035+0000","last_fullsized":"2024-09-20T21:01:14.985035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986320+0000","last_change":"2024-09-20T21:01:11.217211+0000","last_active":"2024-09-20T21:01:14.986320+0000","last_peered":"2024-09-20T21:01:14.986320+0000","last_clean":"2024-09-20T21:01:14.986320+0000","last_became_active":"2024-09-20T21:01:11.216428+0000","last_became_peered":"2024-09-20T21:01:11.216428+0000","last_unstale":"2024-09-20T21:01:14.986320+0000","last_undegraded":"2024-09-20T21:01:14.986320+0000","last_fullsized":"2024-09-20T21:01:14.986320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986366+0000","last_change":"2024-09-20T21:01:12.214965+0000","last_active":"2024-09-20T21:01:14.986366+0000","last_peered":"2024-09-20T21:01:14.986366+0000","last_clean":"2024-09-20T21:01:14.986366+0000","last_became_active":"2024-09-20T21:01:12.211534+0000","last_became_peered":"2024-09-20T21:01:12.211534+0000","last_unstale":"2024-09-20T21:01:14.986366+0000","last_undegraded":"2024-09-20T21:01:14.986366+0000","last_fullsized":"2024-09-20T21:01:14.986366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.305711+0000","last_change":"2024-09-20T21:01:11.220332+0000","last_active":"2024-09-20T21:01:15.305711+0000","last_peered":"2024-09-20T21:01:15.305711+0000","last_clean":"2024-09-20T21:01:15.305711+0000","last_became_active":"2024-09-20T21:01:11.219022+0000","last_became_peered":"2024-09-20T21:01:11.219022+0000","last_unstale":"2024-09-20T21:01:15.305711+0000","last_undegraded":"2024-09-20T21:01:15.305711+0000","last_fullsized":"2024-09-20T21:01:15.305711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.928114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.304479+0000","last_change":"2024-09-20T21:01:12.238819+0000","last_active":"2024-09-20T21:01:15.304479+0000","last_peered":"2024-09-20T21:01:15.304479+0000","last_clean":"2024-09-20T21:01:15.304479+0000","last_became_active":"2024-09-20T21:01:12.237939+0000","last_became_peered":"2024-09-20T21:01:12.237939+0000","last_unstale":"2024-09-20T21:01:15.304479+0000","last_undegraded":"2024-09-20T21:01:15.304479+0000","last_fullsized":"2024-09-20T21:01:15.304479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825078+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:01:15.825078+0000","last_peered":"2024-09-20T21:01:15.825078+0000","last_clean":"2024-09-20T21:01:15.825078+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:01:15.825078+0000","last_undegraded":"2024-09-20T21:01:15.825078+0000","last_fullsized":"2024-09-20T21:01:15.825078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:14.986017+0000","last_change":"2024-09-20T21:01:12.213562+0000","last_active":"2024-09-20T21:01:14.986017+0000","last_peered":"2024-09-20T21:01:14.986017+0000","last_clean":"2024-09-20T21:01:14.986017+0000","last_became_active":"2024-09-20T21:01:12.210781+0000","last_became_peered":"2024-09-20T21:01:12.210781+0000","last_unstale":"2024-09-20T21:01:14.986017+0000","last_undegraded":"2024-09-20T21:01:14.986017+0000","last_fullsized":"2024-09-20T21:01:14.986017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T21:01:15.825003+0000","last_change":"2024-09-20T21:01:11.222738+0000","last_active":"2024-09-20T21:01:15.825003+0000","last_peered":"2024-09-20T21:01:15.825003+0000","last_clean":"2024-09-20T21:01:15.825003+0000","last_became_active":"2024-09-20T21:01:11.221990+0000","last_became_peered":"2024-09-20T21:01:11.221990+0000","last_unstale":"2024-09-20T21:01:15.825003+0000","last_undegraded":"2024-09-20T21:01:15.825003+0000","last_fullsized":"2024-09-20T21:01:15.825003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":258048,"data_stored":655436,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":270336,"data_stored":656071,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:01:23.830 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-20T21:01:23.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-20T21:01:24.154 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 20 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:fsid 095c2509-1828-40cb-9515-44c079c52d3b 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-20T21:00:50.259405+0000 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-20T21:01:14.979294+0000 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:crush_version 4 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:full_ratio 0.95 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:backfillfull_ratio 0.9 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:nearfull_ratio 0.85 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:require_min_compat_client luminous 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:min_compat_client jewel 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:require_osd_release squid 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:stretch_mode_enabled false 2024-09-20T21:01:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-20T21:01:24.156 INFO:teuthology.orchestra.run.smithi112.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-20T21:01:24.156 INFO:teuthology.orchestra.run.smithi112.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-20T21:01:24.156 INFO:teuthology.orchestra.run.smithi112.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-20T21:01:24.156 INFO:teuthology.orchestra.run.smithi112.stdout:max_osd 3 2024-09-20T21:01:24.156 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6800/2576994201,v1:172.21.15.139:6801/2576994201] [v2:172.21.15.139:6802/2576994201,v1:172.21.15.139:6803/2576994201] exists,up 238496db-6b3e-463e-90eb-e476e93f06e3 2024-09-20T21:01:24.156 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.161:6800/2769075992,v1:172.21.15.161:6801/2769075992] [v2:172.21.15.161:6802/2769075992,v1:172.21.15.161:6803/2769075992] exists,up 5e46dfeb-5456-40e0-b0a3-d85993becaef 2024-09-20T21:01:24.156 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6800/1237842363,v1:172.21.15.203:6801/1237842363] [v2:172.21.15.203:6802/1237842363,v1:172.21.15.203:6803/1237842363] exists,up f5e294ac-6f79-4615-93d7-8870379d28e4 2024-09-20T21:01:24.172 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6800/2576994201,v1:172.21.15.139:6801/2576994201] [v2:172.21.15.139:6802/2576994201,v1:172.21.15.139:6803/2576994201] exists,up 238496db-6b3e-463e-90eb-e476e93f06e3', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.161:6800/2769075992,v1:172.21.15.161:6801/2769075992] [v2:172.21.15.161:6802/2769075992,v1:172.21.15.161:6803/2769075992] exists,up 5e46dfeb-5456-40e0-b0a3-d85993becaef', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6800/1237842363,v1:172.21.15.203:6801/1237842363] [v2:172.21.15.203:6802/1237842363,v1:172.21.15.203:6803/1237842363] exists,up f5e294ac-6f79-4615-93d7-8870379d28e4'] 2024-09-20T21:01:24.172 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-20T21:01:24.279 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-20T21:01:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mon.a", 2024-09-20T21:01:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster": "ceph", 2024-09-20T21:01:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-20T21:01:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "admin_socket_mode": "", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_client_required": "cephx, none", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_cluster_required": "cephx", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_debug": "true", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_service_required": "cephx", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_supported": "cephx", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_aio": "true", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-20T21:01:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_aio_poll_ms": "250", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_aio_reap_max": "16", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_async_discard": "false", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_block_size": "4096", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_debug_aio": "false", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_debug_inflight_ios": "false", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_enable_discard": "false", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_flock_retry": "3", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_inject_crash": "0", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_ioring": "false", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_ioring_hipri": "false", 2024-09-20T21:01:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_type": "", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_alloc_size": "1048576", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_allocator": "hybrid", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_buffered_io": "true", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_check_for_zeros": "false", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_compact_log_sync": "false", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-20T21:01:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_max_log_runway": "4194304", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_max_prefetch": "1048576", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_min_flush_size": "524288", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_min_log_runway": "1048576", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_replay_recovery": "false", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_sync_write": "false", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-20T21:01:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_allocation_from_file": "true", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_allocator": "hybrid", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bdev_label_multi": "true", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-20T21:01:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_create": "true", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_db_create": "false", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_db_path": "", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_db_size": "0", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_path": "", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_preallocate_file": "false", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_size": "107374182400", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_wal_create": "false", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_wal_path": "", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_wal_size": "100663296", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bluefs": "true", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-20T21:01:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_autotune": "true", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_size": "0", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-20T21:01:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_type": "2q", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_clone_cow": "true", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_mode": "none", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-20T21:01:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_csum_type": "crc32c", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_freelist": "false", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-20T21:01:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_small_allocations": "0", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_default_buffered_read": "true", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_default_buffered_write": "false", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fail_eio": "false", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-20T21:01:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_mount": "false", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_umount": "false", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-20T21:01:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_ignore_data_csum": "false", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_log_op_age": "5.000000", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_alloc_size": "0", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_blob_size": "0", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_deferred_txc": "32", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_min_alloc_size": "0", 2024-09-20T21:01:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_nid_prealloc": "1024", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_retry_disk_reads": "3", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_rocksdb_cf": "true", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-20T21:01:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_spdk_mem": "512", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_tracing": "false", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-20T21:01:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_zero_block_detection": "false", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-20T21:01:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_cluster_require_signatures": "false", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_cluster_require_version": "2", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_require_signatures": "false", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_require_version": "2", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_service_require_signatures": "false", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_service_require_version": "2", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_sign_messages": "true", 2024-09-20T21:01:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "chdir": "", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_acl_type": "", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_asio_thread_count": "2", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_cache_mid": "0.750000", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_cache_size": "16384", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_caps_release_delay": "5", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_check_pool_perm": "true", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_debug_force_sync_read": "false", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_debug_getattr_caps": "false", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_debug_inject_features": "", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_debug_inject_tick_delay": "0", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_die_on_failed_remount": "false", 2024-09-20T21:01:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_dirsize_rbytes": "true", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_force_lazyio": "false", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_fs": "", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_inject_release_failure": "false", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_max_inline_size": "4096", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_mds_namespace": "", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_metadata": "", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_mount_gid": "-1", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_mount_timeout": "300", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_mount_uid": "-1", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_mountpoint": "/", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_notify_timeout": "10", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc": "true", 2024-09-20T21:01:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc_max_dirty": "104857600", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc_max_objects": "1000", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc_size": "209715200", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc_target_dirty": "8388608", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_permissions": "true", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_quota": "true", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_quota_df": "true", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_readahead_max_bytes": "0", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_readahead_max_periods": "4", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_readahead_min": "131072", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_reconnect_stale": "false", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_shutdown_timeout": "30", 2024-09-20T21:01:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_snapdir": ".snap", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_tick_interval": "1", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_trace": "", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_try_dentry_invalidate": "false", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_use_faked_inos": "false", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_use_random_mds": "false", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_graylog": "false", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_graylog_port": "12201", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_monitors": "default=true", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_syslog": "false", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_syslog_level": "info", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "-", 2024-09-20T21:01:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_network": "", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_network_interface": "", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "compressor_zlib_isal": "false", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "compressor_zlib_level": "5", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "compressor_zlib_winsize": "-15", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "compressor_zstd_level": "1", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_alien_op_num_threads": "6", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_osd_stat_interval": "0", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_seastar_cpu_cores": "", 2024-09-20T21:01:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_seastar_num_threads": "0", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_location": "", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_location_hook": "", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_location_hook_timeout": "10", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "daemonize": "false", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "daos_pool": "tank", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_alienstore": "0/5", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_allow_any_pool_priority": "false", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_asok": "1/5", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_asok_assert_abort": "false", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_asserts_on_shutdown": "true", 2024-09-20T21:01:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_auth": "20/20", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_bdev": "1/3", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_bluefs": "1/5", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_bluestore": "1/5", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_buffer": "0/1", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_ceph_exporter": "1/5", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_cephfs_mirror": "0/5", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_cephsqlite": "0/5", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_client": "0/5", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_compressor": "1/5", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_context": "0/1", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_crimson_interrupt": "0/5", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_crush": "1/1", 2024-09-20T21:01:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_crypto": "1/5", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_cyanstore": "0/5", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_deliberately_leak_memory": "false", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_disable_randomized_ping": "false", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_dpdk": "1/5", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_eventtrace": "1/5", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_filer": "0/1", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_filestore": "1/3", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_finisher": "1/1", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_fuse": "1/5", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_heartbeat_testing_span": "0", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_heartbeatmap": "1/5", 2024-09-20T21:01:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_javaclient": "1/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_journal": "1/3", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_journaler": "0/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_kstore": "1/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_lockdep": "0/1", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mclock": "1/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds": "1/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_balancer": "1/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_locker": "1/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_log": "1/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_log_expire": "1/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_migrator": "1/5", 2024-09-20T21:01:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_quiesce": "3/5", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_memstore": "1/5", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mgr": "2/5", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mgrc": "1/5", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mon": "20/20", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_monc": "0/10", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_ms": "1/1", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_none": "0/5", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_objclass": "0/5", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_objectcacher": "0/5", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_objecter": "0/1", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_optracker": "0/5", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_osd": "1/5", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_paxos": "20/20", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_perfcounter": "1/5", 2024-09-20T21:01:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_prioritycache": "1/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rados": "0/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rbd": "0/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rbd_mirror": "0/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rbd_pwl": "0/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rbd_replay": "0/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_refs": "0/0", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_reserver": "1/1", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw": "1/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_access": "1/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_datacache": "1/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_dbstore": "1/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_flight": "1/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-20T21:01:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_sync": "1/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rocksdb": "4/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_backref": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_cache": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_cleaner": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_device": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_epm": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_journal": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_lba": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_odata": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_omap": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_onode": "0/5", 2024-09-20T21:01:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_t": "0/5", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_tm": "0/5", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_striper": "0/1", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_test": "0/5", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_throttle": "1/1", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_timer": "0/1", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_tp": "0/5", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_trace": "1/5", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "device_failure_prediction_mode": "none", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "err_to_graylog": "false", 2024-09-20T21:01:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "err_to_journald": "false", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "err_to_stderr": "true", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "err_to_syslog": "false", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event_tracing": "false", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_addr": "0.0.0.0", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_http_port": "9926", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_prio_limit": "5", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_sort_metrics": "true", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_stats_period": "5", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "fake_statfs_for_testing": "0", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "fatal_signal_handlers": "true", 2024-09-20T21:01:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "filer_max_purge_ops": "10", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filer_max_truncate_ops": "128", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_apply_finisher_threads": "1", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_blackhole": "false", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_btrfs_clone_range": "true", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_btrfs_snap": "true", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_caller_concurrency": "10", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_collect_device_partition_information": "true", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_commit_timeout": "600.000000", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_debug_inject_read_err": "false", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_debug_omap_check": "false", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_debug_verify_split": "false", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_dump_file": "", 2024-09-20T21:01:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-20T21:01:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-20T21:01:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fadvise": "true", 2024-09-20T21:01:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fail_eio": "true", 2024-09-20T21:01:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fd_cache_shards": "16", 2024-09-20T21:01:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fd_cache_size": "128", 2024-09-20T21:01:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fiemap": "false", 2024-09-20T21:01:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fiemap_threshold": "4096", 2024-09-20T21:01:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-20T21:01:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-20T21:01:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_inject_stall": "0", 2024-09-20T21:01:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_journal_parallel": "false", 2024-09-20T21:01:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_journal_trailing": "false", 2024-09-20T21:01:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_journal_writeahead": "false", 2024-09-20T21:01:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_kill_at": "0", 2024-09-20T21:01:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-20T21:01:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-20T21:01:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-20T21:01:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-20T21:01:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-20T21:01:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattrs": "0", 2024-09-20T21:01:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-20T21:01:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-20T21:01:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-20T21:01:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-20T21:01:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_xattr_value_size": "0", 2024-09-20T21:01:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_merge_threshold": "-10", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_odsync_write": "false", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_omap_backend": "rocksdb", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_omap_backend_path": "", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_op_thread_timeout": "60", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_op_threads": "2", 2024-09-20T21:01:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_punch_hole": "false", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_max_ops": "50", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_seek_data_hole": "false", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_sloppy_crc": "false", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-20T21:01:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_splice": "false", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_split_multiple": "2", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_split_rand_factor": "20", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_update_to": "1000", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_enable": "true", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-20T21:01:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_xfs_extsize": "false", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_zfs_snap": "false", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fio_dir": "/tmp/fio", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "095c2509-1828-40cb-9515-44c079c52d3b", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_allow_other": "true", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_atomic_o_trunc": "true", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_big_writes": "true", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_debug": "false", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_default_permissions": "false", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_disable_pagecache": "false", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_max_write": "0", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_multithreaded": "true", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_require_active_mds": "true", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_set_user_groups": "true", 2024-09-20T21:01:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_splice_move": "true", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_splice_read": "true", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_splice_write": "true", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_use_invalidate_cb": "true", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "gss_target_name": "ceph", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_file": "", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_inject_failure": "0", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_interval": "5", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "host": "smithi112", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-20T21:01:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "inject_early_sigterm": "false", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "jaeger_agent_port": "6799", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "jaeger_tracing_enable": "false", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_aio": "true", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_align_min_size": "65536", 2024-09-20T21:01:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_block_align": "true", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_block_size": "4096", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_dio": "true", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_discard": "false", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_force_aio": "false", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_ignore_corruption": "false", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_max_write_bytes": "10485760", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_max_write_entries": "100", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_replay_from": "0", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_write_header_frequency": "0", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_zero_on_create": "false", 2024-09-20T21:01:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "journaler_prefetch_periods": "10", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "journaler_prezero_periods": "5", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "journaler_write_head_interval": "15", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "keyfile": "", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_backend": "rocksdb", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_default_stripe_size": "65536", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_fsck_on_mount": "false", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_max_bytes": "67108864", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_max_ops": "512", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_nid_prealloc": "1024", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_onode_map_size": "1024", 2024-09-20T21:01:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_sync_submit_transaction": "false", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_sync_transaction": "false", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "librados_thread_count": "2", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "lockdep": "false", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "lockdep_force_backtrace": "false", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "log_coarse_timestamps": "true", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "log_flush_on_exit": "false", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "log_graylog_host": "127.0.0.1", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "log_graylog_port": "12201", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "log_max_new": "1000", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "log_max_recent": "10000", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "log_stderr_prefix": "", 2024-09-20T21:01:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "log_stop_at_utilization": "0.970000", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": "true", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_graylog": "false", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_journald": "false", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_stderr": "false", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_syslog": "false", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "max_rotating_auth_attempts": "10", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_action_on_write_error": "1", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_alternate_name_max": "8192", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_asio_thread_count": "2", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_export_pin": "true", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_fragment_dirs": "true", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_fragment_interval": "5", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-20T21:01:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_interval": "10", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_max": "-1", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_max_until": "-1", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_merge_size": "50", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_midchunk": "0.300000", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_min_start": "0.200000", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_minchunk": "0.001000", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_mode": "0", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_need_max": "1.200000", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_need_min": "0.800000", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_overload_epochs": "2", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-20T21:01:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_split_bits": "3", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_split_size": "10000", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_target_decay": "10.000000", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_beacon_grace": "15.000000", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_beacon_interval": "4.000000", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_mid": "0.700000", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_quiesce_delay": "0", 2024-09-20T21:01:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_release_free_interval": "10", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_reservation": "0.050000", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_trim_interval": "1", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_trim_threshold": "262144", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_client_prealloc_inos": "1000", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-20T21:01:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_connect_bootstrapping": "false", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_damage_table_max_entries": "10000", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_debug_auth_pins": "false", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_debug_frag": "false", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_debug_scatterstat": "false", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_debug_subtrees": "false", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_decay_halflife": "5.000000", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_default_dir_hash": "2", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_defer_session_stale": "true", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_deny_all_reconnect": "false", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dir_keys_per_op": "16384", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dir_max_commit_size": "10", 2024-09-20T21:01:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dir_max_entries": "0", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dir_prefetch": "true", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dump_cache_on_map": "false", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_early_reply": "true", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_enable_op_tracker": "true", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_enforce_unique_name": "true", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_export_ephemeral_random": "true", 2024-09-20T21:01:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_health_summarize_threshold": "10", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_health_dummy": "false", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_migrator_session_race": "false", 2024-09-20T21:01:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_join_fs": "", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_journal_format": "1", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_create_at": "0", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_export_at": "0", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_import_at": "0", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_journal_at": "0", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_journal_expire_at": "0", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_journal_replay_at": "0", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_link_at": "0", 2024-09-20T21:01:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_mdstable_at": "0", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_openc_at": "0", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_rename_at": "0", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_shutdown_at": "0", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_event_large_threshold": "524288", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_events_per_segment": "1024", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_max_events": "-1", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_max_segments": "128", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_pause": "false", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_segment_size": "0", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-20T21:01:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_trim_threshold": "128", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_warn_factor": "2.000000", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_caps_per_client": "1048576", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_completed_flushes": "100000", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_completed_requests": "100000", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_export_size": "20971520", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_file_recover": "32", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_purge_files": "64", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_purge_ops": "8192", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_snaps_per_dir": "100", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_metrics_update_interval": "2", 2024-09-20T21:01:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_min_caps_per_client": "100", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_min_caps_working_set": "10000", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_numa_node": "-1", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_complaint_time": "30.000000", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_history_duration": "600", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_history_size": "20", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_history_slow_op_size": "20", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_log_threshold": "5", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_ping_grace": "15", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_ping_interval": "5", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-20T21:01:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_max_caps": "30000", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_warning_threshold": "262144", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_replay_interval": "1.000000", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_root_ino_gid": "0", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_root_ino_uid": "0", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-20T21:01:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_shutdown_check": "0", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_skip_ino": "0", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_snap_max_uid": "4294967294", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_snap_min_uid": "0", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_snap_rstat": "false", 2024-09-20T21:01:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_standby_replay_damaged": "false", 2024-09-20T21:01:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_symlink_recovery": "true", 2024-09-20T21:01:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-20T21:01:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_thrash_exports": "0", 2024-09-20T21:01:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_thrash_fragments": "0", 2024-09-20T21:01:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_tick_interval": "5.000000", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_valgrind_exit": "false", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_verify_backtrace": "1", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_verify_scatter": "false", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_wipe_sessions": "false", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool_debug": "false", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "memstore_device_bytes": "1073741824", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "memstore_page_set": "false", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "memstore_page_size": "65536", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_client_bytes": "134217728", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_client_messages": "512", 2024-09-20T21:01:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_disabled_modules": "", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_enable_op_tracker": "true", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_max_pg_num_change": "128", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_mds_bytes": "134217728", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_mds_messages": "128", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_mon_bytes": "134217728", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_mon_messages": "128", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-20T21:01:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_history_duration": "600", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_history_size": "20", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_log_threshold": "5", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_osd_bytes": "536870912", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_osd_messages": "8192", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_pool": "true", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_standby_modules": "true", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_stats_period": "5", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_stats_threshold": "5", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_tick_period": "2", 2024-09-20T21:01:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_allow_pool_delete": "true", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_allow_pool_size_one": "true", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_auth_validate_all_caps": "true", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_bytes": "104857600", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_directed_command_retry": "2", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_hunt_parallel": "3", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_log_interval": "1.000000", 2024-09-20T21:01:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_ping_interval": "10.000000", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_target_rank": "-1", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_file_level": "debug", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_file": "true", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_journald": "false", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-20T21:01:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_compact_on_bootstrap": "false", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_compact_on_start": "false", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_compact_on_trim": "true", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cpu_threads": "4", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_crush_min_required_version": "hammer", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_daemon_bytes": "419430400", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-20T21:01:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_data_avail_crit": "5", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_data_avail_warn": "5", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_data_size_warn": "16106127360", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_dump_json": "false", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_dump_transactions": "false", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_extra_checks": "false", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_no_require_reef": "false", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_no_require_squid": "false", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-20T21:01:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_down_mkfs_grace": "120", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_down_uptime_grace": "60", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_election_default_strategy": "1", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_election_timeout": "5.000000", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_elector_ping_divisor": "2", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_enable_op_tracker": "true", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_fake_pool_delete": "false", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_force_quorum_join": "false", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_globalid_prealloc": "10000", 2024-09-20T21:01:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_detail_to_clog": "false", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_log_update_period": "5", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_max_detail": "50", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_to_clog": "true", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_to_clog_interval": "600", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_host": "172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790],[v2:172.21.15.112:3302,v1:172.21.15.112:6791]", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_host_override": "", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_initial_members": "", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-20T21:01:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_lease": "5.000000", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_log_full_interval": "50", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_log_max": "10000", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_log_max_summary": "50", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_log_epochs": "500", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_osd": "10000", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_pg_per_osd": "10000", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_pool_pg_num": "65536", 2024-09-20T21:01:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mds_force_trim_to": "0", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mds_skip_sanity": "false", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_memory_autotune": "true", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_memory_target": "2147483648", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_beacon_grace": "30", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_digest_period": "5", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_inactive_grace": "60", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_min_osdmap_epochs": "500", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_complaint_time": "30", 2024-09-20T21:01:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_history_duration": "600", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_history_size": "20", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_history_slow_op_size": "20", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_log_threshold": "5", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_auto_mark_in": "false", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_cache_size": "500", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-20T21:01:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_down_out_interval": "600", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_force_trim_to": "0", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_min_down_reporters": "2", 2024-09-20T21:01:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_report_timeout": "900", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-20T21:01:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_stuck_threshold": "60", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_probe_timeout": "2.000000", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_reweight_max_change": "0.050000", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_reweight_max_osds": "4", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-20T21:01:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_scrub_interval": "86400", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_scrub_max_keys": "100", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_scrub_timeout": "300", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_session_timeout": "300", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_smart_report_timeout": "5", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_stat_smooth_intervals": "6", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_stretch_pool_min_size": "2", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_stretch_pool_size": "4", 2024-09-20T21:01:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_debug": "false", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_provider_kill_at": "0", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_requester_kill_at": "0", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_timeout": "60.000000", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_target_pg_per_osd": "100", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_tick_interval": "5", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_timecheck_interval": "300.000000", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_use_min_delay_socket": "false", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_older_version_delay": "604800", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-20T21:01:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_misplaced": "false", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_older_version": "true", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-20T21:01:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "monmap": "", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-20T21:01:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_tracing_enabled": "false", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_op_threads": "3", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_cm": "false", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_device_name": "", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_dscp": "96", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_local_gid": "", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_port_num": "1", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-20T21:01:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_sl": "3", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_support_srq": "true", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_type": "ib", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_reap_threshold": "5", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_before_connect": "false", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_ipv4": "true", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_ipv6": "false", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_msgr1": "true", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_msgr2": "true", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_port_max": "7568", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_port_min": "6800", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-20T21:01:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_retry_count": "3", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_retry_delay": "5", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_blackhole_client": "false", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_blackhole_mds": "false", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_blackhole_mgr": "false", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_blackhole_mon": "false", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_blackhole_osd": "false", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_client_mode": "crc secure", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_cluster_mode": "crc secure", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_cluster_type": "", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_compress_secure": "false", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_connection_idle_timeout": "900", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_connection_ready_timeout": "10", 2024-09-20T21:01:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_crc_data": "true", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_crc_header": "true", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_die_on_bad_msg": "false", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_die_on_bug": "true", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_die_on_old_message": "true", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_die_on_skipped_message": "false", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_coremask": "0xF", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_enable_tso": "true", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-20T21:01:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_hugepages": "", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_lro": "true", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_memory_channel": "4", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_pmd": "", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_port_id": "0", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dump_on_send": "false", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_initial_backoff": "0.200000", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_delay_max": "1.000000", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-20T21:01:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_delay_type": "", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_network_congestion": "0", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_socket_failures": "0", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_learn_addr_from_peer": "true", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_max_accept_failures": "4", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_max_backoff": "15.000000", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_mon_client_mode": "secure crc", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_mon_service_mode": "secure crc", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_osd_compress_min_size": "1024", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_osd_compress_mode": "none", 2024-09-20T21:01:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_pq_min_cost": "65536", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_public_type": "", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_service_mode": "crc secure", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_tcp_listen_backlog": "512", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_tcp_nodelay": "true", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_tcp_rcvbuf": "0", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_type": "async+posix", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "no_config_file": "false", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_completion_locks_per_session": "32", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-20T21:01:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_inflight_ops": "1024", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_tick_interval": "5.000000", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_timeout": "10.000000", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "objectstore_blackhole": "false", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "openssl_engine_opts": "", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_delay_time": "5.000000", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_hist_halflife": "1000", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_max_low_ops": "2", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_max_ops": "4", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-20T21:01:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_slop": "0.020000", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_asio_thread_count": "2", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_async_recovery_min_cost": "100", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backfill_scan_max": "512", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backfill_scan_min": "64", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backoff_on_degraded": "false", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backoff_on_peering": "false", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backoff_on_unfound": "true", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_beacon_report_interval": "300", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bench_duration": "30", 2024-09-20T21:01:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bench_max_block_size": "67108864", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_blkin_trace_all": "false", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_check_for_log_corruption": "false", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_class_update_on_start": "true", 2024-09-20T21:01:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_client_message_cap": "256", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_client_message_size_cap": "524288000", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_client_op_priority": "63", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_client_watch_timeout": "30", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_command_max_records": "256", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_compact_on_start": "false", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_crush_update_on_start": "true", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_crush_update_weight_set": "true", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-20T21:01:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_feed_pullee": "-1", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_misdirected_ops": "false", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_no_acting_change": "false", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_no_purge_strays": "false", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_op_order": "false", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-20T21:01:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_shutdown": "false", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_trim_objects": "false", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_verify_snaps": "false", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_keys": "1024", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-20T21:01:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_stride": "524288", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_default_notify_timeout": "30", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_delete_sleep": "0.000000", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_discard_disconnected_ops": "true", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_enable_op_tracker": "true", 2024-09-20T21:01:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_fast_info": "true", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_fast_shutdown": "true", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_function_tracing": "false", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_grace": "20", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_interval": "6", 2024-09-20T21:01:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_min_peers": "10", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_min_size": "2000", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_stale": "600", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_hit_set_max_size": "100000", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_hit_set_min_size": "1000", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-20T21:01:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_journal_size": "5120", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_kill_backfill_at": "0", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_map_cache_size": "50", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_map_dedup": "true", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_map_message_max": "40", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_map_share_max_epochs": "40", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_attr_name_len": "100", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_attr_size": "0", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_backfills": "1", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_markdown_count": "5", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_markdown_period": "600", 2024-09-20T21:01:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_object_name_len": "2048", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_object_namespace_len": "256", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_object_size": "134217728", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_pg_blocked_by": "16", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_pg_log_entries": "10000", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_pgls": "1024", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_push_cost": "8388608", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_push_objects": "10", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_scrubs": "3", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_trimming_pgs": "2", 2024-09-20T21:01:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_write_op_reply_len": "64", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_write_size": "90", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_profile": "balanced", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-20T21:01:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_base": "805306368", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_cache_min": "134217728", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-20T21:01:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_target": "4294967296", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_target_autotune": "false", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_min_pg_log_entries": "250", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_min_recovery_priority": "0", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mon_report_interval": "5", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_num_cache_shards": "32", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_num_op_tracker_shard": "32", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_numa_auto_affinity": "true", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_numa_node": "-1", 2024-09-20T21:01:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_numa_prefer_iface": "true", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_objecter_finishers": "1", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_objectstore": "bluestore", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_objectstore_fuse": "false", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_objectstore_tracing": "false", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_complaint_time": "30.000000", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_history_duration": "600", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_history_size": "20", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_history_slow_op_size": "20", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_log_threshold": "5", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_shards": "0", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_shards_hdd": "5", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_shards_ssd": "8", 2024-09-20T21:01:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_pq_min_cost": "65536", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_queue_cut_off": "high", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_thread_timeout": "15", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_open_classes_on_start": "true", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_os_flags": "0", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_peering_op_priority": "255", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_delete_cost": "1048576", 2024-09-20T21:01:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_delete_priority": "5", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_log_trim_max": "10000", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_log_trim_min": "100", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-20T21:01:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_crimson": "false", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flags": "0", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_min_size": "0", 2024-09-20T21:01:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_pg_num": "32", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_pgp_num": "0", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_read_ratio": "70", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_size": "2", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_type": "replicated", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_push_per_object_cost": "1000", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recover_clone_overlap": "true", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-20T21:01:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_cost": "20971520", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_active": "0", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_single_start": "1", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_op_priority": "3", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_priority": "5", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_sleep": "0.000000", 2024-09-20T21:01:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_repair_during_recovery": "false", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_requested_scrub_priority": "120", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_auto_repair": "false", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_begin_hour": "0", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_begin_week_day": "0", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_chunk_max": "25", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_chunk_min": "5", 2024-09-20T21:01:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_cost": "52428800", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_during_recovery": "false", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_end_hour": "0", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_end_week_day": "0", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_event_cost": "4096", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_invalid_stats": "true", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_max_preemptions": "5", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_priority": "5", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_sleep": "0.000000", 2024-09-20T21:01:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_skip_data_digest": "false", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_smart_report_timeout": "5", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_cost": "1048576", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_priority": "5", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-20T21:01:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_target_transaction_size": "30", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-20T21:01:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tracing": "false", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_use_stale_snap": "false", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "osdc_blkin_trace_all": "false", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_kill_at": "0", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_max_join_drift": "10", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_min": "500", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_min_wait": "0.050000", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_propose_interval": "1.000000", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_service_trim_max": "500", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_service_trim_min": "250", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_stash_full_interval": "25", 2024-09-20T21:01:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_trim_max": "500", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_trim_min": "250", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "perf": "true", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "-", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrv": "", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "public_bind_addr": "-", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "public_network": "", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "public_network_interface": "", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "qat_compressor_busy_polling": "false", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "qat_compressor_enabled": "false", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "qat_compressor_session_max_number": "256", 2024-09-20T21:01:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "rados_mon_op_timeout": "0", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rados_osd_op_timeout": "0", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rados_tracing": "false", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_atime_update_interval": "60", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_balance_parent_reads": "false", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_balance_snap_reads": "false", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_blkin_trace_all": "false", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache": "true", 2024-09-20T21:01:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-20T21:01:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-20T21:01:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-20T21:01:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-20T21:01:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_policy": "writearound", 2024-09-20T21:01:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_size": "33554432", 2024-09-20T21:01:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-20T21:01:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-20T21:01:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_clone_copy_on_read": "false", 2024-09-20T21:01:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_compression_hint": "none", 2024-09-20T21:01:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_concurrent_management_ops": "10", 2024-09-20T21:01:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-20T21:01:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_clone_format": "auto", 2024-09-20T21:01:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_data_pool": "", 2024-09-20T21:01:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_features": "61", 2024-09-20T21:01:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_format": "2", 2024-09-20T21:01:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_map_options": "", 2024-09-20T21:01:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_order": "22", 2024-09-20T21:01:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_pool": "rbd", 2024-09-20T21:01:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-20T21:01:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_stripe_count": "0", 2024-09-20T21:01:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_stripe_unit": "0", 2024-09-20T21:01:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-20T21:01:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_enable_alloc_hint": "true", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_io_scheduler": "simple", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-20T21:01:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_order": "24", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_pool": "", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_splay_width": "4", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_localize_parent_reads": "false", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_localize_snap_reads": "false", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-20T21:01:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-20T21:01:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mtime_update_interval": "60", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_non_blocking_aio": "true", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_op_thread_timeout": "60", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_op_threads": "1", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_parent_cache_enabled": "false", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-20T21:01:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_plugins": "", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_bps_burst": "0", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_bps_limit": "0", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_exclude_ops": "0", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_iops_burst": "0", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_iops_limit": "0", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-20T21:01:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_read_from_replica_policy": "default", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-20T21:01:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_skip_partial_discard": "true", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_tracing": "false", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_validate_names": "true", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_validate_pool": "true", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "restapi_base_url": "", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "restapi_log_level": "", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_acl_grants_max_num": "100", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_admin_entry": "admin", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_backend_store": "rados", 2024-09-20T21:01:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_barbican_url": "", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_beast_enable_async": "true", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_counters_cache": "false", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_cache_enabled": "true", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_cache_expiry_interval": "900", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_cache_lru_size": "25000", 2024-09-20T21:01:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_config_store": "rados", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_content_length_compat": "false", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_copy_obj_progress": "true", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_cors_rules_max_num": "100", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_cross_domain_policy": "", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_addr": "", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_password": "", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_username": "", 2024-09-20T21:01:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_require_ssl": "true", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-20T21:01:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_addr": "", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_auth": "token", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_namespace": "", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_prefix": "", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_token_file": "", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-20T21:01:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_curl_buffersize": "524288", 2024-09-20T21:01:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-20T21:01:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_curl_low_speed_time": "300", 2024-09-20T21:01:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-20T21:01:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-20T21:01:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-20T21:01:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-20T21:01:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-20T21:01:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-20T21:01:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-20T21:01:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-20T21:01:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-20T21:01:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-20T21:01:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-20T21:01:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d4n_port": "6379", 2024-09-20T21:01:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-20T21:01:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_log_changes_size": "1000", 2024-09-20T21:01:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_log_num_shards": "128", 2024-09-20T21:01:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-20T21:01:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_log_window": "30", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-20T21:01:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dns_name": "", 2024-09-20T21:01:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dns_s3website_name": "", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dynamic_resharding": "true", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_gc_threads": "true", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_lc_threads": "true", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_ops_log": "false", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_quota_threads": "true", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_static_website": "false", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_usage_log": "false", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enforce_swift_acls": "true", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_exit_timeout_secs": "120", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_expose_bucket": "false", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_extended_http_attrs": "", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_filter": "none", 2024-09-20T21:01:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_frontends": "beast port=7480", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_deferred": "50", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_objs": "32", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_processor_period": "3600", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-20T21:01:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_init_timeout": "300", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_kafka_connection_idle": "300", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_domain": "", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_password": "", 2024-09-20T21:01:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_password_path": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_project": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_tenant": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_token": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_token_path": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_user": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_api_version": "2", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_barbican_domain": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_barbican_password": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_barbican_project": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_barbican_user": "", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-20T21:01:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_url": "", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_debug_interval": "-1", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_lock_max_time": "90", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_max_objs": "32", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_max_rules": "1000", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_max_worker": "3", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_thread_delay": "0", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_dnattr": "uid", 2024-09-20T21:01:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_searchfilter": "", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_uri": "", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_log_http_headers": "", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_log_object_name_utc": "false", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_attr_name_len": "0", 2024-09-20T21:01:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_attr_size": "0", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_chunk_size": "4194304", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_listing_results": "1000", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_notify_retries": "10", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_put_param_size": "1048576", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_put_size": "5368709120", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_slo_entries": "1000", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_md_log_max_shards": "64", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-20T21:01:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_mp_lock_max_time": "600", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_max_gc": "300", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-20T21:01:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_num_async_rados_threads": "32", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_num_control_oids": "8", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_numa_node": "-1", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_objexp_chunk_size": "100", 2024-09-20T21:01:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_objexp_gc_interval": "600", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_op_thread_timeout": "600", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_op_tracing": "false", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_opa_token": "", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_opa_url": "", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_opa_verify_ssl": "true", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ops_log_rados": "false", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ops_log_socket_path": "", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-20T21:01:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_period_push_interval": "2.000000", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_cache_lanes": "3", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_cache_partitions": "3", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_print_continue": "true", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-20T21:01:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_rados_tracing": "false", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_realm": "", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_realm_id": "", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_region": "", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-20T21:01:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_request_uri": "", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_batch_size": "64", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_max_aio": "128", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_num_logs": "16", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_thread_interval": "600", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_resolve_cname": "false", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_run_sync_thread": "true", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-20T21:01:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_scheduler_type": "throttler", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_script_uri": "", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_service_provider_name": "", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_client_id": "", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_client_secret": "", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_entry": "sts", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_key": "sts", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_min_session_duration": "900", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_token_introspection_url": "", 2024-09-20T21:01:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_account_in_url": "false", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_auth_entry": "auth", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_auth_url": "", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_custom_header": "", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_need_stats": "true", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_tenant_name": "", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_token_expiration": "86400", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_url": "", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_url_prefix": "swift", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_lease_period": "120", 2024-09-20T21:01:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_thread_pool_size": "512", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_comment": "", 2024-09-20T21:01:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_createby": "", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_encoding": "", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_flag": "false", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_origin": "", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_tracker": "", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_trust_forwarded_https": "false", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_usage_max_shards": "32", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_usage_max_user_shards": "1", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_use_opa_authz": "false", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_counters_cache": "false", 2024-09-20T21:01:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_max_buckets": "1000", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_policies_max_num": "100", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_unique_email": "true", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_verify_ssl": "true", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zone": "", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zone_id": "", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-20T21:01:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zonegroup": "", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zonegroup_id": "", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rgwlc_auto_session_clear": "true", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_block_size": "4096", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_size": "536870912", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-20T21:01:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_index_type": "binary_search", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_partition_filters": "false", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_perf": "false", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-20T21:01:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "run_dir": "/var/run/ceph", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_block_create": "true", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_cache_lru_size": "67108864", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_default_max_object_size": "16777216", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_device_size": "53687091200", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_full_integrity_check": "false", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_journal_batch_capacity": "16", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-20T21:01:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_main_device_type": "SSD", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_segment_size": "67108864", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "set_keepcaps": "false", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "setgroup": "", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "setuser": "", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "setuser_match_path": "", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "thp": "false", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "threadpool_default_timeout": "60", 2024-09-20T21:01:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-20T21:01:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: "throttler_perf_counter": "true" 2024-09-20T21:01:24.430 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-20T21:01:24.432 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-20T21:01:24.570 INFO:teuthology.orchestra.run.smithi112.stdout:mon.a: {} 2024-09-20T21:01:24.570 INFO:teuthology.orchestra.run.smithi112.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T21:01:24.579 INFO:teuthology.orchestra.run.smithi112.stdout:mon.b: {} 2024-09-20T21:01:24.579 INFO:teuthology.orchestra.run.smithi112.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T21:01:24.588 INFO:teuthology.orchestra.run.smithi112.stdout:mon.c: {} 2024-09-20T21:01:24.588 INFO:teuthology.orchestra.run.smithi112.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T21:01:24.606 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-20T21:01:24.606 INFO:teuthology.run_tasks:Running task radosbench... 2024-09-20T21:01:24.617 INFO:tasks.radosbench:Beginning radosbench... 2024-09-20T21:01:24.617 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-20T21:01:24.617 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-20T21:01:24.617 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-20T21:01:24.618 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T21:01:24.618 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:01:24.618 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-20T21:01:24.618 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.000000 2024-09-20T21:01:24.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0 2024-09-20T21:01:24.618 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-20T21:01:24.619 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-20T21:01:24.619 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:01:24.619 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-20T21:01:24.619 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:24.620 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-20T21:01:24.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:01:24.621 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:24.621+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:24.721 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:24.721+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:24.753 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:01:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-20T21:01:24.754 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:24.768 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:24.769 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:24.788 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:24.788 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:24.809 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:24.809 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:24.821 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:24.818+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:24.891 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:24.891 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:24.905 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:24.922 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:24.921+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:25.023 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:25.021+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:25.068 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:25.068 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:25.083 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:25.124 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:25.122+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:25.165 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:01:25.165 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'unique_pool_0' created 2024-09-20T21:01:25.166 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.1 primary-affinity to 0 (802) 2024-09-20T21:01:25.198 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-20T21:01:25.220 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:25.220 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:25.224 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:25.222+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:25.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:25.325 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:25.325+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:25.357 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:25.357 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:25.372 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:25.426 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:25.425+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:25.493 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:25.493 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:25.507 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:25.526 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:25.525+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:25.627 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:25.625+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:25.639 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:25.639 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:25.653 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:25.728 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:25.725+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:25.773 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:25.773 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:25.787 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:25.828 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:25.829+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:25.929 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:25.926+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:25.952 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:25.952 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:25.966 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:26.030 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:26.029+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:26.098 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:26.098 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:26.113 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:26.131 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:26.129+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:26.160 INFO:teuthology.orchestra.run.smithi112.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-20T21:01:26.232 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:26.229+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:26.238 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:26.238 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:26.253 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:26.333 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:26.333+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:26.373 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:26.373 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:26.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:26.434 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:26.433+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:26.519 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:26.520 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:26.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:26.535 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:26.534+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:26.636 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:26.634+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:26.650 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:26.650 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:26.664 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:26.737 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:26.734+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:26.785 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:26.785 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:26.799 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:26.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:01:26.838 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:26.834+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:26.932 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:26.932 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:26.939 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:26.937+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:26.947 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:26.990 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:26.990 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:27.011 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:27.011 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:27.029 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:27.030 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:27.040 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:27.037+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:27.112 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:27.112 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:01:27.112 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:01:27.113 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:01:27.113 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:27.127 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:27.141 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:27.141+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:27.187 DEBUG:teuthology.orchestra.run.smithi112:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-09-20T21:01:27.189 INFO:teuthology.run_tasks:Running task admin_socket... 2024-09-20T21:01:27.200 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-09-20T21:01:27.200 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-09-20T21:01:27.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T21:01:27.238 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:hints = 1 2024-09-20T21:01:27.238 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-09-20T21:01:27.238 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Object prefix: benchmark_data_smithi112_23632 2024-09-20T21:01:27.239 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-20T21:01:27.239 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 0 0 0 0 0 0 - 0 2024-09-20T21:01:27.242 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:27.241+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:27.250 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4173.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:02.809533+0000", 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.440350909999999, 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0091038290000000008, 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.251 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.809533+0000", 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.809533+0000", 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.809534+0000", 2024-09-20T21:01:27.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.809561+0000", 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6959999999999999e-05 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.809577+0000", 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5406000000000001e-05 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.809586+0000", 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3999999999999998e-06 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.811118+0000", 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001532285 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.811220+0000", 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000101739 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.818472+0000", 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0072519029999999996 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.818637+0000", 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000165219 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4173.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:02.810048+0000", 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.439836394, 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0086791590000000005, 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810048+0000", 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810048+0000", 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810049+0000", 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-07 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810056+0000", 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.593e-06 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810073+0000", 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6214000000000001e-05 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810081+0000", 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8429999999999999e-06 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.811793+0000", 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001711789 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.811831+0000", 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7914000000000003e-05 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.818641+0000", 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0068102969999999999 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.818727+0000", 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5709000000000002e-05 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.259 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4173.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:02.810549+0000", 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.439335424999999, 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0082820830000000008, 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810549+0000", 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810549+0000", 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810550+0000", 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.144e-06 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810616+0000", 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6248999999999995e-05 2024-09-20T21:01:27.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810632+0000", 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5627000000000001e-05 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.810642+0000", 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7929999999999992e-06 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.812452+0000", 2024-09-20T21:01:27.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018098820000000001 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.812488+0000", 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6363999999999999e-05 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.818734+0000", 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0062459710000000003 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.818831+0000", 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7052999999999994e-05 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4173.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'85)", 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:02.811219+0000", 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.438665582999999, 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077460059999999997, 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.811219+0000", 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.811219+0000", 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.811220+0000", 2024-09-20T21:01:27.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.037e-06 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.811227+0000", 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8199999999999999e-06 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.811245+0000", 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7918999999999999e-05 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.811253+0000", 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4200000000000007e-06 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.813696+0000", 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024433480000000001 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.813740+0000", 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3259e-05 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.818834+0000", 2024-09-20T21:01:27.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050948579999999999 2024-09-20T21:01:27.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:02.818965+0000", 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000130345 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.053812955, 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.269 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.270 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:01:27.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:01:27.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:01:27.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.053722919, 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.275 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:01:27.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.053636566, 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:01:27.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:01:27.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.053567757, 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:27.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:27.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.053534897, 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:01:27.292 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:01:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:27.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:27.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:27.298 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.05349288, 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:27.304 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.053367774, 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:01:27.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:01:27.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:01:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.053275425000001, 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:27.311 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:01:27.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:01:27.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:01:27.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.053191053000001, 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:01:27.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.200636+0000", 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.049248273, 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0098493710000000009, 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200636+0000", 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200636+0000", 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200637+0000", 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7599999999999996e-07 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200684+0000", 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7342999999999997e-05 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200712+0000", 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7716999999999999e-05 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200730+0000", 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7833e-05 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200863+0000", 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013310199999999999 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200912+0000", 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.871e-05 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.210396+0000", 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0094848699999999994 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.210485+0000", 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9019999999999998e-05 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.324 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.200776+0000", 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.049107900999999, 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01033588, 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200776+0000", 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200776+0000", 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200777+0000", 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200786+0000", 2024-09-20T21:01:27.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6729999999999998e-06 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200808+0000", 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2235999999999999e-05 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2476999999999999e-05 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200920+0000", 2024-09-20T21:01:27.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9376000000000005e-05 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.200965+0000", 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4852999999999999e-05 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.211026+0000", 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010061123 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.211112+0000", 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6441999999999997e-05 2024-09-20T21:01:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(mds.0.3:19 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.203930+0000", 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.045954172, 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.013241541000000001, 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203930+0000", 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203930+0000", 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203932+0000", 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.703e-06 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203946+0000", 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.419e-05 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204093+0000", 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000146706 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204151+0000", 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7902000000000002e-05 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.205739+0000", 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001587818 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.205793+0000", 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4472999999999998e-05 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217075+0000", 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01128154 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217172+0000", 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7208999999999997e-05 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.206196+0000", 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.043687976999999, 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.013467636999999999, 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206196+0000", 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206196+0000", 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206197+0000", 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3399999999999997e-07 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206243+0000", 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5266000000000003e-05 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206275+0000", 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2712999999999997e-05 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206446+0000", 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017021199999999999 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213268+0000", 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0068228239999999999 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213315+0000", 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6334000000000001e-05 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219529+0000", 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0062142949999999999 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219664+0000", 2024-09-20T21:01:27.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013505900000000001 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(mds.0.3:31 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.206698+0000", 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.043186554, 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.012952636999999999, 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206698+0000", 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206698+0000", 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206699+0000", 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.237e-06 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206712+0000", 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3206e-05 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206735+0000", 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.3223000000000001e-05 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.206769+0000", 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3370000000000001e-05 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212084+0000", 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0053148900000000001 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212821+0000", 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00073686800000000001 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219542+0000", 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006721327 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219650+0000", 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108516 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.207450+0000", 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.042434843000001, 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.012300915000000001, 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.207450+0000", 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.207450+0000", 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.207450+0000", 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1399999999999996e-07 2024-09-20T21:01:27.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.207486+0000", 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5333000000000002e-05 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.207508+0000", 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2589e-05 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.207529+0000", 2024-09-20T21:01:27.343 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0423000000000001e-05 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213904+0000", 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0063749080000000003 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213951+0000", 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7017000000000001e-05 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219671+0000", 2024-09-20T21:01:27.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0057205850000000003 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219750+0000", 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9246000000000007e-05 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.213888+0000", 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.035996642000001, 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0082390499999999995, 2024-09-20T21:01:27.345 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213888+0000", 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213888+0000", 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:27.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213888+0000", 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0299999999999999e-07 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213906+0000", 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7586000000000001e-05 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213927+0000", 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0903999999999998e-05 2024-09-20T21:01:27.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213938+0000", 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1643e-05 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217119+0000", 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003180422 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:27.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217178+0000", 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9225999999999998e-05 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222082+0000", 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0049038629999999996 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222127+0000", 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4802999999999998e-05 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.349 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.350 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.350 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:27.350 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:27.350 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:27.351 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:27.352 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:27.350+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:27.452 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:27.449+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:27.526 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:790 5.a 5:51df567d:::benchmark_data_smithi112_23632_object789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.524967+0000", 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0019809469999999998, 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0020091390000000001, 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 790 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524967+0000", 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524967+0000", 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524968+0000", 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.879999999999999e-07 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.525049+0000", 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0952999999999996e-05 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.525064+0000", 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4112e-05 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.525073+0000", 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1090000000000004e-06 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.525112+0000", 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9255999999999998e-05 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.525200+0000", 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7888999999999998e-05 2024-09-20T21:01:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.525288+0000", 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8103000000000007e-05 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.525789+0000", 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050102600000000001 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:792 5.b e23/21 5:d335ad67:::benchmark_data_smithi112_23632_object791:head v 23'52, mlcod=23'50)", 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.526812+0000", 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00013654499999999999, 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025234900000000002, 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.526812+0000", 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.526812+0000", 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.526812+0000", 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.32e-07 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.526881+0000", 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8272e-05 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.526887+0000", 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9099999999999999e-06 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.526891+0000", 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6739999999999999e-06 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.526921+0000", 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0103999999999998e-05 2024-09-20T21:01:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.526933+0000", 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2094e-05 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:788 5.5 5:ad14b71d:::benchmark_data_smithi112_23632_object787:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.524186+0000", 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0027619709999999998, 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002940794, 2024-09-20T21:01:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 788 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524186+0000", 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524186+0000", 2024-09-20T21:01:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524187+0000", 2024-09-20T21:01:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1100000000000004e-07 2024-09-20T21:01:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524261+0000", 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3302999999999999e-05 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524272+0000", 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1268e-05 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524280+0000", 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8180000000000004e-06 2024-09-20T21:01:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524328+0000", 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8387000000000003e-05 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524484+0000", 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015556599999999999 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.524625+0000", 2024-09-20T21:01:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014166999999999999 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.525214+0000", 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058906300000000002 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 3 2024-09-20T21:01:27.540 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:27.552 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:27.552 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:27.550+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:27.652 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:27.650+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:27.753 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:27.750+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:27.763 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:27.763 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:01:27.763 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:01:27.763 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:01:27.763 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:27.787 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:27.879 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:27.878+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:27.955 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:27.953+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:28.004 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:28.004 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:01:28.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:01:28.004 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:28.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.004 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.808438170000001, 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:01:28.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:01:28.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.808303971000001, 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:28.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:01:28.016 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.808198965000001, 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:01:28.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.80807944, 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.023 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:01:28.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:01:28.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.808009433, 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:01:28.029 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:01:28.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:01:28.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:28.035 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.807934381000001, 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:28.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:01:28.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:01:28.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.041 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.807847355, 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:01:28.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:01:28.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:28.046 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.807778581999999, 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:28.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:01:28.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.807692322999999, 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:01:28.051 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:01:28.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:28.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:14.194332+0000", 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.808337651, 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011114007, 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194332+0000", 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194332+0000", 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194335+0000", 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5459999999999998e-06 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194365+0000", 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0260000000000002e-05 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194398+0000", 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3266999999999998e-05 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194414+0000", 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5603e-05 2024-09-20T21:01:28.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194553+0000", 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013937199999999999 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194564+0000", 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.028e-05 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.202513+0000", 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079495050000000008 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.202769+0000", 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000255825 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.202938+0000", 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016944599999999999 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.204180+0000", 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012415900000000001 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.205292+0000", 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001112385 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.205376+0000", 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3312000000000005e-05 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.205446+0000", 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0616000000000003e-05 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:150 5.b e23/21 5:df921fd3:::benchmark_data_smithi112_23632_object149:head v 23'6, mlcod=23'3)", 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.308461+0000", 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.69420842400000005, 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011677892, 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.062 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308461+0000", 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308461+0000", 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308463+0000", 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.812e-06 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308544+0000", 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0655999999999995e-05 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308565+0000", 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1433999999999998e-05 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308581+0000", 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5948999999999999e-05 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308709+0000", 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012737299999999999 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308797+0000", 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8510000000000005e-05 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.314294+0000", 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054968810000000003 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320139+0000", 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058452770000000003 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.066 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:154 5.5 5:af193f12:::benchmark_data_smithi112_23632_object153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.308896+0000", 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.69377347099999997, 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010345696, 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 154 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308896+0000", 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308896+0000", 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308898+0000", 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.683e-06 2024-09-20T21:01:28.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308963+0000", 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4535999999999993e-05 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309009+0000", 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6557000000000002e-05 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309026+0000", 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.696e-05 2024-09-20T21:01:28.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.312072+0000", 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030456889999999999 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.312409+0000", 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033695699999999998 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.312823+0000", 2024-09-20T21:01:28.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041390699999999998 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.316861+0000", 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0040387330000000001 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.319074+0000", 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022126730000000001 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.319158+0000", 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4386000000000001e-05 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.319242+0000", 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3615000000000005e-05 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:152 5.e e23/21 5:74bf54a6:::benchmark_data_smithi112_23632_object151:head v 23'9, mlcod=23'7)", 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.309093+0000", 2024-09-20T21:01:28.072 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.69357660899999996, 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011031946000000001, 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309093+0000", 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309093+0000", 2024-09-20T21:01:28.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309095+0000", 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7600000000000001e-06 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309160+0000", 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4916e-05 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309180+0000", 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9811999999999999e-05 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309192+0000", 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2680999999999999e-05 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309334+0000", 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014111899999999999 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309372+0000", 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8858e-05 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.313987+0000", 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046144259999999996 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320125+0000", 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061383740000000003 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.076 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:155 5.e e23/21 5:73cbff94:::benchmark_data_smithi112_23632_object154:head v 23'10, mlcod=23'7)", 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.309661+0000", 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.693008501, 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010523219, 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309661+0000", 2024-09-20T21:01:28.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309661+0000", 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309663+0000", 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.725e-06 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309733+0000", 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9444999999999997e-05 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309754+0000", 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1880000000000001e-05 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309829+0000", 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4981999999999995e-05 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309930+0000", 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010101400000000001 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309965+0000", 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4585000000000002e-05 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320132+0000", 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010166557999999999 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320185+0000", 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3029999999999999e-05 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:158 5.c 5:3efd5b0b:::benchmark_data_smithi112_23632_object157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310204+0000", 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.69246593499999998, 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010689961, 2024-09-20T21:01:28.081 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 158 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310204+0000", 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310204+0000", 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310206+0000", 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9939999999999999e-06 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310310+0000", 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103762 2024-09-20T21:01:28.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310337+0000", 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7330000000000001e-05 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310356+0000", 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8563000000000002e-05 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310458+0000", 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102433 2024-09-20T21:01:28.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310707+0000", 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024893499999999999 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311042+0000", 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033517699999999998 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320526+0000", 2024-09-20T21:01:28.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094839360000000001 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320560+0000", 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4165000000000002e-05 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320724+0000", 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016423300000000001 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320894+0000", 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000169433 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159 5.a 5:5db82723:::benchmark_data_smithi112_23632_object158:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.69227634299999996, 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015345846, 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.087 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310395+0000", 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.48e-06 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310489+0000", 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4293e-05 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310510+0000", 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1073e-05 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310554+0000", 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3797000000000001e-05 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310670+0000", 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115442 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311025+0000", 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035569399999999999 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311335+0000", 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030994099999999999 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322334+0000", 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010998888 2024-09-20T21:01:28.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325578+0000", 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032433850000000001 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325667+0000", 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9127000000000002e-05 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325739+0000", 2024-09-20T21:01:28.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2725999999999995e-05 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:160 5.2 5:4b3a9c63:::benchmark_data_smithi112_23632_object159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310595+0000", 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.69207513799999998, 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011877560000000001, 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:28.093 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310595+0000", 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310595+0000", 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310596+0000", 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5370000000000001e-06 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310680+0000", 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.365e-05 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310701+0000", 2024-09-20T21:01:28.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1389000000000001e-05 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310717+0000", 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5943e-05 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310809+0000", 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1699000000000004e-05 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311080+0000", 2024-09-20T21:01:28.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271446 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311360+0000", 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027989600000000002 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.316431+0000", 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0050703650000000003 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322304+0000", 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058737920000000001 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322398+0000", 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3460000000000003e-05 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322472+0000", 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4382999999999996e-05 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:157 5.4 e23/21 5:2a681351:::benchmark_data_smithi112_23632_object156:head v 23'9, mlcod=23'7)", 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.69203738100000001, 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015433034, 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310634+0000", 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6959999999999999e-06 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310717+0000", 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3245999999999995e-05 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310740+0000", 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2957000000000001e-05 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310757+0000", 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6646e-05 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320083+0000", 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0093255790000000005 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320124+0000", 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1635999999999999e-05 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325970+0000", 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058456879999999999 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.326066+0000", 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5586000000000003e-05 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:164 5.0 e23/21 5:09907a96:::benchmark_data_smithi112_23632_object163:head v 23'16, mlcod=23'14)", 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.312972+0000", 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.68969822700000005, 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012082229, 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.312972+0000", 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.312972+0000", 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.312978+0000", 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8050000000000001e-06 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.313036+0000", 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7328999999999999e-05 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.313062+0000", 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6359e-05 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.313100+0000", 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7762999999999997e-05 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320098+0000", 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069984349999999999 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320141+0000", 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3022000000000002e-05 2024-09-20T21:01:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.324978+0000", 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048368939999999996 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325054+0000", 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5622000000000002e-05 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.107 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:308 5.a 5:5458a5ac:::benchmark_data_smithi112_23632_object307:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.368801+0000", 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.63386885000000004, 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010828058999999999, 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 308 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368801+0000", 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368801+0000", 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368802+0000", 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1990000000000001e-06 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368844+0000", 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1782000000000001e-05 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368856+0000", 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1848000000000001e-05 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368864+0000", 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5290000000000008e-06 2024-09-20T21:01:28.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.369873+0000", 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010089389999999999 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.370014+0000", 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014098299999999999 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.370235+0000", 2024-09-20T21:01:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022038599999999999 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.371632+0000", 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013970950000000001 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.379547+0000", 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079153629999999999 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:28.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.379600+0000", 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3235000000000001e-05 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.379629+0000", 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.87e-05 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:28.113 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:28.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:28.115 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:28.113+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:28.183 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-20T21:01:28.207 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'squid'} 2024-09-20T21:01:28.207 DEBUG:teuthology.orchestra.run.smithi112:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=squid' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-20T21:01:28.215 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:28.214+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:28.239 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 1 16 3593 3577 223.55 223.562 0.00435443 0.00445855 2024-09-20T21:01:28.274 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:3714 5.7 e24/21 5:ef80df98:::benchmark_data_smithi112_23632_object3713:head v 24'204, mlcod=24'202)", 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:28.274206+0000", 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00088385299999999998, 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00093733300000000005, 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.275 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274206+0000", 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274206+0000", 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274206+0000", 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.2300000000000001e-07 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.276 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274268+0000", 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.2124000000000004e-05 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274287+0000", 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8964999999999999e-05 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274292+0000", 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1039999999999998e-06 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274342+0000", 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0019999999999999e-05 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274354+0000", 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1826e-05 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.278 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:3715 5.3 e24/21 5:c2a4428d:::benchmark_data_smithi112_23632_object3714:head v 24'252, mlcod=24'250)", 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:28.274320+0000", 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00076901499999999995, 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00099506599999999996, 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274320+0000", 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.279 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274320+0000", 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274321+0000", 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.4799999999999999e-07 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274350+0000", 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9666999999999999e-05 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.280 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274356+0000", 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.0090000000000004e-06 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274361+0000", 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.1420000000000003e-06 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274412+0000", 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1437000000000002e-05 2024-09-20T21:01:28.281 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274433+0000", 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0962999999999999e-05 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:3716 5.5 e24/21 5:a665fde1:::benchmark_data_smithi112_23632_object3715:head v 24'243, mlcod=24'241)", 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:28.274490+0000", 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.000599487, 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00092541699999999999, 2024-09-20T21:01:28.282 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274490+0000", 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274490+0000", 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274490+0000", 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.3000000000000001e-07 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274562+0000", 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1582999999999995e-05 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274569+0000", 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.2910000000000002e-06 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.284 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274580+0000", 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0426e-05 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274644+0000", 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.4208000000000006e-05 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274668+0000", 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.4244e-05 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.285 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:3717 5.c e24/21 5:388d968d:::benchmark_data_smithi112_23632_object3716:head v 24'217, mlcod=24'215)", 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:28.274674+0000", 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00041582700000000002, 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00082390199999999995, 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.286 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274674+0000", 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274674+0000", 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274674+0000", 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1600000000000001e-07 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.287 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274743+0000", 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.9017999999999995e-05 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274750+0000", 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.9789999999999996e-06 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274756+0000", 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.7270000000000004e-06 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.288 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274804+0000", 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.8547999999999997e-05 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.274819+0000", 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4477999999999999e-05 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.289 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:3719 5.5 e24/21 5:a759b961:::benchmark_data_smithi112_23632_object3718:head v 24'244, mlcod=24'241)", 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:28.275316+0000", 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 4294967295.9997735, 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027318500000000001, 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.275316+0000", 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.290 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.275316+0000", 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.275317+0000", 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1800000000000005e-07 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.275390+0000", 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.3481999999999999e-05 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.275403+0000", 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3013000000000001e-05 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.275409+0000", 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.614e-06 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.275473+0000", 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.4145000000000003e-05 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.293 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:28.275497+0000", 2024-09-20T21:01:28.293 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.4457e-05 2024-09-20T21:01:28.293 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.293 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.293 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.293 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.293 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:01:28.293 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 5 2024-09-20T21:01:28.293 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:28.294 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:28.337 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:28.337+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:28.417 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:28.417+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:28.437 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:28.437 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:01:28.437 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:01:28.437 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:01:28.437 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:28.458 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:28.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-09-20T21:01:28.553 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:28.553+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:28.619 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:28.617+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:28.657 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 26.692951561000001, 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.658 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:28.659 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.660 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.661 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:01:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:01:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.664 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 25.687956787000001, 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.665 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:01:28.666 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.667 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.670 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.460017391000001, 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.671 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.672 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:01:28.673 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.674 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.675 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.459870171999999, 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.676 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:01:28.677 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.678 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.679 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.680 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.459744239999999, 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.683 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.684 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:01:28.685 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.686 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.459659643999998, 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.688 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.689 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:01:28.690 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.692 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.459342042999999, 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.693 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:01:28.694 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.695 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.696 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.697 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.459240327, 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.699 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.700 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:01:28.701 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:01:28.702 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.703 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.459159731, 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.704 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:01:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.707 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.708 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.459082665, 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.709 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.710 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.711 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:01:28.712 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:01:28.713 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.714 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.458871197000001, 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.715 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:01:28.716 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.717 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.718 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:01:28.719 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.45879536, 2024-09-20T21:01:28.720 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.721 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:01:28.722 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.723 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.724 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.725 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.458673298000001, 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.726 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.727 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.728 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:01:28.729 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:01:28.730 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.458605048999999, 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:01:28.731 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.732 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.733 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:01:28.734 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:01:28.735 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.736 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.458512262999999, 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.737 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:01:28.738 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.739 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.740 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.458450407000001, 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:01:28.742 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.743 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.744 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:01:28.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.747 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.458368030999999, 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:28.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.749 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.750 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:01:28.751 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:01:28.752 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.458283471000001, 2024-09-20T21:01:28.753 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:28.754 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.755 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.756 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:01:28.757 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.458219565, 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.759 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.760 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.761 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:01:28.762 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:01:28.763 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.764 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 16.458156821999999, 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.765 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.766 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.767 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:28.768 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:28.770 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:28.769+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5459, 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.6a416dd3", 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5458", 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5458", 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.771307s", 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003999964, 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.685856+0000", 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5463, 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.c13b1bc6", 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5462", 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5462", 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.687962+0000", 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5464, 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.1a2d68a3", 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5463", 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5463", 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.687976+0000", 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5446, 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.93118d69", 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5445", 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5445", 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.771307s", 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003999964, 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.684213+0000", 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5452, 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.2e7a332d", 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5451", 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5451", 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.771307s", 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003999964, 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.685369+0000", 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5455, 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.ea3a7bcd", 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5454", 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5454", 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.771307s", 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003999964, 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.685519+0000", 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5457, 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.ebf3e4ff", 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5456", 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5456", 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.771307s", 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003999964, 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.685547+0000", 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5460, 2024-09-20T21:01:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.9aa25c7e", 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5459", 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5459", 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.687471+0000", 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5461, 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.c0e4ff29", 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5460", 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5460", 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.687505+0000", 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5462, 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.c6119ef0", 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5461", 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5461", 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.786 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.687942+0000", 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5465, 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.51adca5f", 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5464", 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5464", 2024-09-20T21:01:28.787 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.687987+0000", 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5466, 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.d31b90cd", 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5465", 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5465", 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.789 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.687997+0000", 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5467, 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.52260f14", 2024-09-20T21:01:28.790 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5466", 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5466", 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.688237+0000", 2024-09-20T21:01:28.791 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5468, 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.5ae243e0", 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5467", 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5467", 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.792 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.688264+0000", 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.793 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5469, 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.4c1be30", 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5468", 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5468", 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.794 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.688277+0000", 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5470, 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: "pg": "5.1297ac5b", 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: "object_id": "benchmark_data_smithi112_23632_object5469", 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: "object_locator": "@5", 2024-09-20T21:01:28.795 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_id": "benchmark_data_smithi112_23632_object5469", 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "target_object_locator": "@5", 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "paused": 0, 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "used_replica": 0, 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "precalc_pgid": 0, 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "last_sent": "708.775307s", 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0, 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "attempts": 1, 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "snapid": "head", 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_context": "0=[]", 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "mtime": "2024-09-20T21:01:28.688290+0000", 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ops": [ 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-20T21:01:28.796 INFO:teuthology.orchestra.run.smithi112.stdout: "write 0~65536 in=65536b" 2024-09-20T21:01:28.797 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:28.797 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:28.797 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-20T21:01:28.797 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ops": [], 2024-09-20T21:01:28.797 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_ops": [], 2024-09-20T21:01:28.797 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_stat_ops": [], 2024-09-20T21:01:28.797 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_ops": [], 2024-09-20T21:01:28.797 INFO:teuthology.orchestra.run.smithi112.stdout: "command_ops": [] 2024-09-20T21:01:28.797 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-20T21:01:28.797 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:28.798 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 5459, "pg": "5.6a416dd3", "osd": 0, "object_id": "benchmark_data_smithi112_23632_object5458", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5458", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.771307s", "age": 0.003999964, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.685856+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5463, "pg": "5.c13b1bc6", "osd": 0, "object_id": "benchmark_data_smithi112_23632_object5462", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5462", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.687962+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5464, "pg": "5.1a2d68a3", "osd": 0, "object_id": "benchmark_data_smithi112_23632_object5463", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5463", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.687976+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5446, "pg": "5.93118d69", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5445", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5445", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.771307s", "age": 0.003999964, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.684213+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5452, "pg": "5.2e7a332d", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5451", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5451", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.771307s", "age": 0.003999964, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.685369+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5455, "pg": "5.ea3a7bcd", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5454", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5454", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.771307s", "age": 0.003999964, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.685519+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5457, "pg": "5.ebf3e4ff", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5456", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5456", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.771307s", "age": 0.003999964, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.685547+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5460, "pg": "5.9aa25c7e", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5459", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5459", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.687471+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5461, "pg": "5.c0e4ff29", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5460", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5460", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.687505+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5462, "pg": "5.c6119ef0", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5461", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5461", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.687942+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5465, "pg": "5.51adca5f", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5464", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5464", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.687987+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5466, "pg": "5.d31b90cd", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5465", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5465", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.687997+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5467, "pg": "5.52260f14", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5466", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5466", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.688237+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5468, "pg": "5.5ae243e0", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5467", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5467", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.688264+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5469, "pg": "5.4c1be30", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5468", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5468", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.688277+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5470, "pg": "5.1297ac5b", "osd": 2, "object_id": "benchmark_data_smithi112_23632_object5469", "object_locator": "@5", "target_object_id": "benchmark_data_smithi112_23632_object5469", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "708.775307s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-20T21:01:28.688290+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-09-20T21:01:28.798 DEBUG:teuthology.orchestra.run.smithi112:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-20T21:01:28.837 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-09-20T21:01:28.870 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:28.866+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:28.889 DEBUG:teuthology.parallel:result is None 2024-09-20T21:01:28.889 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-09-20T21:01:28.906 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-09-20T21:01:28.906 INFO:teuthology.orchestra.run:waiting for 2100 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:6370 5.9 5:90ca47ad:::benchmark_data_smithi112_23632_object6369:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:28.943493+0000", 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0050912980000000002, 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0051110189999999996, 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:28.947 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 6370 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943493+0000", 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:28.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943493+0000", 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943494+0000", 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2900000000000002e-07 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943638+0000", 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014411599999999999 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943679+0000", 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0781999999999997e-05 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943690+0000", 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1292e-05 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943743+0000", 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3389e-05 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943864+0000", 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000120264 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943989+0000", 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000124931 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.944997+0000", 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010087539999999999 2024-09-20T21:01:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:6373 5.d 5:b393fc3d:::benchmark_data_smithi112_23632_object6372:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:28.943719+0000", 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0048649540000000003, 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0049368420000000003, 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:28.952 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 6373 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943719+0000", 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943719+0000", 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943720+0000", 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6799999999999999e-07 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943752+0000", 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2209999999999998e-05 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943765+0000", 2024-09-20T21:01:28.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3253e-05 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943772+0000", 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8449999999999997e-06 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943834+0000", 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1838e-05 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:28.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.943963+0000", 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012887 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.944095+0000", 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013188699999999999 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.945026+0000", 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00093152899999999995 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.956 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:6375 5.8 5:14d323dc:::benchmark_data_smithi112_23632_object6374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:28.945936+0000", 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002648442, 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002764346, 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.957 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 6375 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.945936+0000", 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.945936+0000", 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.945937+0000", 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946050+0000", 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113349 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946064+0000", 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3878e-05 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946072+0000", 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4149999999999999e-06 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946110+0000", 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8049000000000001e-05 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946211+0000", 2024-09-20T21:01:28.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000100621 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946296+0000", 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5211999999999997e-05 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947486+0000", 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001189964 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:6376 5.d 5:b06f68f1:::benchmark_data_smithi112_23632_object6375:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:28.946145+0000", 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0024393180000000002, 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0025984139999999998, 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 6376 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946145+0000", 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946145+0000", 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:28.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946146+0000", 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9899999999999999e-07 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946233+0000", 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7442999999999996e-05 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946244+0000", 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1235e-05 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946252+0000", 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.396e-06 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946301+0000", 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9458e-05 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946403+0000", 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000101605 2024-09-20T21:01:28.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946541+0000", 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138238 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947272+0000", 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00073054000000000001 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:6378 5.f 5:f7808d22:::benchmark_data_smithi112_23632_object6377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:28.946301+0000", 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002283074, 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024852670000000002, 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 6378 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.967 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946301+0000", 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946301+0000", 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:28.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946302+0000", 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7000000000000003e-07 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946414+0000", 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000112209 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946427+0000", 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2507000000000001e-05 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946433+0000", 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8399999999999997e-06 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946491+0000", 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7544000000000003e-05 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946641+0000", 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015021899999999999 2024-09-20T21:01:28.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946814+0000", 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017305599999999999 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.948085+0000", 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0012708940000000001 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:6379 5.8 5:1426acaa:::benchmark_data_smithi112_23632_object6378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:28.946450+0000", 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0021341429999999998, 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002384316, 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 6379 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.972 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946450+0000", 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946450+0000", 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:28.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946451+0000", 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4799999999999998e-07 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946502+0000", 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1486999999999997e-05 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946512+0000", 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0378e-05 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946519+0000", 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3300000000000004e-06 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946958+0000", 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00043902699999999998 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947083+0000", 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012487800000000001 2024-09-20T21:01:28.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947165+0000", 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2175999999999994e-05 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.948302+0000", 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001137491 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:6381 5.8 5:1d362efa:::benchmark_data_smithi112_23632_object6380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:28.946532+0000", 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00205186, 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023581969999999998, 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 6381 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:28.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946532+0000", 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946532+0000", 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946533+0000", 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.75e-07 2024-09-20T21:01:28.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946571+0000", 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8395000000000001e-05 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946581+0000", 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4059999999999994e-06 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946587+0000", 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0170000000000002e-06 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947524+0000", 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00093692500000000002 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947699+0000", 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000174859 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947872+0000", 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000173003 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.948537+0000", 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00066585199999999998 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:6382 5.f 5:f3bf541b:::benchmark_data_smithi112_23632_object6381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-20T21:01:28.981 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:28.946606+0000", 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0019777129999999999, 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023487170000000002, 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 6382 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946606+0000", 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946606+0000", 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946607+0000", 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5700000000000002e-07 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946646+0000", 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8893000000000002e-05 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946655+0000", 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3009999999999995e-06 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946663+0000", 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6499999999999996e-06 2024-09-20T21:01:28.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947487+0000", 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00082381000000000002 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947575+0000", 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8708999999999994e-05 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947658+0000", 2024-09-20T21:01:28.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3081e-05 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.948362+0000", 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000703588 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:6383 5.9 5:9aa9fcfa:::benchmark_data_smithi112_23632_object6382:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:28.946901+0000", 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0016830160000000001, 2024-09-20T21:01:28.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002100307, 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 6383 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946901+0000", 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946901+0000", 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946902+0000", 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.043e-06 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.946993+0000", 2024-09-20T21:01:28.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1095999999999997e-05 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947005+0000", 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1963999999999999e-05 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947014+0000", 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8400000000000001e-06 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947076+0000", 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1721000000000001e-05 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947194+0000", 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118551 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.947314+0000", 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000119743 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:28.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:28.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:28.948161+0000", 2024-09-20T21:01:28.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00084664099999999997 2024-09-20T21:01:28.991 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.991 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:28.991 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.991 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:28.991 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:01:28.991 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 9 2024-09-20T21:01:28.991 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:28.992 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:28.993 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:28.990+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:29.046 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:01:29.093 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:29.093+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:29.145 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:29.145 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:01:29.145 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:01:29.145 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:01:29.145 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:29.167 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:29.194 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:29.190+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:29.210 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:29.210 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:29.229 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:29.229 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:29.239 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 2 16 7422 7406 231.422 239.312 0.00329479 0.00431296 2024-09-20T21:01:29.249 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:29.294 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:29.293+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:29.367 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:29.367 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:29.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:29.395 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:29.393+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:29.496 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:29.494+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:29.553 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:29.553 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:29.574 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:29.619 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:29.618+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:29.698 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:29.697+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:29.783 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:29.783 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:29.798 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:29.794+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:29.803 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:29.899 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:29.897+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:30.000 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:29.997+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:30.013 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:30.013 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:30.034 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:30.101 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:30.101+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:30.191 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:30.191 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:30.198 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T21:01:30.198 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:01:30.199 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-20T21:01:30.199 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 1.000000 2024-09-20T21:01:30.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-20T21:01:30.202 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:30.201+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:30.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:30.210 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:01:30.239 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 3 15 10538 10523 219.213 194.812 0.00714563 0.00455693 2024-09-20T21:01:30.303 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:30.301+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:30.396 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:30.397 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:30.404 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:30.405+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:30.415 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:30.505 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:30.505+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:30.601 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:30.601 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:30.606 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:30.602+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:30.619 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:30.707 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:30.705+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:30.770 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:30.770 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:30.790 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:30.808 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:30.806+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:30.909 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:30.909+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:30.978 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:30.979 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:30.997 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:31.040 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:31.041+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:31.112 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:31.110+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:31.200 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:31.200 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:31.211 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-20T21:01:31.212 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:31.213+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:31.219 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:31.222 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:01:31.239 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 4 16 13571 13555 211.781 189.5 0.00590626 0.00471372 2024-09-20T21:01:31.267 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:01:31.313 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:31.310+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:31.381 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:31.381 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:31.403 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:31.439 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:31.439 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:31.447 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:31.446+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:31.461 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:31.461 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:31.481 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:31.481 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:31.514 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:31.510+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:01:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:01:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:01:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:31.615 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:31.613+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:31.628 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:31.716 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:31.714+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:31.817 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:31.817+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:31.836 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.640216231, 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:01:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:01:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:01:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.640082031999999, 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:01:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.639977026, 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.639857501000002, 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.639787494, 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:01:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.639712442, 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:01:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:01:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.639625416000001, 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:01:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:01:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:01:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.639556642999999, 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:01:31.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:01:31.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.639470383999999, 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:01:31.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:01:31.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:14.194332+0000", 2024-09-20T21:01:31.887 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.640115712, 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011114007, 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194332+0000", 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194332+0000", 2024-09-20T21:01:31.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194335+0000", 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5459999999999998e-06 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194365+0000", 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0260000000000002e-05 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194398+0000", 2024-09-20T21:01:31.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3266999999999998e-05 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194414+0000", 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5603e-05 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194553+0000", 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013937199999999999 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:31.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.194564+0000", 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.028e-05 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.202513+0000", 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079495050000000008 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.202769+0000", 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000255825 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.202938+0000", 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016944599999999999 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.204180+0000", 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012415900000000001 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.205292+0000", 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001112385 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.205376+0000", 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3312000000000005e-05 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:14.205446+0000", 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0616000000000003e-05 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:150 5.b e23/21 5:df921fd3:::benchmark_data_smithi112_23632_object149:head v 23'6, mlcod=23'3)", 2024-09-20T21:01:31.893 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.308461+0000", 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5259864849999998, 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011677892, 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308461+0000", 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308461+0000", 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308463+0000", 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.812e-06 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308544+0000", 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0655999999999995e-05 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308565+0000", 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1433999999999998e-05 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308581+0000", 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5948999999999999e-05 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308709+0000", 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012737299999999999 2024-09-20T21:01:31.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.308797+0000", 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8510000000000005e-05 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.314294+0000", 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054968810000000003 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320139+0000", 2024-09-20T21:01:31.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058452770000000003 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:152 5.e e23/21 5:74bf54a6:::benchmark_data_smithi112_23632_object151:head v 23'9, mlcod=23'7)", 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.309093+0000", 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5253546700000005, 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011031946000000001, 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.898 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309093+0000", 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309093+0000", 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309095+0000", 2024-09-20T21:01:31.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7600000000000001e-06 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309160+0000", 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4916e-05 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309180+0000", 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9811999999999999e-05 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309192+0000", 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2680999999999999e-05 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309334+0000", 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014111899999999999 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.309372+0000", 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8858e-05 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.313987+0000", 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046144259999999996 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320125+0000", 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061383740000000003 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:158 5.c 5:3efd5b0b:::benchmark_data_smithi112_23632_object157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310204+0000", 2024-09-20T21:01:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.524243996, 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010689961, 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 158 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310204+0000", 2024-09-20T21:01:31.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310204+0000", 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310206+0000", 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9939999999999999e-06 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310310+0000", 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103762 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310337+0000", 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7330000000000001e-05 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310356+0000", 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8563000000000002e-05 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310458+0000", 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102433 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310707+0000", 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024893499999999999 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311042+0000", 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033517699999999998 2024-09-20T21:01:31.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320526+0000", 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094839360000000001 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320560+0000", 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4165000000000002e-05 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320724+0000", 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016423300000000001 2024-09-20T21:01:31.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320894+0000", 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000169433 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159 5.a 5:5db82723:::benchmark_data_smithi112_23632_object158:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5240544040000001, 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015345846, 2024-09-20T21:01:31.908 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310395+0000", 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.48e-06 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310489+0000", 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4293e-05 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310510+0000", 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1073e-05 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310554+0000", 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3797000000000001e-05 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310670+0000", 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115442 2024-09-20T21:01:31.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311025+0000", 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035569399999999999 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311335+0000", 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030994099999999999 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322334+0000", 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010998888 2024-09-20T21:01:31.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325578+0000", 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032433850000000001 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325667+0000", 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9127000000000002e-05 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325739+0000", 2024-09-20T21:01:31.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2725999999999995e-05 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:160 5.2 5:4b3a9c63:::benchmark_data_smithi112_23632_object159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310595+0000", 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5238531990000004, 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011877560000000001, 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:31.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310595+0000", 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310595+0000", 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310596+0000", 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5370000000000001e-06 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310680+0000", 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.365e-05 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310701+0000", 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1389000000000001e-05 2024-09-20T21:01:31.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310717+0000", 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5943e-05 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310809+0000", 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1699000000000004e-05 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311080+0000", 2024-09-20T21:01:31.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271446 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311360+0000", 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027989600000000002 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.316431+0000", 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0050703650000000003 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322304+0000", 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058737920000000001 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322398+0000", 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3460000000000003e-05 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322472+0000", 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4382999999999996e-05 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:157 5.4 e23/21 5:2a681351:::benchmark_data_smithi112_23632_object156:head v 23'9, mlcod=23'7)", 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5238154420000001, 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015433034, 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310634+0000", 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6959999999999999e-06 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310717+0000", 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3245999999999995e-05 2024-09-20T21:01:31.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310740+0000", 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2957000000000001e-05 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310757+0000", 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6646e-05 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320083+0000", 2024-09-20T21:01:31.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0093255790000000005 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320124+0000", 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1635999999999999e-05 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325970+0000", 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058456879999999999 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.326066+0000", 2024-09-20T21:01:31.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5586000000000003e-05 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:164 5.0 e23/21 5:09907a96:::benchmark_data_smithi112_23632_object163:head v 23'16, mlcod=23'14)", 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.312972+0000", 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5214762879999997, 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012082229, 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.312972+0000", 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.312972+0000", 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.312978+0000", 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8050000000000001e-06 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.313036+0000", 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7328999999999999e-05 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.313062+0000", 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6359e-05 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.313100+0000", 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7762999999999997e-05 2024-09-20T21:01:31.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320098+0000", 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069984349999999999 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320141+0000", 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3022000000000002e-05 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.324978+0000", 2024-09-20T21:01:31.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048368939999999996 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325054+0000", 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5622000000000002e-05 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:308 5.a 5:5458a5ac:::benchmark_data_smithi112_23632_object307:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.368801+0000", 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.4656469110000003, 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010828058999999999, 2024-09-20T21:01:31.928 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 308 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368801+0000", 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368801+0000", 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368802+0000", 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1990000000000001e-06 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368844+0000", 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1782000000000001e-05 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368856+0000", 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1848000000000001e-05 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.368864+0000", 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5290000000000008e-06 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.369873+0000", 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010089389999999999 2024-09-20T21:01:31.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.370014+0000", 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014098299999999999 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.370235+0000", 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022038599999999999 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.371632+0000", 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013970950000000001 2024-09-20T21:01:31.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.379547+0000", 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079153629999999999 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.379600+0000", 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3235000000000001e-05 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.379629+0000", 2024-09-20T21:01:31.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.87e-05 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:4188 5.1 5:8ca4c789:::benchmark_data_smithi112_23632_object4187:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:28.404359+0000", 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.4300891390000001, 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011504344999999999, 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:31.934 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 4188 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.404359+0000", 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.404359+0000", 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.404359+0000", 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5000000000000003e-07 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.404406+0000", 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6524999999999999e-05 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.404415+0000", 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8279999999999992e-06 2024-09-20T21:01:31.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.404445+0000", 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0360000000000001e-05 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.405093+0000", 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064752899999999999 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.405200+0000", 2024-09-20T21:01:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107768 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.405326+0000", 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125621 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.406479+0000", 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001153404 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.415738+0000", 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.009258189 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.415803+0000", 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4987000000000006e-05 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:28.415863+0000", 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0584000000000001e-05 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.939 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:15019 5.a 5:50d78f85:::benchmark_data_smithi112_23632_object15018:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:31.748889+0000", 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.085558420999999996, 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011243843999999999, 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 15019 2024-09-20T21:01:31.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.748889+0000", 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.748889+0000", 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:31.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.748890+0000", 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9300000000000006e-07 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.748970+0000", 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9645000000000001e-05 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.748983+0000", 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2807e-05 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.748990+0000", 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8159999999999996e-06 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.749609+0000", 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061901999999999997 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.749728+0000", 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118853 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.749857+0000", 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129713 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.751455+0000", 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015975169999999999 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.760076+0000", 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0086210550000000007 2024-09-20T21:01:31.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.760110+0000", 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4320999999999999e-05 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:31.760133+0000", 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3104000000000001e-05 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:31.945 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:31.947 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:31.945+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:31.947 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:32.047 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:32.045+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:32.109 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:32.109 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:32.109 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.109 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:16114 5.9 e25/21 5:9a9dbf80:::benchmark_data_smithi112_23632_object16113:head v 25'1017, mlcod=25'1014)", 2024-09-20T21:01:32.109 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:32.107804+0000", 2024-09-20T21:01:32.109 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0021298710000000002, 2024-09-20T21:01:32.109 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021523129999999999, 2024-09-20T21:01:32.109 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.109 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.107804+0000", 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.107804+0000", 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.110 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.107805+0000", 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7199999999999998e-07 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.107855+0000", 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0834000000000002e-05 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.107868+0000", 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2737e-05 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.111 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.107873+0000", 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1660000000000002e-06 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.107918+0000", 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.5176000000000003e-05 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.107938+0000", 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9411000000000001e-05 2024-09-20T21:01:32.112 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.113 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.113 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.113 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.109946+0000", 2024-09-20T21:01:32.113 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0020079859999999998 2024-09-20T21:01:32.113 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.113 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.114 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.114 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.114 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.114 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:16115 5.c e25/21 5:313a7bb7:::benchmark_data_smithi112_23632_object16114:head v 25'968, mlcod=25'966)", 2024-09-20T21:01:32.114 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:32.108613+0000", 2024-09-20T21:01:32.114 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.001320793, 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0014156780000000001, 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.108613+0000", 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.115 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.116 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.116 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.108613+0000", 2024-09-20T21:01:32.116 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.116 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.116 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.116 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.116 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.108613+0000", 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6400000000000002e-07 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.108667+0000", 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.3403999999999999e-05 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.108676+0000", 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5529999999999998e-06 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.108684+0000", 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.108737+0000", 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.3414000000000001e-05 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.108751+0000", 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3540000000000001e-05 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:16116 5.3 e25/21 5:c210b3ca:::benchmark_data_smithi112_23632_object16115:head v 25'1034, mlcod=25'1031)", 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:32.109790+0000", 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00014311799999999999, 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027439800000000002, 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.119 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.109790+0000", 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.109790+0000", 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.109791+0000", 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.9599999999999999e-07 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.120 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.109851+0000", 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.9892000000000002e-05 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.109869+0000", 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8114e-05 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.109877+0000", 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7889999999999995e-06 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.121 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.109930+0000", 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.2763999999999998e-05 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:32.109950+0000", 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0539000000000001e-05 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 3 2024-09-20T21:01:32.122 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:32.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:32.173 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:32.173+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:32.239 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 5 16 16465 16449 205.596 180.875 0.00261962 0.00484742 2024-09-20T21:01:32.249 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:32.249+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:32.265 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:32.266 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:01:32.266 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:01:32.266 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:01:32.266 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:32.285 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:32.373 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:32.373+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:32.451 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:32.449+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:32.478 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:32.478 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 30.514384400000001, 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:32.479 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.480 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:01:32.481 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:01:32.482 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:01:32.483 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:01:32.484 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.509389626000001, 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.485 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.486 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.487 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:01:32.488 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:01:32.489 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.281450230000001, 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.491 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.492 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.493 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.494 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:01:32.495 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.496 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.281303010999999, 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.497 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.498 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.500 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.501 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.281177078999999, 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.502 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:01:32.503 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.504 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:01:32.505 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:01:32.506 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.507 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.281092482999998, 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.508 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:01:32.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:01:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.511 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.512 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.280774881999999, 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.514 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.515 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.516 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:01:32.517 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.518 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.280673166, 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.519 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:01:32.520 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:01:32.521 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.522 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.523 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.28059257, 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.524 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:32.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:01:32.526 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.527 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.528 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.280515504, 2024-09-20T21:01:32.529 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:32.531 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.532 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:01:32.533 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.534 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.280304036, 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.535 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.536 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.537 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.538 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:01:32.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.280228199, 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:01:32.542 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.543 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.544 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.280106137000001, 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.547 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.548 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.549 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:01:32.550 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.551 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.280037887999999, 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.552 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.554 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:01:32.555 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:01:32.556 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.557 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.279945101999999, 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:32.558 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.559 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.560 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:01:32.561 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:01:32.562 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.279883246000001, 2024-09-20T21:01:32.563 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:01:32.565 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:01:32.566 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.566 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.566 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.566 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:01:32.566 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:01:32.566 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.566 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.566 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.566 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.567 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.279800869999999, 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:01:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:01:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:01:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.279716310000001, 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:01:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.577 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.578 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:01:32.579 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.580 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.279652404, 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.581 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:01:32.582 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 20.279589660999999, 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:32.586 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.587 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.589 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:32.589 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:01:32.589 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:32.589 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.590 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:32.591 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:32.592 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:32.592 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:01:32.592 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:01:32.592 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.592 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.592 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.592 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:32.592 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:32.592 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:32.594 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:32.594 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:32.590+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:32.694 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:32.693+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:32.750 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:32.750 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:32.750 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:18014 5.b 5:dcf49603:::benchmark_data_smithi112_23632_object18013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.749757+0000", 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0027695390000000001, 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027884720000000002, 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 18014 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:32.751 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.749757+0000", 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.749757+0000", 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.749758+0000", 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2079999999999999e-06 2024-09-20T21:01:32.752 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.749803+0000", 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4687000000000001e-05 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.749815+0000", 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.276e-05 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.749824+0000", 2024-09-20T21:01:32.753 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4030000000000007e-06 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.749882+0000", 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8513e-05 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.749973+0000", 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0827000000000003e-05 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.754 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750083+0000", 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000109675 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:18015 5.8 5:11c844f7:::benchmark_data_smithi112_23632_object18014:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.750174+0000", 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002352158, 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024193359999999998, 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:32.755 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 18015 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750174+0000", 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:32.756 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750174+0000", 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750175+0000", 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0100000000000003e-07 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750247+0000", 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2280000000000006e-05 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750259+0000", 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2091e-05 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750267+0000", 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9699999999999999e-06 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750312+0000", 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4270999999999997e-05 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.758 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750401+0000", 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9209000000000006e-05 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750546+0000", 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014476800000000001 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.759 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:18016 5.0 5:0694d203:::benchmark_data_smithi112_23632_object18015:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.750285+0000", 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0022413060000000002, 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023495310000000002, 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 18016 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.760 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750285+0000", 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750285+0000", 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750286+0000", 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5400000000000001e-07 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.761 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750322+0000", 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6406999999999999e-05 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750332+0000", 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8479999999999996e-06 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750339+0000", 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6719999999999998e-06 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.762 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750386+0000", 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7416000000000001e-05 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750523+0000", 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136599 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750665+0000", 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014286 2024-09-20T21:01:32.763 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:18018 5.9 5:93786863:::benchmark_data_smithi112_23632_object18017:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.750635+0000", 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001891268, 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020400470000000001, 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:32.764 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 18018 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750635+0000", 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750635+0000", 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.765 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750636+0000", 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1999999999999998e-07 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750764+0000", 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012860399999999999 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750776+0000", 2024-09-20T21:01:32.766 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1687e-05 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750784+0000", 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5410000000000003e-06 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750851+0000", 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7378000000000004e-05 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.767 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750981+0000", 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012960099999999999 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.751111+0000", 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000130751 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:18008 5.0 5:0b74c3ce:::benchmark_data_smithi112_23632_object18007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:32.768 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.747960+0000", 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0045664019999999998, 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004755647, 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 18008 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.747960+0000", 2024-09-20T21:01:32.769 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.747960+0000", 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.747961+0000", 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8100000000000002e-07 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:32.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748010+0000", 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9184999999999997e-05 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748017+0000", 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9129999999999997e-06 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748021+0000", 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3850000000000004e-06 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748068+0000", 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.723e-05 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748195+0000", 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012716800000000001 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748345+0000", 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000149188 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.772 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.750043+0000", 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016985139999999999 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:18009 5.4 5:2a7c278e:::benchmark_data_smithi112_23632_object18008:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.748034+0000", 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0044926159999999996, 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047238879999999999, 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:32.773 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 18009 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748034+0000", 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748034+0000", 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748034+0000", 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.92e-07 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748090+0000", 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5250000000000001e-05 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748096+0000", 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6120000000000004e-06 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748100+0000", 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8039999999999999e-06 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748136+0000", 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5930000000000003e-05 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748230+0000", 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4191999999999995e-05 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.748312+0000", 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2018e-05 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.749574+0000", 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001261566 2024-09-20T21:01:32.777 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.778 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:32.778 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.778 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:32.778 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:01:32.778 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 6 2024-09-20T21:01:32.778 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:32.779 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:32.795 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:32.793+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:32.896 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:32.897+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:32.932 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:32.932 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:01:32.932 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:01:32.932 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:01:32.932 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:32.953 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:32.998 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:32.994+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:33.099 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:33.097+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:33.154 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:33.154 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:01:33.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:01:33.154 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:33.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.154 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:33.154 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:33.154 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.957370575999999, 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:33.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:01:33.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:33.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:01:33.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.957280539999999, 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:33.166 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.957194186999999, 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:33.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:01:33.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:01:33.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:01:33.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.957125378000001, 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.173 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:01:33.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:01:33.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.957092518, 2024-09-20T21:01:33.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:01:33.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:33.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:01:33.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.184 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.957050501000001, 2024-09-20T21:01:33.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:01:33.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:01:33.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.956925394999999, 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:01:33.191 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:01:33.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.956833046, 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:01:33.197 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:01:33.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:01:33.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:01:33.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:01:33.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:01:33.203 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.956748674, 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:01:33.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.208 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:2 5.8 5:124aadbb:::benchmark_data_smithi112_23632_object1:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.9103238520000003, 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017726502000000002, 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 2 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243120+0000", 2024-09-20T21:01:33.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3799999999999999e-06 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243306+0000", 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018621499999999999 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243327+0000", 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1036e-05 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243341+0000", 2024-09-20T21:01:33.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.412e-05 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243477+0000", 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136286 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243492+0000", 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5033e-05 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252641+0000", 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0091492480000000004 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252748+0000", 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106724 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252867+0000", 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011846899999999999 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255666+0000", 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002799368 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260766+0000", 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050996940000000001 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260809+0000", 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2972999999999997e-05 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260845+0000", 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5955999999999999e-05 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:5 5.4 5:272d9688:::benchmark_data_smithi112_23632_object4:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.9098573229999998, 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015407461000000001, 2024-09-20T21:01:33.215 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 5 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243586+0000", 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0300000000000001e-06 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243695+0000", 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0001097 2024-09-20T21:01:33.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243712+0000", 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7073000000000001e-05 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243721+0000", 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9360000000000005e-06 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243834+0000", 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000112186 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243849+0000", 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5347000000000001e-05 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.251959+0000", 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0081103449999999997 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252062+0000", 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010262 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252178+0000", 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011608900000000001 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256938+0000", 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047595249999999997 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258912+0000", 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019745470000000001 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258955+0000", 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2568000000000003e-05 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258992+0000", 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7494999999999999e-05 2024-09-20T21:01:33.221 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:7 5.4 5:2e77bfa8:::benchmark_data_smithi112_23632_object6:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.9096966540000002, 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016326288000000001, 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.222 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 7 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243747+0000", 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2300000000000001e-06 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243903+0000", 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015672599999999999 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243918+0000", 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4355999999999999e-05 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243927+0000", 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3340000000000008e-06 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244038+0000", 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110612 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244046+0000", 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9869999999999999e-06 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252713+0000", 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0086670889999999993 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253039+0000", 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032610099999999997 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253414+0000", 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037573700000000001 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256958+0000", 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035431759999999999 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259926+0000", 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002968077 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260003+0000", 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7208999999999999e-05 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260072+0000", 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8653999999999997e-05 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:9 5.0 5:0418dd6f:::benchmark_data_smithi112_23632_object8:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:33.228 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243948+0000", 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.9094934889999999, 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014983845000000001, 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 9 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243948+0000", 2024-09-20T21:01:33.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243948+0000", 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243950+0000", 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2270000000000001e-06 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244080+0000", 2024-09-20T21:01:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000130149 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244097+0000", 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6886000000000001e-05 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244106+0000", 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7970000000000006e-06 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244169+0000", 2024-09-20T21:01:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3299999999999994e-05 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244175+0000", 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9229999999999999e-06 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.249939+0000", 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0057645550000000002 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.250595+0000", 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065572899999999997 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.250929+0000", 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000333467 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254107+0000", 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003178878 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258836+0000", 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047288620000000003 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258893+0000", 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6743000000000002e-05 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258932+0000", 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9329000000000002e-05 2024-09-20T21:01:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:10 5.0 5:0c1d9875:::benchmark_data_smithi112_23632_object9:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244126+0000", 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.9093162530000001, 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014913087, 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 10 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244126+0000", 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244126+0000", 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244127+0000", 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.24e-06 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244238+0000", 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000111295 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244271+0000", 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2894e-05 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244280+0000", 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6559999999999998e-06 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244333+0000", 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3125999999999999e-05 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244338+0000", 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3600000000000004e-06 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.251927+0000", 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0075885090000000002 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252042+0000", 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011513100000000001 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252178+0000", 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013604700000000001 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254889+0000", 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027108560000000002 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258974+0000", 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040847050000000001 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259020+0000", 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6312e-05 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259039+0000", 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8955999999999999e-05 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:14 5.0 5:04cc51db:::benchmark_data_smithi112_23632_object13:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.9089841029999999, 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017127937999999999, 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 14 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244459+0000", 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0699999999999999e-06 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244569+0000", 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010965 2024-09-20T21:01:33.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244594+0000", 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5066e-05 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244607+0000", 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3152999999999999e-05 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244663+0000", 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6360000000000002e-05 2024-09-20T21:01:33.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244670+0000", 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8199999999999999e-06 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252692+0000", 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0080222069999999999 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252990+0000", 2024-09-20T21:01:33.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000297788 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253360+0000", 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00036990699999999999 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255672+0000", 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023116529999999999 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.246 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261302+0000", 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0056302890000000001 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261450+0000", 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000148016 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261586+0000", 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135959 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.247 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:15 5.4 5:26d45dc5:::benchmark_data_smithi112_23632_object14:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.9088173140000002, 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015746412000000001, 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 15 2024-09-20T21:01:33.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244626+0000", 2024-09-20T21:01:33.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1170000000000001e-06 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244735+0000", 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108902 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244767+0000", 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2767e-05 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244780+0000", 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2823000000000001e-05 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244832+0000", 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2102999999999999e-05 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244838+0000", 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2129999999999999e-06 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254299+0000", 2024-09-20T21:01:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0094618670000000005 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254554+0000", 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025405099999999998 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255233+0000", 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000679852 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.257421+0000", 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00218761 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260171+0000", 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027496119999999998 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260302+0000", 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000131025 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260371+0000", 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9469999999999997e-05 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:157 5.4 5:2a681351:::benchmark_data_smithi112_23632_object156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.8416007560000001, 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016166680999999999, 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.254 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 157 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311842+0000", 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2389999999999999e-06 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311879+0000", 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6520000000000003e-05 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311893+0000", 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3814e-05 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311903+0000", 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7969999999999995e-06 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311963+0000", 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0773999999999998e-05 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.312056+0000", 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2264999999999998e-05 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.312153+0000", 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7118000000000001e-05 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.317062+0000", 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0049092420000000003 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.327952+0000", 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010889708999999999 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.327985+0000", 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3519000000000002e-05 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.328008+0000", 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2684000000000002e-05 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16441 5.4 5:231ae493:::benchmark_data_smithi112_23632_object16440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.259 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.92983850300000004, 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018694967999999999, 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16441 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223604+0000", 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0020000000000001e-06 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223754+0000", 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014907899999999999 2024-09-20T21:01:33.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5207e-05 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223787+0000", 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8685000000000002e-05 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223852+0000", 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5012999999999996e-05 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017955400000000001 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224223+0000", 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000191428 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225787+0000", 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001563617 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242143+0000", 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01635615 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242235+0000", 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2250000000000006e-05 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242298+0000", 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2983000000000003e-05 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16442 5.0 5:07f91168:::benchmark_data_smithi112_23632_object16441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.92963368999999996, 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018432022999999999, 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.265 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16442 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223809+0000", 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223867+0000", 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8365000000000001e-05 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223878+0000", 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.058e-05 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223886+0000", 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6490000000000008e-06 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223943+0000", 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6879000000000002e-05 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224078+0000", 2024-09-20T21:01:33.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135549 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224243+0000", 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016484900000000001 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226958+0000", 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027148490000000001 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242135+0000", 2024-09-20T21:01:33.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015176858 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242185+0000", 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0254999999999999e-05 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242240+0000", 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.541e-05 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16446 5.0 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.92946237099999995, 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018538079999999998, 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16446 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:33.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5799999999999999e-07 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224021+0000", 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1053000000000001e-05 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.111e-05 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224040+0000", 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5480000000000004e-06 2024-09-20T21:01:33.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225554+0000", 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001513749 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225818+0000", 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026389300000000002 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226084+0000", 2024-09-20T21:01:33.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026617999999999998 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.227457+0000", 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013727030000000001 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242319+0000", 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014862492 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:33.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242426+0000", 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107291 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242518+0000", 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1403000000000006e-05 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:33.276 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:33.277 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:01:33.278 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 6 16 19390 19374 201.795 182.812 0.00788513 0.00495051 2024-09-20T21:01:33.279 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:33.277+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:33.279 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:33.378 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:33.377+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:33.439 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19900 5.6 5:6fbaf7ce:::benchmark_data_smithi112_23632_object19899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.432346+0000", 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00663797, 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0066794350000000001, 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19900 2024-09-20T21:01:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432346+0000", 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432346+0000", 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432346+0000", 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4099999999999998e-07 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432431+0000", 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5016000000000001e-05 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432454+0000", 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3204999999999999e-05 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432463+0000", 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4649999999999994e-06 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432514+0000", 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1187999999999998e-05 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432622+0000", 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108158 2024-09-20T21:01:33.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432758+0000", 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013546399999999999 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436573+0000", 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038155490000000001 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19901 5.c 5:387e3375:::benchmark_data_smithi112_23632_object19900:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.432480+0000", 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.006503132, 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0066417949999999998, 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19901 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432480+0000", 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432480+0000", 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432481+0000", 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7599999999999997e-07 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432529+0000", 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8112000000000003e-05 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432539+0000", 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0206e-05 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432546+0000", 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6030000000000001e-06 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432599+0000", 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2584999999999999e-05 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432710+0000", 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011162000000000001 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.432833+0000", 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000122793 2024-09-20T21:01:33.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436569+0000", 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037358669999999999 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19904 5.5 5:a8be0a86:::benchmark_data_smithi112_23632_object19903:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.434518+0000", 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0044656660000000001, 2024-09-20T21:01:33.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046936850000000004, 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19904 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.434518+0000", 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.434518+0000", 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.434519+0000", 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6599999999999996e-07 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.434607+0000", 2024-09-20T21:01:33.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8943999999999994e-05 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.434616+0000", 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6750000000000008e-06 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.434621+0000", 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9019999999999998e-06 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.434660+0000", 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9366999999999998e-05 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.434743+0000", 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2354999999999993e-05 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.434820+0000", 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7576000000000004e-05 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436620+0000", 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0017996780000000001 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19905 5.3 5:c36cf442:::benchmark_data_smithi112_23632_object19904:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.436452+0000", 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0025312870000000001, 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028461319999999999, 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19905 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436452+0000", 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436452+0000", 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436453+0000", 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1100000000000005e-07 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436559+0000", 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010606 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436570+0000", 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0623e-05 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436576+0000", 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9830000000000001e-06 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436634+0000", 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8270999999999998e-05 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436803+0000", 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016882099999999999 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436958+0000", 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015499599999999999 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438258+0000", 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001300292 2024-09-20T21:01:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19907 5.c 5:3ad1eff1:::benchmark_data_smithi112_23632_object19906:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.436968+0000", 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0020153060000000001, 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0024168560000000002, 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19907 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436968+0000", 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436968+0000", 2024-09-20T21:01:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.436969+0000", 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5000000000000003e-07 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437069+0000", 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010060600000000001 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437089+0000", 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9505999999999999e-05 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437093+0000", 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.493e-06 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437143+0000", 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9746000000000001e-05 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437277+0000", 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000134375 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437427+0000", 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014982400000000001 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439335+0000", 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00190759 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19908 5.c 5:3e5e4a27:::benchmark_data_smithi112_23632_object19907:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.437902+0000", 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001081991, 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00158581, 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19908 2024-09-20T21:01:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437902+0000", 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437902+0000", 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437902+0000", 2024-09-20T21:01:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9199999999999999e-07 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437975+0000", 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.292e-05 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437984+0000", 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2409999999999995e-06 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.437988+0000", 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6319999999999999e-06 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438334+0000", 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034610499999999998 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438453+0000", 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119014 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438572+0000", 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118369 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19909 5.6 5:6cd9ca85:::benchmark_data_smithi112_23632_object19908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.438000+0000", 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00098372499999999996, 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015719180000000001, 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19909 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438000+0000", 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438000+0000", 2024-09-20T21:01:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438000+0000", 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4499999999999997e-07 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438038+0000", 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7842000000000001e-05 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438046+0000", 2024-09-20T21:01:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7270000000000007e-06 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438050+0000", 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7859999999999998e-06 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438094+0000", 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4294e-05 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438210+0000", 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011578099999999999 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438336+0000", 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012649300000000001 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19911 5.5 5:a51694f0:::benchmark_data_smithi112_23632_object19910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.438059+0000", 2024-09-20T21:01:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00092460999999999997, 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015918550000000001, 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19911 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438059+0000", 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438059+0000", 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438059+0000", 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6600000000000002e-07 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438127+0000", 2024-09-20T21:01:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7552999999999995e-05 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438133+0000", 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9209999999999997e-06 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438136+0000", 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6780000000000002e-06 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438170+0000", 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3946999999999999e-05 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438255+0000", 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4697000000000006e-05 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438354+0000", 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9165000000000003e-05 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19913 5.6 5:609ee14b:::benchmark_data_smithi112_23632_object19912:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.438848+0000", 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000135241, 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00088140799999999997, 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19913 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438848+0000", 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438848+0000", 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438849+0000", 2024-09-20T21:01:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6799999999999999e-07 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438972+0000", 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000123342 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.438993+0000", 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0772999999999999e-05 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439001+0000", 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.418e-06 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439330+0000", 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000329239 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439463+0000", 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013316099999999999 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439600+0000", 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013731099999999999 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:19900 5.6 e25/21)", 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.439051+0000", 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9999323, 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00074844400000000002, 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439051+0000", 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439051+0000", 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439052+0000", 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.75e-07 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439055+0000", 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.478e-06 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439063+0000", 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0469999999999994e-06 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439069+0000", 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.451e-06 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19914 5.5 5:a3321dbe:::benchmark_data_smithi112_23632_object19913:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.439228+0000", 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9997554, 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00062740699999999996, 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19914 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439228+0000", 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439228+0000", 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439229+0000", 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6599999999999996e-07 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439257+0000", 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8325000000000001e-05 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439266+0000", 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6929999999999996e-06 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439272+0000", 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5849999999999996e-06 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439491+0000", 2024-09-20T21:01:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219113 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439614+0000", 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012227000000000001 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439747+0000", 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013319199999999999 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:19915 5.3 5:cff8cc65:::benchmark_data_smithi112_23632_object19914:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:33.439521+0000", 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9994621, 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041644400000000003, 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19915 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439521+0000", 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439521+0000", 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439522+0000", 2024-09-20T21:01:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.006e-06 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439692+0000", 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016955099999999999 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439704+0000", 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1491000000000001e-05 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439711+0000", 2024-09-20T21:01:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4340000000000003e-06 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439749+0000", 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7799999999999997e-05 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439827+0000", 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8252999999999998e-05 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:33.439905+0000", 2024-09-20T21:01:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7754000000000001e-05 2024-09-20T21:01:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:01:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 12 2024-09-20T21:01:33.493 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:33.494 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:33.495 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:33.493+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:33.499 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:01:33.595 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:33.593+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:33.645 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:33.645 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:33.656 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:33.656 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:33.665 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:33.665 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:33.678 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:33.685 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:33.686 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:33.696 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:33.697+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:33.797 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:33.797+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:33.844 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:33.844 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:33.865 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:33.909 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:33.909+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:33.999 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:33.998+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:34.019 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:34.019 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:34.039 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:34.125 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:34.125+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:34.200 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:34.201+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:34.222 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:01:34.227 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:34.227 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:34.239 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 7 16 22148 22132 197.589 172.375 0.00365642 0.00505564 2024-09-20T21:01:34.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:34.300 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:34.301+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:34.401 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:34.398+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:34.431 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:34.431 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:34.451 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:34.502 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:34.501+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:34.602 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:34.601+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:34.611 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:34.611 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:34.634 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:34.720 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:34.721+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:34.803 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:34.802+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:34.836 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:34.837 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:34.855 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:34.904 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:34.901+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:35.005 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:35.005+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:35.047 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:35.047 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:35.067 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:35.106 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:35.105+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:35.207 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:35.205+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:35.219 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:35.219 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:35.238 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:35.239 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 8 16 24893 24877 194.333 171.562 0.00685242 0.00514028 2024-09-20T21:01:35.308 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:35.305+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:35.391 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:35.391 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:35.409 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:35.409+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:35.410 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:35.509 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:35.509+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:35.564 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:35.564 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:35.585 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:35.629 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:35.629+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:35.703 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:01:35.711 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:35.706+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:35.732 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:35.732 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:35.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:35.837 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:35.837+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:35.861 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:35.861 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:35.880 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:35.880 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:35.898 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:35.898 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:35.913 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:35.910+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:35.941 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:35.942 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:01:35.942 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:01:35.942 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:01:35.942 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:35.960 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:36.049 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:36.049+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:36.114 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:36.110+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:36.153 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 34.190033790999998, 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:36.154 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.155 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:01:36.156 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:01:36.157 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:01:36.158 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.159 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:36.160 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.185039017000001, 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:36.161 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.162 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:01:36.163 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.164 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:36.166 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.957099621000001, 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.167 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.168 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.169 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:01:36.170 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:01:36.171 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.956952401999999, 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.172 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.173 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:01:36.174 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:01:36.175 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:01:36.176 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.956826469999999, 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:01:36.177 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.178 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.179 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:01:36.180 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:01:36.181 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.182 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.956741873999999, 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.183 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.184 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:01:36.185 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:01:36.186 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:01:36.187 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.956424273, 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.188 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:01:36.189 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:01:36.190 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.191 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.192 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:36.193 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.956322557, 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:36.194 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.195 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.196 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.198 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.956241961, 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:36.199 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.200 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.201 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.202 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.203 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.956164895000001, 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.204 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.205 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.206 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.207 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:01:36.208 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.209 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.955953427000001, 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.210 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.211 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.212 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.213 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:01:36.214 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.95587759, 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.215 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.217 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.218 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.219 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.955755528000001, 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.220 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:01:36.221 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.223 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:01:36.224 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.225 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.955687278999999, 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.226 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.227 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:01:36.228 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:01:36.229 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:01:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.955594493, 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.231 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:01:36.233 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:01:36.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:01:36.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.955532637000001, 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:01:36.236 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.237 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:01:36.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:01:36.240 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.241 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.955450260999999, 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.242 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.243 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.244 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.245 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.246 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.955365701000002, 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:36.247 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:01:36.248 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:01:36.249 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:01:36.250 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.251 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.955301795, 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.252 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.253 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:01:36.254 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:01:36.255 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:01:36.256 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 23.955239052, 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:36.257 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.258 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.259 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:36.260 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:36.261 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:01:36.261 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:01:36.261 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.261 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.261 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.261 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:36.261 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:36.261 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:36.261 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T21:01:36.261 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:01:36.262 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:01:36.262 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:01:36.266 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 9 16 27604 27588 191.565 169.438 0.00707868 0.00521433 2024-09-20T21:01:36.267 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:36.261+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:36.267 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:36.363 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:36.362+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:36.427 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:36.427 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:36.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:28113 5.4 5:29e1b6eb:::benchmark_data_smithi112_23632_object28112:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:36.426271+0000", 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.003484858, 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035070359999999998, 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 28113 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426271+0000", 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426271+0000", 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426272+0000", 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1500000000000003e-07 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426343+0000", 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1032999999999996e-05 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426351+0000", 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2789999999999998e-06 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426356+0000", 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0919999999999997e-06 2024-09-20T21:01:36.430 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426398+0000", 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1476000000000001e-05 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426490+0000", 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2359000000000001e-05 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426607+0000", 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000117093 2024-09-20T21:01:36.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.429294+0000", 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002686445 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:28117 5.e 5:7bee3e6f:::benchmark_data_smithi112_23632_object28116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:36.426518+0000", 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0032373469999999998, 2024-09-20T21:01:36.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0033210290000000001, 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 28117 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426518+0000", 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426518+0000", 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426519+0000", 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7400000000000003e-07 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426605+0000", 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6036000000000001e-05 2024-09-20T21:01:36.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426613+0000", 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6729999999999992e-06 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426617+0000", 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9369999999999997e-06 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426649+0000", 2024-09-20T21:01:36.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1933000000000001e-05 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426758+0000", 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010969299999999999 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426879+0000", 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000120791 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:28120 5.f 5:f2d3d62f:::benchmark_data_smithi112_23632_object28119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:36.426806+0000", 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0029493739999999998, 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0030757029999999999, 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 28120 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426806+0000", 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426806+0000", 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426807+0000", 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.92e-07 2024-09-20T21:01:36.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426904+0000", 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6374999999999998e-05 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426914+0000", 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0302000000000001e-05 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426921+0000", 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8770000000000004e-06 2024-09-20T21:01:36.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426972+0000", 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0858e-05 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.427106+0000", 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013415200000000001 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.427251+0000", 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000144821 2024-09-20T21:01:36.440 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:28121 5.d 5:b8ba1fea:::benchmark_data_smithi112_23632_object28120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:36.426940+0000", 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0028160949999999998, 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029839659999999998, 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.441 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 28121 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426940+0000", 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426940+0000", 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426940+0000", 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3300000000000001e-07 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426979+0000", 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8906999999999999e-05 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426988+0000", 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2360000000000004e-06 2024-09-20T21:01:36.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.426993+0000", 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8730000000000004e-06 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.427057+0000", 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3391000000000003e-05 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.427195+0000", 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138341 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.427324+0000", 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012839899999999999 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:28123 5.4 5:293f1f26:::benchmark_data_smithi112_23632_object28122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:36.428144+0000", 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0016113799999999999, 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018185530000000001, 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.445 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 28123 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428144+0000", 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428144+0000", 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428145+0000", 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7600000000000006e-07 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428256+0000", 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110671 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428271+0000", 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4887e-05 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428279+0000", 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4940000000000003e-06 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428330+0000", 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0188999999999997e-05 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428457+0000", 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012694599999999999 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428605+0000", 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014846099999999999 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:28124 5.8 5:1010c526:::benchmark_data_smithi112_23632_object28123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:36.428493+0000", 2024-09-20T21:01:36.449 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001262986, 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0015094749999999999, 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 28124 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428493+0000", 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428493+0000", 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428494+0000", 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.33e-07 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428552+0000", 2024-09-20T21:01:36.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8371000000000001e-05 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428564+0000", 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2164000000000001e-05 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428573+0000", 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7539999999999995e-06 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428628+0000", 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5096000000000002e-05 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428768+0000", 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014031499999999999 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:36.428909+0000", 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014079300000000001 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.453 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.454 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.454 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:01:36.454 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 6 2024-09-20T21:01:36.454 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:36.455 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:36.464 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:36.461+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:36.565 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:36.562+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:36.605 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:01:36.605 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:36.606 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:01:36.606 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:01:36.606 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:01:36.606 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:36.621 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-20T21:01:34.864184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635767709,"num_objects":9718,"num_object_clones":0,"num_object_copies":19436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9718,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":9942,"num_write_kb":623764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9891,"ondisk_log_size":9891,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":181716,"kb_used_data":63196,"kb_used_omap":4,"kb_used_meta":118459,"kb_avail":282933804,"statfs":{"total":289910292480,"available":289724215296,"internally_reserved":0,"allocated":64712704,"data_stored":1023074377,"data_compressed":4899505,"data_compressed_allocated":63934464,"data_compressed_original":1022787584,"omap_allocated":4788,"internal_metadata":121302348},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,6,9,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":635174912,"num_objects":9692,"num_object_clones":0,"num_object_copies":19384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9692,"num_write_kb":620288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.680485"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188880+0000","last_change":"2024-09-20T21:01:12.240709+0000","last_active":"2024-09-20T21:01:28.188880+0000","last_peered":"2024-09-20T21:01:28.188880+0000","last_clean":"2024-09-20T21:01:28.188880+0000","last_became_active":"2024-09-20T21:01:12.239599+0000","last_became_peered":"2024-09-20T21:01:12.239599+0000","last_unstale":"2024-09-20T21:01:28.188880+0000","last_undegraded":"2024-09-20T21:01:28.188880+0000","last_fullsized":"2024-09-20T21:01:28.188880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187569+0000","last_change":"2024-09-20T21:01:12.236761+0000","last_active":"2024-09-20T21:01:28.187569+0000","last_peered":"2024-09-20T21:01:28.187569+0000","last_clean":"2024-09-20T21:01:28.187569+0000","last_became_active":"2024-09-20T21:01:12.235613+0000","last_became_peered":"2024-09-20T21:01:12.235613+0000","last_unstale":"2024-09-20T21:01:28.187569+0000","last_undegraded":"2024-09-20T21:01:28.187569+0000","last_fullsized":"2024-09-20T21:01:28.187569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187509+0000","last_change":"2024-09-20T21:01:26.196187+0000","last_active":"2024-09-20T21:01:28.187509+0000","last_peered":"2024-09-20T21:01:28.187509+0000","last_clean":"2024-09-20T21:01:28.187509+0000","last_became_active":"2024-09-20T21:01:26.194809+0000","last_became_peered":"2024-09-20T21:01:26.194809+0000","last_unstale":"2024-09-20T21:01:28.187509+0000","last_undegraded":"2024-09-20T21:01:28.187509+0000","last_fullsized":"2024-09-20T21:01:28.187509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:32:57.333723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184028+0000","last_change":"2024-09-20T21:01:26.187140+0000","last_active":"2024-09-20T21:01:28.184028+0000","last_peered":"2024-09-20T21:01:28.184028+0000","last_clean":"2024-09-20T21:01:28.184028+0000","last_became_active":"2024-09-20T21:01:26.184626+0000","last_became_peered":"2024-09-20T21:01:26.184626+0000","last_unstale":"2024-09-20T21:01:28.184028+0000","last_undegraded":"2024-09-20T21:01:28.184028+0000","last_fullsized":"2024-09-20T21:01:28.184028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:23.486608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187794+0000","last_change":"2024-09-20T21:01:12.232080+0000","last_active":"2024-09-20T21:01:28.187794+0000","last_peered":"2024-09-20T21:01:28.187794+0000","last_clean":"2024-09-20T21:01:28.187794+0000","last_became_active":"2024-09-20T21:01:12.231429+0000","last_became_peered":"2024-09-20T21:01:12.231429+0000","last_unstale":"2024-09-20T21:01:28.187794+0000","last_undegraded":"2024-09-20T21:01:28.187794+0000","last_fullsized":"2024-09-20T21:01:28.187794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185830+0000","last_change":"2024-09-20T21:01:26.187112+0000","last_active":"2024-09-20T21:01:28.185830+0000","last_peered":"2024-09-20T21:01:28.185830+0000","last_clean":"2024-09-20T21:01:28.185830+0000","last_became_active":"2024-09-20T21:01:26.185335+0000","last_became_peered":"2024-09-20T21:01:26.185335+0000","last_unstale":"2024-09-20T21:01:28.185830+0000","last_undegraded":"2024-09-20T21:01:28.185830+0000","last_fullsized":"2024-09-20T21:01:28.185830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:16.681572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184095+0000","last_change":"2024-09-20T21:01:26.195111+0000","last_active":"2024-09-20T21:01:28.184095+0000","last_peered":"2024-09-20T21:01:28.184095+0000","last_clean":"2024-09-20T21:01:28.184095+0000","last_became_active":"2024-09-20T21:01:26.194334+0000","last_became_peered":"2024-09-20T21:01:26.194334+0000","last_unstale":"2024-09-20T21:01:28.184095+0000","last_undegraded":"2024-09-20T21:01:28.184095+0000","last_fullsized":"2024-09-20T21:01:28.184095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:32.305202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184155+0000","last_change":"2024-09-20T21:01:26.187350+0000","last_active":"2024-09-20T21:01:28.184155+0000","last_peered":"2024-09-20T21:01:28.184155+0000","last_clean":"2024-09-20T21:01:28.184155+0000","last_became_active":"2024-09-20T21:01:26.185422+0000","last_became_peered":"2024-09-20T21:01:26.185422+0000","last_unstale":"2024-09-20T21:01:28.184155+0000","last_undegraded":"2024-09-20T21:01:28.184155+0000","last_fullsized":"2024-09-20T21:01:28.184155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:54:07.656861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184873+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:01:28.184873+0000","last_peered":"2024-09-20T21:01:28.184873+0000","last_clean":"2024-09-20T21:01:28.184873+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:01:28.184873+0000","last_undegraded":"2024-09-20T21:01:28.184873+0000","last_fullsized":"2024-09-20T21:01:28.184873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187799+0000","last_change":"2024-09-20T21:01:12.240432+0000","last_active":"2024-09-20T21:01:28.187799+0000","last_peered":"2024-09-20T21:01:28.187799+0000","last_clean":"2024-09-20T21:01:28.187799+0000","last_became_active":"2024-09-20T21:01:12.238826+0000","last_became_peered":"2024-09-20T21:01:12.238826+0000","last_unstale":"2024-09-20T21:01:28.187799+0000","last_undegraded":"2024-09-20T21:01:28.187799+0000","last_fullsized":"2024-09-20T21:01:28.187799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184590+0000","last_change":"2024-09-20T21:01:26.195459+0000","last_active":"2024-09-20T21:01:28.184590+0000","last_peered":"2024-09-20T21:01:28.184590+0000","last_clean":"2024-09-20T21:01:28.184590+0000","last_became_active":"2024-09-20T21:01:26.194481+0000","last_became_peered":"2024-09-20T21:01:26.194481+0000","last_unstale":"2024-09-20T21:01:28.184590+0000","last_undegraded":"2024-09-20T21:01:28.184590+0000","last_fullsized":"2024-09-20T21:01:28.184590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:26.903534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187820+0000","last_change":"2024-09-20T21:01:12.229580+0000","last_active":"2024-09-20T21:01:28.187820+0000","last_peered":"2024-09-20T21:01:28.187820+0000","last_clean":"2024-09-20T21:01:28.187820+0000","last_became_active":"2024-09-20T21:01:12.226915+0000","last_became_peered":"2024-09-20T21:01:12.226915+0000","last_unstale":"2024-09-20T21:01:28.187820+0000","last_undegraded":"2024-09-20T21:01:28.187820+0000","last_fullsized":"2024-09-20T21:01:28.187820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.985765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187621+0000","last_change":"2024-09-20T21:01:12.230410+0000","last_active":"2024-09-20T21:01:28.187621+0000","last_peered":"2024-09-20T21:01:28.187621+0000","last_clean":"2024-09-20T21:01:28.187621+0000","last_became_active":"2024-09-20T21:01:12.229859+0000","last_became_peered":"2024-09-20T21:01:12.229859+0000","last_unstale":"2024-09-20T21:01:28.187621+0000","last_undegraded":"2024-09-20T21:01:28.187621+0000","last_fullsized":"2024-09-20T21:01:28.187621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187052+0000","last_change":"2024-09-20T21:01:26.184671+0000","last_active":"2024-09-20T21:01:28.187052+0000","last_peered":"2024-09-20T21:01:28.187052+0000","last_clean":"2024-09-20T21:01:28.187052+0000","last_became_active":"2024-09-20T21:01:26.183545+0000","last_became_peered":"2024-09-20T21:01:26.183545+0000","last_unstale":"2024-09-20T21:01:28.187052+0000","last_undegraded":"2024-09-20T21:01:28.187052+0000","last_fullsized":"2024-09-20T21:01:28.187052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:55.984268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187053+0000","last_change":"2024-09-20T21:01:26.190382+0000","last_active":"2024-09-20T21:01:28.187053+0000","last_peered":"2024-09-20T21:01:28.187053+0000","last_clean":"2024-09-20T21:01:28.187053+0000","last_became_active":"2024-09-20T21:01:26.186214+0000","last_became_peered":"2024-09-20T21:01:26.186214+0000","last_unstale":"2024-09-20T21:01:28.187053+0000","last_undegraded":"2024-09-20T21:01:28.187053+0000","last_fullsized":"2024-09-20T21:01:28.187053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:54:07.656861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184304+0000","last_change":"2024-09-20T21:01:26.186757+0000","last_active":"2024-09-20T21:01:28.184304+0000","last_peered":"2024-09-20T21:01:28.184304+0000","last_clean":"2024-09-20T21:01:28.184304+0000","last_became_active":"2024-09-20T21:01:26.184738+0000","last_became_peered":"2024-09-20T21:01:26.184738+0000","last_unstale":"2024-09-20T21:01:28.184304+0000","last_undegraded":"2024-09-20T21:01:28.184304+0000","last_fullsized":"2024-09-20T21:01:28.184304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:56.030003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185327+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:01:28.185327+0000","last_peered":"2024-09-20T21:01:28.185327+0000","last_clean":"2024-09-20T21:01:28.185327+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:01:28.185327+0000","last_undegraded":"2024-09-20T21:01:28.185327+0000","last_fullsized":"2024-09-20T21:01:28.185327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188067+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:01:28.188067+0000","last_peered":"2024-09-20T21:01:28.188067+0000","last_clean":"2024-09-20T21:01:28.188067+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:01:28.188067+0000","last_undegraded":"2024-09-20T21:01:28.188067+0000","last_fullsized":"2024-09-20T21:01:28.188067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184424+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:01:28.184424+0000","last_peered":"2024-09-20T21:01:28.184424+0000","last_clean":"2024-09-20T21:01:28.184424+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:01:28.184424+0000","last_undegraded":"2024-09-20T21:01:28.184424+0000","last_fullsized":"2024-09-20T21:01:28.184424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184846+0000","last_change":"2024-09-20T21:01:26.187783+0000","last_active":"2024-09-20T21:01:28.184846+0000","last_peered":"2024-09-20T21:01:28.184846+0000","last_clean":"2024-09-20T21:01:28.184846+0000","last_became_active":"2024-09-20T21:01:26.185081+0000","last_became_peered":"2024-09-20T21:01:26.185081+0000","last_unstale":"2024-09-20T21:01:28.184846+0000","last_undegraded":"2024-09-20T21:01:28.184846+0000","last_fullsized":"2024-09-20T21:01:28.184846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185875+0000","last_change":"2024-09-20T21:01:26.197852+0000","last_active":"2024-09-20T21:01:28.185875+0000","last_peered":"2024-09-20T21:01:28.185875+0000","last_clean":"2024-09-20T21:01:28.185875+0000","last_became_active":"2024-09-20T21:01:26.195824+0000","last_became_peered":"2024-09-20T21:01:26.195824+0000","last_unstale":"2024-09-20T21:01:28.185875+0000","last_undegraded":"2024-09-20T21:01:28.185875+0000","last_fullsized":"2024-09-20T21:01:28.185875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:41:54.555337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187124+0000","last_change":"2024-09-20T21:01:12.230375+0000","last_active":"2024-09-20T21:01:28.187124+0000","last_peered":"2024-09-20T21:01:28.187124+0000","last_clean":"2024-09-20T21:01:28.187124+0000","last_became_active":"2024-09-20T21:01:12.228679+0000","last_became_peered":"2024-09-20T21:01:12.228679+0000","last_unstale":"2024-09-20T21:01:28.187124+0000","last_undegraded":"2024-09-20T21:01:28.187124+0000","last_fullsized":"2024-09-20T21:01:28.187124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184187+0000","last_change":"2024-09-20T21:01:12.214484+0000","last_active":"2024-09-20T21:01:28.184187+0000","last_peered":"2024-09-20T21:01:28.184187+0000","last_clean":"2024-09-20T21:01:28.184187+0000","last_became_active":"2024-09-20T21:01:12.212293+0000","last_became_peered":"2024-09-20T21:01:12.212293+0000","last_unstale":"2024-09-20T21:01:28.184187+0000","last_undegraded":"2024-09-20T21:01:28.184187+0000","last_fullsized":"2024-09-20T21:01:28.184187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187060+0000","last_change":"2024-09-20T21:01:12.229114+0000","last_active":"2024-09-20T21:01:28.187060+0000","last_peered":"2024-09-20T21:01:28.187060+0000","last_clean":"2024-09-20T21:01:28.187060+0000","last_became_active":"2024-09-20T21:01:12.227812+0000","last_became_peered":"2024-09-20T21:01:12.227812+0000","last_unstale":"2024-09-20T21:01:28.187060+0000","last_undegraded":"2024-09-20T21:01:28.187060+0000","last_fullsized":"2024-09-20T21:01:28.187060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:02.638461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188967+0000","last_change":"2024-09-20T21:01:12.237926+0000","last_active":"2024-09-20T21:01:28.188967+0000","last_peered":"2024-09-20T21:01:28.188967+0000","last_clean":"2024-09-20T21:01:28.188967+0000","last_became_active":"2024-09-20T21:01:12.234061+0000","last_became_peered":"2024-09-20T21:01:12.234061+0000","last_unstale":"2024-09-20T21:01:28.188967+0000","last_undegraded":"2024-09-20T21:01:28.188967+0000","last_fullsized":"2024-09-20T21:01:28.188967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185051+0000","last_change":"2024-09-20T21:01:12.214728+0000","last_active":"2024-09-20T21:01:28.185051+0000","last_peered":"2024-09-20T21:01:28.185051+0000","last_clean":"2024-09-20T21:01:28.185051+0000","last_became_active":"2024-09-20T21:01:12.213159+0000","last_became_peered":"2024-09-20T21:01:12.213159+0000","last_unstale":"2024-09-20T21:01:28.185051+0000","last_undegraded":"2024-09-20T21:01:28.185051+0000","last_fullsized":"2024-09-20T21:01:28.185051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188147+0000","last_change":"2024-09-20T21:01:26.191047+0000","last_active":"2024-09-20T21:01:28.188147+0000","last_peered":"2024-09-20T21:01:28.188147+0000","last_clean":"2024-09-20T21:01:28.188147+0000","last_became_active":"2024-09-20T21:01:26.189902+0000","last_became_peered":"2024-09-20T21:01:26.189902+0000","last_unstale":"2024-09-20T21:01:28.188147+0000","last_undegraded":"2024-09-20T21:01:28.188147+0000","last_fullsized":"2024-09-20T21:01:28.188147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:15.197998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188082+0000","last_change":"2024-09-20T21:01:12.227425+0000","last_active":"2024-09-20T21:01:28.188082+0000","last_peered":"2024-09-20T21:01:28.188082+0000","last_clean":"2024-09-20T21:01:28.188082+0000","last_became_active":"2024-09-20T21:01:12.226625+0000","last_became_peered":"2024-09-20T21:01:12.226625+0000","last_unstale":"2024-09-20T21:01:28.188082+0000","last_undegraded":"2024-09-20T21:01:28.188082+0000","last_fullsized":"2024-09-20T21:01:28.188082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185728+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:01:28.185728+0000","last_peered":"2024-09-20T21:01:28.185728+0000","last_clean":"2024-09-20T21:01:28.185728+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:01:28.185728+0000","last_undegraded":"2024-09-20T21:01:28.185728+0000","last_fullsized":"2024-09-20T21:01:28.185728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187256+0000","last_change":"2024-09-20T21:01:12.230684+0000","last_active":"2024-09-20T21:01:28.187256+0000","last_peered":"2024-09-20T21:01:28.187256+0000","last_clean":"2024-09-20T21:01:28.187256+0000","last_became_active":"2024-09-20T21:01:12.229915+0000","last_became_peered":"2024-09-20T21:01:12.229915+0000","last_unstale":"2024-09-20T21:01:28.187256+0000","last_undegraded":"2024-09-20T21:01:28.187256+0000","last_fullsized":"2024-09-20T21:01:28.187256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184197+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:01:28.184197+0000","last_peered":"2024-09-20T21:01:28.184197+0000","last_clean":"2024-09-20T21:01:28.184197+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:01:28.184197+0000","last_undegraded":"2024-09-20T21:01:28.184197+0000","last_fullsized":"2024-09-20T21:01:28.184197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184481+0000","last_change":"2024-09-20T21:01:26.187763+0000","last_active":"2024-09-20T21:01:28.184481+0000","last_peered":"2024-09-20T21:01:28.184481+0000","last_clean":"2024-09-20T21:01:28.184481+0000","last_became_active":"2024-09-20T21:01:26.185774+0000","last_became_peered":"2024-09-20T21:01:26.185774+0000","last_unstale":"2024-09-20T21:01:28.184481+0000","last_undegraded":"2024-09-20T21:01:28.184481+0000","last_fullsized":"2024-09-20T21:01:28.184481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:07.330848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188031+0000","last_change":"2024-09-20T21:01:12.232814+0000","last_active":"2024-09-20T21:01:28.188031+0000","last_peered":"2024-09-20T21:01:28.188031+0000","last_clean":"2024-09-20T21:01:28.188031+0000","last_became_active":"2024-09-20T21:01:12.232026+0000","last_became_peered":"2024-09-20T21:01:12.232026+0000","last_unstale":"2024-09-20T21:01:28.188031+0000","last_undegraded":"2024-09-20T21:01:28.188031+0000","last_fullsized":"2024-09-20T21:01:28.188031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185542+0000","last_change":"2024-09-20T21:01:26.197377+0000","last_active":"2024-09-20T21:01:28.185542+0000","last_peered":"2024-09-20T21:01:28.185542+0000","last_clean":"2024-09-20T21:01:28.185542+0000","last_became_active":"2024-09-20T21:01:26.194232+0000","last_became_peered":"2024-09-20T21:01:26.194232+0000","last_unstale":"2024-09-20T21:01:28.185542+0000","last_undegraded":"2024-09-20T21:01:28.185542+0000","last_fullsized":"2024-09-20T21:01:28.185542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:16.800376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187783+0000","last_change":"2024-09-20T21:01:12.230727+0000","last_active":"2024-09-20T21:01:28.187783+0000","last_peered":"2024-09-20T21:01:28.187783+0000","last_clean":"2024-09-20T21:01:28.187783+0000","last_became_active":"2024-09-20T21:01:12.229987+0000","last_became_peered":"2024-09-20T21:01:12.229987+0000","last_unstale":"2024-09-20T21:01:28.187783+0000","last_undegraded":"2024-09-20T21:01:28.187783+0000","last_fullsized":"2024-09-20T21:01:28.187783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.186110+0000","last_change":"2024-09-20T21:01:11.220335+0000","last_active":"2024-09-20T21:01:28.186110+0000","last_peered":"2024-09-20T21:01:28.186110+0000","last_clean":"2024-09-20T21:01:28.186110+0000","last_became_active":"2024-09-20T21:01:11.219506+0000","last_became_peered":"2024-09-20T21:01:11.219506+0000","last_unstale":"2024-09-20T21:01:28.186110+0000","last_undegraded":"2024-09-20T21:01:28.186110+0000","last_fullsized":"2024-09-20T21:01:28.186110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:16:05.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185461+0000","last_change":"2024-09-20T21:01:12.214329+0000","last_active":"2024-09-20T21:01:28.185461+0000","last_peered":"2024-09-20T21:01:28.185461+0000","last_clean":"2024-09-20T21:01:28.185461+0000","last_became_active":"2024-09-20T21:01:12.212104+0000","last_became_peered":"2024-09-20T21:01:12.212104+0000","last_unstale":"2024-09-20T21:01:28.185461+0000","last_undegraded":"2024-09-20T21:01:28.185461+0000","last_fullsized":"2024-09-20T21:01:28.185461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187594+0000","last_change":"2024-09-20T21:01:11.213590+0000","last_active":"2024-09-20T21:01:28.187594+0000","last_peered":"2024-09-20T21:01:28.187594+0000","last_clean":"2024-09-20T21:01:28.187594+0000","last_became_active":"2024-09-20T21:01:11.212919+0000","last_became_peered":"2024-09-20T21:01:11.212919+0000","last_unstale":"2024-09-20T21:01:28.187594+0000","last_undegraded":"2024-09-20T21:01:28.187594+0000","last_fullsized":"2024-09-20T21:01:28.187594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.040754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184974+0000","last_change":"2024-09-20T21:01:12.214556+0000","last_active":"2024-09-20T21:01:28.184974+0000","last_peered":"2024-09-20T21:01:28.184974+0000","last_clean":"2024-09-20T21:01:28.184974+0000","last_became_active":"2024-09-20T21:01:12.212508+0000","last_became_peered":"2024-09-20T21:01:12.212508+0000","last_unstale":"2024-09-20T21:01:28.184974+0000","last_undegraded":"2024-09-20T21:01:28.184974+0000","last_fullsized":"2024-09-20T21:01:28.184974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.186981+0000","last_change":"2024-09-20T21:01:26.192597+0000","last_active":"2024-09-20T21:01:28.186981+0000","last_peered":"2024-09-20T21:01:28.186981+0000","last_clean":"2024-09-20T21:01:28.186981+0000","last_became_active":"2024-09-20T21:01:26.190364+0000","last_became_peered":"2024-09-20T21:01:26.190364+0000","last_unstale":"2024-09-20T21:01:28.186981+0000","last_undegraded":"2024-09-20T21:01:28.186981+0000","last_fullsized":"2024-09-20T21:01:28.186981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:26.013177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"24'618","reported_seq":632,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.941848+0000","last_change":"2024-09-20T21:01:26.187301+0000","last_active":"2024-09-20T21:01:29.941848+0000","last_peered":"2024-09-20T21:01:29.941848+0000","last_clean":"2024-09-20T21:01:29.941848+0000","last_became_active":"2024-09-20T21:01:26.184620+0000","last_became_peered":"2024-09-20T21:01:26.184620+0000","last_unstale":"2024-09-20T21:01:29.941848+0000","last_undegraded":"2024-09-20T21:01:29.941848+0000","last_fullsized":"2024-09-20T21:01:29.941848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:40.880801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40501248,"num_objects":618,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":618,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":39552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.189368+0000","last_change":"2024-09-20T21:01:26.189708+0000","last_active":"2024-09-20T21:01:28.189368+0000","last_peered":"2024-09-20T21:01:28.189368+0000","last_clean":"2024-09-20T21:01:28.189368+0000","last_became_active":"2024-09-20T21:01:26.187755+0000","last_became_peered":"2024-09-20T21:01:26.187755+0000","last_unstale":"2024-09-20T21:01:28.189368+0000","last_undegraded":"2024-09-20T21:01:28.189368+0000","last_fullsized":"2024-09-20T21:01:28.189368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:22.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187155+0000","last_change":"2024-09-20T21:01:12.229503+0000","last_active":"2024-09-20T21:01:28.187155+0000","last_peered":"2024-09-20T21:01:28.187155+0000","last_clean":"2024-09-20T21:01:28.187155+0000","last_became_active":"2024-09-20T21:01:12.228540+0000","last_became_peered":"2024-09-20T21:01:12.228540+0000","last_unstale":"2024-09-20T21:01:28.187155+0000","last_undegraded":"2024-09-20T21:01:28.187155+0000","last_fullsized":"2024-09-20T21:01:28.187155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:13.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"24'604","reported_seq":618,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.934037+0000","last_change":"2024-09-20T21:01:26.198531+0000","last_active":"2024-09-20T21:01:29.934037+0000","last_peered":"2024-09-20T21:01:29.934037+0000","last_clean":"2024-09-20T21:01:29.934037+0000","last_became_active":"2024-09-20T21:01:26.198133+0000","last_became_peered":"2024-09-20T21:01:26.198133+0000","last_unstale":"2024-09-20T21:01:29.934037+0000","last_undegraded":"2024-09-20T21:01:29.934037+0000","last_fullsized":"2024-09-20T21:01:29.934037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:54.516925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39583744,"num_objects":604,"num_object_clones":0,"num_object_copies":1208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188200+0000","last_change":"2024-09-20T21:01:11.214247+0000","last_active":"2024-09-20T21:01:28.188200+0000","last_peered":"2024-09-20T21:01:28.188200+0000","last_clean":"2024-09-20T21:01:28.188200+0000","last_became_active":"2024-09-20T21:01:11.212760+0000","last_became_peered":"2024-09-20T21:01:11.212760+0000","last_unstale":"2024-09-20T21:01:28.188200+0000","last_undegraded":"2024-09-20T21:01:28.188200+0000","last_fullsized":"2024-09-20T21:01:28.188200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:20.108703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187126+0000","last_change":"2024-09-20T21:01:12.238294+0000","last_active":"2024-09-20T21:01:28.187126+0000","last_peered":"2024-09-20T21:01:28.187126+0000","last_clean":"2024-09-20T21:01:28.187126+0000","last_became_active":"2024-09-20T21:01:12.237461+0000","last_became_peered":"2024-09-20T21:01:12.237461+0000","last_unstale":"2024-09-20T21:01:28.187126+0000","last_undegraded":"2024-09-20T21:01:28.187126+0000","last_fullsized":"2024-09-20T21:01:28.187126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:11.215425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"24'601","reported_seq":615,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.939524+0000","last_change":"2024-09-20T21:01:26.189622+0000","last_active":"2024-09-20T21:01:29.939524+0000","last_peered":"2024-09-20T21:01:29.939524+0000","last_clean":"2024-09-20T21:01:29.939524+0000","last_became_active":"2024-09-20T21:01:26.186385+0000","last_became_peered":"2024-09-20T21:01:26.186385+0000","last_unstale":"2024-09-20T21:01:29.939524+0000","last_undegraded":"2024-09-20T21:01:29.939524+0000","last_fullsized":"2024-09-20T21:01:29.939524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:50.339650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39387136,"num_objects":601,"num_object_clones":0,"num_object_copies":1202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":601,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":601,"num_write_kb":38464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187709+0000","last_change":"2024-09-20T21:01:26.195674+0000","last_active":"2024-09-20T21:01:28.187709+0000","last_peered":"2024-09-20T21:01:28.187709+0000","last_clean":"2024-09-20T21:01:28.187709+0000","last_became_active":"2024-09-20T21:01:26.194725+0000","last_became_peered":"2024-09-20T21:01:26.194725+0000","last_unstale":"2024-09-20T21:01:28.187709+0000","last_undegraded":"2024-09-20T21:01:28.187709+0000","last_fullsized":"2024-09-20T21:01:28.187709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:06:30.103410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.186236+0000","last_change":"2024-09-20T21:01:26.187349+0000","last_active":"2024-09-20T21:01:28.186236+0000","last_peered":"2024-09-20T21:01:28.186236+0000","last_clean":"2024-09-20T21:01:28.186236+0000","last_became_active":"2024-09-20T21:01:26.185876+0000","last_became_peered":"2024-09-20T21:01:26.185876+0000","last_unstale":"2024-09-20T21:01:28.186236+0000","last_undegraded":"2024-09-20T21:01:28.186236+0000","last_fullsized":"2024-09-20T21:01:28.186236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:48.846118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"24'611","reported_seq":625,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.937464+0000","last_change":"2024-09-20T21:01:26.189804+0000","last_active":"2024-09-20T21:01:29.937464+0000","last_peered":"2024-09-20T21:01:29.937464+0000","last_clean":"2024-09-20T21:01:29.937464+0000","last_became_active":"2024-09-20T21:01:26.187924+0000","last_became_peered":"2024-09-20T21:01:26.187924+0000","last_unstale":"2024-09-20T21:01:29.937464+0000","last_undegraded":"2024-09-20T21:01:29.937464+0000","last_fullsized":"2024-09-20T21:01:29.937464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:35:44.867498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40042496,"num_objects":611,"num_object_clones":0,"num_object_copies":1222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":611,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":611,"num_write_kb":39104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184628+0000","last_change":"2024-09-20T21:01:26.189711+0000","last_active":"2024-09-20T21:01:28.184628+0000","last_peered":"2024-09-20T21:01:28.184628+0000","last_clean":"2024-09-20T21:01:28.184628+0000","last_became_active":"2024-09-20T21:01:26.187708+0000","last_became_peered":"2024-09-20T21:01:26.187708+0000","last_unstale":"2024-09-20T21:01:28.184628+0000","last_undegraded":"2024-09-20T21:01:28.184628+0000","last_fullsized":"2024-09-20T21:01:28.184628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:31:35.980589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185597+0000","last_change":"2024-09-20T21:01:12.220592+0000","last_active":"2024-09-20T21:01:28.185597+0000","last_peered":"2024-09-20T21:01:28.185597+0000","last_clean":"2024-09-20T21:01:28.185597+0000","last_became_active":"2024-09-20T21:01:12.219682+0000","last_became_peered":"2024-09-20T21:01:12.219682+0000","last_unstale":"2024-09-20T21:01:28.185597+0000","last_undegraded":"2024-09-20T21:01:28.185597+0000","last_fullsized":"2024-09-20T21:01:28.185597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"24'542","reported_seq":555,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.943141+0000","last_change":"2024-09-20T21:01:26.196437+0000","last_active":"2024-09-20T21:01:29.943141+0000","last_peered":"2024-09-20T21:01:29.943141+0000","last_clean":"2024-09-20T21:01:29.943141+0000","last_became_active":"2024-09-20T21:01:26.195712+0000","last_became_peered":"2024-09-20T21:01:26.195712+0000","last_unstale":"2024-09-20T21:01:29.943141+0000","last_undegraded":"2024-09-20T21:01:29.943141+0000","last_fullsized":"2024-09-20T21:01:29.943141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:56:20.379997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35520512,"num_objects":542,"num_object_clones":0,"num_object_copies":1084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":34688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185844+0000","last_change":"2024-09-20T21:01:11.220548+0000","last_active":"2024-09-20T21:01:28.185844+0000","last_peered":"2024-09-20T21:01:28.185844+0000","last_clean":"2024-09-20T21:01:28.185844+0000","last_became_active":"2024-09-20T21:01:11.219847+0000","last_became_peered":"2024-09-20T21:01:11.219847+0000","last_unstale":"2024-09-20T21:01:28.185844+0000","last_undegraded":"2024-09-20T21:01:28.185844+0000","last_fullsized":"2024-09-20T21:01:28.185844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184408+0000","last_change":"2024-09-20T21:01:26.189300+0000","last_active":"2024-09-20T21:01:28.184408+0000","last_peered":"2024-09-20T21:01:28.184408+0000","last_clean":"2024-09-20T21:01:28.184408+0000","last_became_active":"2024-09-20T21:01:26.186381+0000","last_became_peered":"2024-09-20T21:01:26.186381+0000","last_unstale":"2024-09-20T21:01:28.184408+0000","last_undegraded":"2024-09-20T21:01:28.184408+0000","last_fullsized":"2024-09-20T21:01:28.184408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:15.197998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"24'587","reported_seq":600,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.933692+0000","last_change":"2024-09-20T21:01:26.185429+0000","last_active":"2024-09-20T21:01:29.933692+0000","last_peered":"2024-09-20T21:01:29.933692+0000","last_clean":"2024-09-20T21:01:29.933692+0000","last_became_active":"2024-09-20T21:01:26.184548+0000","last_became_peered":"2024-09-20T21:01:26.184548+0000","last_unstale":"2024-09-20T21:01:29.933692+0000","last_undegraded":"2024-09-20T21:01:29.933692+0000","last_fullsized":"2024-09-20T21:01:29.933692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:23.837807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38469632,"num_objects":587,"num_object_clones":0,"num_object_copies":1174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":587,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.186036+0000","last_change":"2024-09-20T21:01:26.187643+0000","last_active":"2024-09-20T21:01:28.186036+0000","last_peered":"2024-09-20T21:01:28.186036+0000","last_clean":"2024-09-20T21:01:28.186036+0000","last_became_active":"2024-09-20T21:01:26.186342+0000","last_became_peered":"2024-09-20T21:01:26.186342+0000","last_unstale":"2024-09-20T21:01:28.186036+0000","last_undegraded":"2024-09-20T21:01:28.186036+0000","last_fullsized":"2024-09-20T21:01:28.186036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:40.496914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188113+0000","last_change":"2024-09-20T21:01:26.190975+0000","last_active":"2024-09-20T21:01:28.188113+0000","last_peered":"2024-09-20T21:01:28.188113+0000","last_clean":"2024-09-20T21:01:28.188113+0000","last_became_active":"2024-09-20T21:01:26.187528+0000","last_became_peered":"2024-09-20T21:01:26.187528+0000","last_unstale":"2024-09-20T21:01:28.188113+0000","last_undegraded":"2024-09-20T21:01:28.188113+0000","last_fullsized":"2024-09-20T21:01:28.188113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"24'665","reported_seq":678,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.942491+0000","last_change":"2024-09-20T21:01:26.191101+0000","last_active":"2024-09-20T21:01:29.942491+0000","last_peered":"2024-09-20T21:01:29.942491+0000","last_clean":"2024-09-20T21:01:29.942491+0000","last_became_active":"2024-09-20T21:01:26.190000+0000","last_became_peered":"2024-09-20T21:01:26.190000+0000","last_unstale":"2024-09-20T21:01:29.942491+0000","last_undegraded":"2024-09-20T21:01:29.942491+0000","last_fullsized":"2024-09-20T21:01:29.942491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:53.347202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43581440,"num_objects":665,"num_object_clones":0,"num_object_copies":1330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":42560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187692+0000","last_change":"2024-09-20T21:01:11.213371+0000","last_active":"2024-09-20T21:01:28.187692+0000","last_peered":"2024-09-20T21:01:28.187692+0000","last_clean":"2024-09-20T21:01:28.187692+0000","last_became_active":"2024-09-20T21:01:11.212385+0000","last_became_peered":"2024-09-20T21:01:11.212385+0000","last_unstale":"2024-09-20T21:01:28.187692+0000","last_undegraded":"2024-09-20T21:01:28.187692+0000","last_fullsized":"2024-09-20T21:01:28.187692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:56.734999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187502+0000","last_change":"2024-09-20T21:01:26.190179+0000","last_active":"2024-09-20T21:01:28.187502+0000","last_peered":"2024-09-20T21:01:28.187502+0000","last_clean":"2024-09-20T21:01:28.187502+0000","last_became_active":"2024-09-20T21:01:26.187701+0000","last_became_peered":"2024-09-20T21:01:26.187701+0000","last_unstale":"2024-09-20T21:01:28.187502+0000","last_undegraded":"2024-09-20T21:01:28.187502+0000","last_fullsized":"2024-09-20T21:01:28.187502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:48.846118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"24'612","reported_seq":623,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.939807+0000","last_change":"2024-09-20T21:01:26.192961+0000","last_active":"2024-09-20T21:01:29.939807+0000","last_peered":"2024-09-20T21:01:29.939807+0000","last_clean":"2024-09-20T21:01:29.939807+0000","last_became_active":"2024-09-20T21:01:26.192159+0000","last_became_peered":"2024-09-20T21:01:26.192159+0000","last_unstale":"2024-09-20T21:01:29.939807+0000","last_undegraded":"2024-09-20T21:01:29.939807+0000","last_fullsized":"2024-09-20T21:01:29.939807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:50.672763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40108032,"num_objects":612,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187188+0000","last_change":"2024-09-20T21:01:11.220785+0000","last_active":"2024-09-20T21:01:28.187188+0000","last_peered":"2024-09-20T21:01:28.187188+0000","last_clean":"2024-09-20T21:01:28.187188+0000","last_became_active":"2024-09-20T21:01:11.220111+0000","last_became_peered":"2024-09-20T21:01:11.220111+0000","last_unstale":"2024-09-20T21:01:28.187188+0000","last_undegraded":"2024-09-20T21:01:28.187188+0000","last_fullsized":"2024-09-20T21:01:28.187188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.621763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184978+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:01:28.184978+0000","last_peered":"2024-09-20T21:01:28.184978+0000","last_clean":"2024-09-20T21:01:28.184978+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:01:28.184978+0000","last_undegraded":"2024-09-20T21:01:28.184978+0000","last_fullsized":"2024-09-20T21:01:28.184978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"24'585","reported_seq":597,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.943392+0000","last_change":"2024-09-20T21:01:26.190940+0000","last_active":"2024-09-20T21:01:29.943392+0000","last_peered":"2024-09-20T21:01:29.943392+0000","last_clean":"2024-09-20T21:01:29.943392+0000","last_became_active":"2024-09-20T21:01:26.189653+0000","last_became_peered":"2024-09-20T21:01:26.189653+0000","last_unstale":"2024-09-20T21:01:29.943392+0000","last_undegraded":"2024-09-20T21:01:29.943392+0000","last_fullsized":"2024-09-20T21:01:29.943392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:08.532604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38338560,"num_objects":585,"num_object_clones":0,"num_object_copies":1170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":585,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":220,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187637+0000","last_change":"2024-09-20T21:01:26.190970+0000","last_active":"2024-09-20T21:01:28.187637+0000","last_peered":"2024-09-20T21:01:28.187637+0000","last_clean":"2024-09-20T21:01:28.187637+0000","last_became_active":"2024-09-20T21:01:26.186126+0000","last_became_peered":"2024-09-20T21:01:26.186126+0000","last_unstale":"2024-09-20T21:01:28.187637+0000","last_undegraded":"2024-09-20T21:01:28.187637+0000","last_fullsized":"2024-09-20T21:01:28.187637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:46.927072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185985+0000","last_change":"2024-09-20T21:01:26.198209+0000","last_active":"2024-09-20T21:01:28.185985+0000","last_peered":"2024-09-20T21:01:28.185985+0000","last_clean":"2024-09-20T21:01:28.185985+0000","last_became_active":"2024-09-20T21:01:26.197583+0000","last_became_peered":"2024-09-20T21:01:26.197583+0000","last_unstale":"2024-09-20T21:01:28.185985+0000","last_undegraded":"2024-09-20T21:01:28.185985+0000","last_fullsized":"2024-09-20T21:01:28.185985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:56:01.208657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.186194+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:01:28.186194+0000","last_peered":"2024-09-20T21:01:28.186194+0000","last_clean":"2024-09-20T21:01:28.186194+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:01:28.186194+0000","last_undegraded":"2024-09-20T21:01:28.186194+0000","last_fullsized":"2024-09-20T21:01:28.186194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187621+0000","last_change":"2024-09-20T21:01:26.192534+0000","last_active":"2024-09-20T21:01:28.187621+0000","last_peered":"2024-09-20T21:01:28.187621+0000","last_clean":"2024-09-20T21:01:28.187621+0000","last_became_active":"2024-09-20T21:01:26.190015+0000","last_became_peered":"2024-09-20T21:01:26.190015+0000","last_unstale":"2024-09-20T21:01:28.187621+0000","last_undegraded":"2024-09-20T21:01:28.187621+0000","last_fullsized":"2024-09-20T21:01:28.187621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:31:36.992486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"24'573","reported_seq":586,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.935393+0000","last_change":"2024-09-20T21:01:26.185969+0000","last_active":"2024-09-20T21:01:29.935393+0000","last_peered":"2024-09-20T21:01:29.935393+0000","last_clean":"2024-09-20T21:01:29.935393+0000","last_became_active":"2024-09-20T21:01:26.185337+0000","last_became_peered":"2024-09-20T21:01:26.185337+0000","last_unstale":"2024-09-20T21:01:29.935393+0000","last_undegraded":"2024-09-20T21:01:29.935393+0000","last_fullsized":"2024-09-20T21:01:29.935393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.883963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37552128,"num_objects":573,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":573,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573,"num_write_kb":36672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187477+0000","last_change":"2024-09-20T21:01:26.192040+0000","last_active":"2024-09-20T21:01:28.187477+0000","last_peered":"2024-09-20T21:01:28.187477+0000","last_clean":"2024-09-20T21:01:28.187477+0000","last_became_active":"2024-09-20T21:01:26.189641+0000","last_became_peered":"2024-09-20T21:01:26.189641+0000","last_unstale":"2024-09-20T21:01:28.187477+0000","last_undegraded":"2024-09-20T21:01:28.187477+0000","last_fullsized":"2024-09-20T21:01:28.187477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:25:21.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184434+0000","last_change":"2024-09-20T21:01:11.220462+0000","last_active":"2024-09-20T21:01:28.184434+0000","last_peered":"2024-09-20T21:01:28.184434+0000","last_clean":"2024-09-20T21:01:28.184434+0000","last_became_active":"2024-09-20T21:01:11.219778+0000","last_became_peered":"2024-09-20T21:01:11.219778+0000","last_unstale":"2024-09-20T21:01:28.184434+0000","last_undegraded":"2024-09-20T21:01:28.184434+0000","last_fullsized":"2024-09-20T21:01:28.184434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:08.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188160+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:01:28.188160+0000","last_peered":"2024-09-20T21:01:28.188160+0000","last_clean":"2024-09-20T21:01:28.188160+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:01:28.188160+0000","last_undegraded":"2024-09-20T21:01:28.188160+0000","last_fullsized":"2024-09-20T21:01:28.188160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"24'621","reported_seq":634,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.933853+0000","last_change":"2024-09-20T21:01:26.193658+0000","last_active":"2024-09-20T21:01:29.933853+0000","last_peered":"2024-09-20T21:01:29.933853+0000","last_clean":"2024-09-20T21:01:29.933853+0000","last_became_active":"2024-09-20T21:01:26.193005+0000","last_became_peered":"2024-09-20T21:01:26.193005+0000","last_unstale":"2024-09-20T21:01:29.933853+0000","last_undegraded":"2024-09-20T21:01:29.933853+0000","last_fullsized":"2024-09-20T21:01:29.933853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:46.866571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40697856,"num_objects":621,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":621,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184541+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:01:28.184541+0000","last_peered":"2024-09-20T21:01:28.184541+0000","last_clean":"2024-09-20T21:01:28.184541+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:01:28.184541+0000","last_undegraded":"2024-09-20T21:01:28.184541+0000","last_fullsized":"2024-09-20T21:01:28.184541+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187273+0000","last_change":"2024-09-20T21:01:11.217295+0000","last_active":"2024-09-20T21:01:28.187273+0000","last_peered":"2024-09-20T21:01:28.187273+0000","last_clean":"2024-09-20T21:01:28.187273+0000","last_became_active":"2024-09-20T21:01:11.216350+0000","last_became_peered":"2024-09-20T21:01:11.216350+0000","last_unstale":"2024-09-20T21:01:28.187273+0000","last_undegraded":"2024-09-20T21:01:28.187273+0000","last_fullsized":"2024-09-20T21:01:28.187273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:59.661622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185064+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:01:28.185064+0000","last_peered":"2024-09-20T21:01:28.185064+0000","last_clean":"2024-09-20T21:01:28.185064+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:01:28.185064+0000","last_undegraded":"2024-09-20T21:01:28.185064+0000","last_fullsized":"2024-09-20T21:01:28.185064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"24'608","reported_seq":621,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.933669+0000","last_change":"2024-09-20T21:01:26.195204+0000","last_active":"2024-09-20T21:01:29.933669+0000","last_peered":"2024-09-20T21:01:29.933669+0000","last_clean":"2024-09-20T21:01:29.933669+0000","last_became_active":"2024-09-20T21:01:26.193385+0000","last_became_peered":"2024-09-20T21:01:26.193385+0000","last_unstale":"2024-09-20T21:01:29.933669+0000","last_undegraded":"2024-09-20T21:01:29.933669+0000","last_fullsized":"2024-09-20T21:01:29.933669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:50.379400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":608,"num_object_clones":0,"num_object_copies":1216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.186347+0000","last_change":"2024-09-20T21:01:26.193870+0000","last_active":"2024-09-20T21:01:28.186347+0000","last_peered":"2024-09-20T21:01:28.186347+0000","last_clean":"2024-09-20T21:01:28.186347+0000","last_became_active":"2024-09-20T21:01:26.193552+0000","last_became_peered":"2024-09-20T21:01:26.193552+0000","last_unstale":"2024-09-20T21:01:28.186347+0000","last_undegraded":"2024-09-20T21:01:28.186347+0000","last_fullsized":"2024-09-20T21:01:28.186347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:32:52.139650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185762+0000","last_change":"2024-09-20T21:01:26.198203+0000","last_active":"2024-09-20T21:01:28.185762+0000","last_peered":"2024-09-20T21:01:28.185762+0000","last_clean":"2024-09-20T21:01:28.185762+0000","last_became_active":"2024-09-20T21:01:26.196361+0000","last_became_peered":"2024-09-20T21:01:26.196361+0000","last_unstale":"2024-09-20T21:01:28.185762+0000","last_undegraded":"2024-09-20T21:01:28.185762+0000","last_fullsized":"2024-09-20T21:01:28.185762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:35.683600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184866+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:01:28.184866+0000","last_peered":"2024-09-20T21:01:28.184866+0000","last_clean":"2024-09-20T21:01:28.184866+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:01:28.184866+0000","last_undegraded":"2024-09-20T21:01:28.184866+0000","last_fullsized":"2024-09-20T21:01:28.184866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"24'612","reported_seq":626,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.933863+0000","last_change":"2024-09-20T21:01:26.187690+0000","last_active":"2024-09-20T21:01:29.933863+0000","last_peered":"2024-09-20T21:01:29.933863+0000","last_clean":"2024-09-20T21:01:29.933863+0000","last_became_active":"2024-09-20T21:01:26.184491+0000","last_became_peered":"2024-09-20T21:01:26.184491+0000","last_unstale":"2024-09-20T21:01:29.933863+0000","last_undegraded":"2024-09-20T21:01:29.933863+0000","last_fullsized":"2024-09-20T21:01:29.933863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:53:38.207514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40108032,"num_objects":612,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184376+0000","last_change":"2024-09-20T21:01:26.195383+0000","last_active":"2024-09-20T21:01:28.184376+0000","last_peered":"2024-09-20T21:01:28.184376+0000","last_clean":"2024-09-20T21:01:28.184376+0000","last_became_active":"2024-09-20T21:01:26.193485+0000","last_became_peered":"2024-09-20T21:01:26.193485+0000","last_unstale":"2024-09-20T21:01:28.184376+0000","last_undegraded":"2024-09-20T21:01:28.184376+0000","last_fullsized":"2024-09-20T21:01:28.184376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:39.527762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185087+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:01:28.185087+0000","last_peered":"2024-09-20T21:01:28.185087+0000","last_clean":"2024-09-20T21:01:28.185087+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:01:28.185087+0000","last_undegraded":"2024-09-20T21:01:28.185087+0000","last_fullsized":"2024-09-20T21:01:28.185087+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187157+0000","last_change":"2024-09-20T21:01:12.227746+0000","last_active":"2024-09-20T21:01:28.187157+0000","last_peered":"2024-09-20T21:01:28.187157+0000","last_clean":"2024-09-20T21:01:28.187157+0000","last_became_active":"2024-09-20T21:01:12.226860+0000","last_became_peered":"2024-09-20T21:01:12.226860+0000","last_unstale":"2024-09-20T21:01:28.187157+0000","last_undegraded":"2024-09-20T21:01:28.187157+0000","last_fullsized":"2024-09-20T21:01:28.187157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:02.144980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"24'616","reported_seq":628,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.933879+0000","last_change":"2024-09-20T21:01:26.185208+0000","last_active":"2024-09-20T21:01:29.933879+0000","last_peered":"2024-09-20T21:01:29.933879+0000","last_clean":"2024-09-20T21:01:29.933879+0000","last_became_active":"2024-09-20T21:01:26.184547+0000","last_became_peered":"2024-09-20T21:01:26.184547+0000","last_unstale":"2024-09-20T21:01:29.933879+0000","last_undegraded":"2024-09-20T21:01:29.933879+0000","last_fullsized":"2024-09-20T21:01:29.933879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:11.520890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184907+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:01:28.184907+0000","last_peered":"2024-09-20T21:01:28.184907+0000","last_clean":"2024-09-20T21:01:28.184907+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:01:28.184907+0000","last_undegraded":"2024-09-20T21:01:28.184907+0000","last_fullsized":"2024-09-20T21:01:28.184907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188234+0000","last_change":"2024-09-20T21:01:09.385616+0000","last_active":"2024-09-20T21:01:28.188234+0000","last_peered":"2024-09-20T21:01:28.188234+0000","last_clean":"2024-09-20T21:01:28.188234+0000","last_became_active":"2024-09-20T21:01:07.000811+0000","last_became_peered":"2024-09-20T21:01:07.000811+0000","last_unstale":"2024-09-20T21:01:28.188234+0000","last_undegraded":"2024-09-20T21:01:28.188234+0000","last_fullsized":"2024-09-20T21:01:28.188234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:03.917240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077098100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187653+0000","last_change":"2024-09-20T21:01:12.227533+0000","last_active":"2024-09-20T21:01:28.187653+0000","last_peered":"2024-09-20T21:01:28.187653+0000","last_clean":"2024-09-20T21:01:28.187653+0000","last_became_active":"2024-09-20T21:01:12.226676+0000","last_became_peered":"2024-09-20T21:01:12.226676+0000","last_unstale":"2024-09-20T21:01:28.187653+0000","last_undegraded":"2024-09-20T21:01:28.187653+0000","last_fullsized":"2024-09-20T21:01:28.187653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"24'606","reported_seq":619,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.930926+0000","last_change":"2024-09-20T21:01:26.187915+0000","last_active":"2024-09-20T21:01:29.930926+0000","last_peered":"2024-09-20T21:01:29.930926+0000","last_clean":"2024-09-20T21:01:29.930926+0000","last_became_active":"2024-09-20T21:01:26.185921+0000","last_became_peered":"2024-09-20T21:01:26.185921+0000","last_unstale":"2024-09-20T21:01:29.930926+0000","last_undegraded":"2024-09-20T21:01:29.930926+0000","last_fullsized":"2024-09-20T21:01:29.930926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:53.347202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39714816,"num_objects":606,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":606,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185365+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:01:28.185365+0000","last_peered":"2024-09-20T21:01:28.185365+0000","last_clean":"2024-09-20T21:01:28.185365+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:01:28.185365+0000","last_undegraded":"2024-09-20T21:01:28.185365+0000","last_fullsized":"2024-09-20T21:01:28.185365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185596+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:01:28.185596+0000","last_peered":"2024-09-20T21:01:28.185596+0000","last_clean":"2024-09-20T21:01:28.185596+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:01:28.185596+0000","last_undegraded":"2024-09-20T21:01:28.185596+0000","last_fullsized":"2024-09-20T21:01:28.185596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184832+0000","last_change":"2024-09-20T21:01:12.227354+0000","last_active":"2024-09-20T21:01:28.184832+0000","last_peered":"2024-09-20T21:01:28.184832+0000","last_clean":"2024-09-20T21:01:28.184832+0000","last_became_active":"2024-09-20T21:01:12.226078+0000","last_became_peered":"2024-09-20T21:01:12.226078+0000","last_unstale":"2024-09-20T21:01:28.184832+0000","last_undegraded":"2024-09-20T21:01:28.184832+0000","last_fullsized":"2024-09-20T21:01:28.184832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"24'631","reported_seq":645,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:29.934134+0000","last_change":"2024-09-20T21:01:26.199069+0000","last_active":"2024-09-20T21:01:29.934134+0000","last_peered":"2024-09-20T21:01:29.934134+0000","last_clean":"2024-09-20T21:01:29.934134+0000","last_became_active":"2024-09-20T21:01:26.198393+0000","last_became_peered":"2024-09-20T21:01:26.198393+0000","last_unstale":"2024-09-20T21:01:29.934134+0000","last_undegraded":"2024-09-20T21:01:29.934134+0000","last_fullsized":"2024-09-20T21:01:29.934134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:31.789539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41353216,"num_objects":631,"num_object_clones":0,"num_object_copies":1262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185575+0000","last_change":"2024-09-20T21:01:11.220479+0000","last_active":"2024-09-20T21:01:28.185575+0000","last_peered":"2024-09-20T21:01:28.185575+0000","last_clean":"2024-09-20T21:01:28.185575+0000","last_became_active":"2024-09-20T21:01:11.219658+0000","last_became_peered":"2024-09-20T21:01:11.219658+0000","last_unstale":"2024-09-20T21:01:28.185575+0000","last_undegraded":"2024-09-20T21:01:28.185575+0000","last_fullsized":"2024-09-20T21:01:28.185575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.189294+0000","last_change":"2024-09-20T21:01:26.187355+0000","last_active":"2024-09-20T21:01:28.189294+0000","last_peered":"2024-09-20T21:01:28.189294+0000","last_clean":"2024-09-20T21:01:28.189294+0000","last_became_active":"2024-09-20T21:01:26.184589+0000","last_became_peered":"2024-09-20T21:01:26.184589+0000","last_unstale":"2024-09-20T21:01:28.189294+0000","last_undegraded":"2024-09-20T21:01:28.189294+0000","last_fullsized":"2024-09-20T21:01:28.189294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:50.835930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187216+0000","last_change":"2024-09-20T21:01:12.228307+0000","last_active":"2024-09-20T21:01:28.187216+0000","last_peered":"2024-09-20T21:01:28.187216+0000","last_clean":"2024-09-20T21:01:28.187216+0000","last_became_active":"2024-09-20T21:01:12.226322+0000","last_became_peered":"2024-09-20T21:01:12.226322+0000","last_unstale":"2024-09-20T21:01:28.187216+0000","last_undegraded":"2024-09-20T21:01:28.187216+0000","last_fullsized":"2024-09-20T21:01:28.187216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:52.194070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187596+0000","last_change":"2024-09-20T21:01:26.184712+0000","last_active":"2024-09-20T21:01:28.187596+0000","last_peered":"2024-09-20T21:01:28.187596+0000","last_clean":"2024-09-20T21:01:28.187596+0000","last_became_active":"2024-09-20T21:01:26.183597+0000","last_became_peered":"2024-09-20T21:01:26.183597+0000","last_unstale":"2024-09-20T21:01:28.187596+0000","last_undegraded":"2024-09-20T21:01:28.187596+0000","last_fullsized":"2024-09-20T21:01:28.187596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.657192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187669+0000","last_change":"2024-09-20T21:01:26.189446+0000","last_active":"2024-09-20T21:01:28.187669+0000","last_peered":"2024-09-20T21:01:28.187669+0000","last_clean":"2024-09-20T21:01:28.187669+0000","last_became_active":"2024-09-20T21:01:26.187287+0000","last_became_peered":"2024-09-20T21:01:26.187287+0000","last_unstale":"2024-09-20T21:01:28.187669+0000","last_undegraded":"2024-09-20T21:01:28.187669+0000","last_fullsized":"2024-09-20T21:01:28.187669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:03.704249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.186012+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:01:28.186012+0000","last_peered":"2024-09-20T21:01:28.186012+0000","last_clean":"2024-09-20T21:01:28.186012+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:01:28.186012+0000","last_undegraded":"2024-09-20T21:01:28.186012+0000","last_fullsized":"2024-09-20T21:01:28.186012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187994+0000","last_change":"2024-09-20T21:01:11.220027+0000","last_active":"2024-09-20T21:01:28.187994+0000","last_peered":"2024-09-20T21:01:28.187994+0000","last_clean":"2024-09-20T21:01:28.187994+0000","last_became_active":"2024-09-20T21:01:11.218551+0000","last_became_peered":"2024-09-20T21:01:11.218551+0000","last_unstale":"2024-09-20T21:01:28.187994+0000","last_undegraded":"2024-09-20T21:01:28.187994+0000","last_fullsized":"2024-09-20T21:01:28.187994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:47:59.918561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184890+0000","last_change":"2024-09-20T21:01:26.193337+0000","last_active":"2024-09-20T21:01:28.184890+0000","last_peered":"2024-09-20T21:01:28.184890+0000","last_clean":"2024-09-20T21:01:28.184890+0000","last_became_active":"2024-09-20T21:01:26.192862+0000","last_became_peered":"2024-09-20T21:01:26.192862+0000","last_unstale":"2024-09-20T21:01:28.184890+0000","last_undegraded":"2024-09-20T21:01:28.184890+0000","last_fullsized":"2024-09-20T21:01:28.184890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:11.609879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184316+0000","last_change":"2024-09-20T21:01:12.211553+0000","last_active":"2024-09-20T21:01:28.184316+0000","last_peered":"2024-09-20T21:01:28.184316+0000","last_clean":"2024-09-20T21:01:28.184316+0000","last_became_active":"2024-09-20T21:01:12.210101+0000","last_became_peered":"2024-09-20T21:01:12.210101+0000","last_unstale":"2024-09-20T21:01:28.184316+0000","last_undegraded":"2024-09-20T21:01:28.184316+0000","last_fullsized":"2024-09-20T21:01:28.184316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185287+0000","last_change":"2024-09-20T21:01:11.221867+0000","last_active":"2024-09-20T21:01:28.185287+0000","last_peered":"2024-09-20T21:01:28.185287+0000","last_clean":"2024-09-20T21:01:28.185287+0000","last_became_active":"2024-09-20T21:01:11.220980+0000","last_became_peered":"2024-09-20T21:01:11.220980+0000","last_unstale":"2024-09-20T21:01:28.185287+0000","last_undegraded":"2024-09-20T21:01:28.185287+0000","last_fullsized":"2024-09-20T21:01:28.185287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184736+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:01:28.184736+0000","last_peered":"2024-09-20T21:01:28.184736+0000","last_clean":"2024-09-20T21:01:28.184736+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:01:28.184736+0000","last_undegraded":"2024-09-20T21:01:28.184736+0000","last_fullsized":"2024-09-20T21:01:28.184736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.189066+0000","last_change":"2024-09-20T21:01:12.236819+0000","last_active":"2024-09-20T21:01:28.189066+0000","last_peered":"2024-09-20T21:01:28.189066+0000","last_clean":"2024-09-20T21:01:28.189066+0000","last_became_active":"2024-09-20T21:01:12.233922+0000","last_became_peered":"2024-09-20T21:01:12.233922+0000","last_unstale":"2024-09-20T21:01:28.189066+0000","last_undegraded":"2024-09-20T21:01:28.189066+0000","last_fullsized":"2024-09-20T21:01:28.189066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184865+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:01:28.184865+0000","last_peered":"2024-09-20T21:01:28.184865+0000","last_clean":"2024-09-20T21:01:28.184865+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:01:28.184865+0000","last_undegraded":"2024-09-20T21:01:28.184865+0000","last_fullsized":"2024-09-20T21:01:28.184865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184767+0000","last_change":"2024-09-20T21:01:12.227395+0000","last_active":"2024-09-20T21:01:28.184767+0000","last_peered":"2024-09-20T21:01:28.184767+0000","last_clean":"2024-09-20T21:01:28.184767+0000","last_became_active":"2024-09-20T21:01:12.226122+0000","last_became_peered":"2024-09-20T21:01:12.226122+0000","last_unstale":"2024-09-20T21:01:28.184767+0000","last_undegraded":"2024-09-20T21:01:28.184767+0000","last_fullsized":"2024-09-20T21:01:28.184767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184387+0000","last_change":"2024-09-20T21:01:11.220367+0000","last_active":"2024-09-20T21:01:28.184387+0000","last_peered":"2024-09-20T21:01:28.184387+0000","last_clean":"2024-09-20T21:01:28.184387+0000","last_became_active":"2024-09-20T21:01:11.219090+0000","last_became_peered":"2024-09-20T21:01:11.219090+0000","last_unstale":"2024-09-20T21:01:28.184387+0000","last_undegraded":"2024-09-20T21:01:28.184387+0000","last_fullsized":"2024-09-20T21:01:28.184387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187687+0000","last_change":"2024-09-20T21:01:12.238895+0000","last_active":"2024-09-20T21:01:28.187687+0000","last_peered":"2024-09-20T21:01:28.187687+0000","last_clean":"2024-09-20T21:01:28.187687+0000","last_became_active":"2024-09-20T21:01:12.235481+0000","last_became_peered":"2024-09-20T21:01:12.235481+0000","last_unstale":"2024-09-20T21:01:28.187687+0000","last_undegraded":"2024-09-20T21:01:28.187687+0000","last_fullsized":"2024-09-20T21:01:28.187687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187301+0000","last_change":"2024-09-20T21:01:11.217493+0000","last_active":"2024-09-20T21:01:28.187301+0000","last_peered":"2024-09-20T21:01:28.187301+0000","last_clean":"2024-09-20T21:01:28.187301+0000","last_became_active":"2024-09-20T21:01:11.216073+0000","last_became_peered":"2024-09-20T21:01:11.216073+0000","last_unstale":"2024-09-20T21:01:28.187301+0000","last_undegraded":"2024-09-20T21:01:28.187301+0000","last_fullsized":"2024-09-20T21:01:28.187301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:23:30.512126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187932+0000","last_change":"2024-09-20T21:01:12.232371+0000","last_active":"2024-09-20T21:01:28.187932+0000","last_peered":"2024-09-20T21:01:28.187932+0000","last_clean":"2024-09-20T21:01:28.187932+0000","last_became_active":"2024-09-20T21:01:12.231450+0000","last_became_peered":"2024-09-20T21:01:12.231450+0000","last_unstale":"2024-09-20T21:01:28.187932+0000","last_undegraded":"2024-09-20T21:01:28.187932+0000","last_fullsized":"2024-09-20T21:01:28.187932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188198+0000","last_change":"2024-09-20T21:01:11.218440+0000","last_active":"2024-09-20T21:01:28.188198+0000","last_peered":"2024-09-20T21:01:28.188198+0000","last_clean":"2024-09-20T21:01:28.188198+0000","last_became_active":"2024-09-20T21:01:11.217722+0000","last_became_peered":"2024-09-20T21:01:11.217722+0000","last_unstale":"2024-09-20T21:01:28.188198+0000","last_undegraded":"2024-09-20T21:01:28.188198+0000","last_fullsized":"2024-09-20T21:01:28.188198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:11:02.101254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185380+0000","last_change":"2024-09-20T21:01:26.195014+0000","last_active":"2024-09-20T21:01:28.185380+0000","last_peered":"2024-09-20T21:01:28.185380+0000","last_clean":"2024-09-20T21:01:28.185380+0000","last_became_active":"2024-09-20T21:01:26.192848+0000","last_became_peered":"2024-09-20T21:01:26.192848+0000","last_unstale":"2024-09-20T21:01:28.185380+0000","last_undegraded":"2024-09-20T21:01:28.185380+0000","last_fullsized":"2024-09-20T21:01:28.185380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:28.674101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184768+0000","last_change":"2024-09-20T21:01:26.197383+0000","last_active":"2024-09-20T21:01:28.184768+0000","last_peered":"2024-09-20T21:01:28.184768+0000","last_clean":"2024-09-20T21:01:28.184768+0000","last_became_active":"2024-09-20T21:01:26.196662+0000","last_became_peered":"2024-09-20T21:01:26.196662+0000","last_unstale":"2024-09-20T21:01:28.184768+0000","last_undegraded":"2024-09-20T21:01:28.184768+0000","last_fullsized":"2024-09-20T21:01:28.184768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:35.350487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.186130+0000","last_change":"2024-09-20T21:01:26.187436+0000","last_active":"2024-09-20T21:01:28.186130+0000","last_peered":"2024-09-20T21:01:28.186130+0000","last_clean":"2024-09-20T21:01:28.186130+0000","last_became_active":"2024-09-20T21:01:26.186319+0000","last_became_peered":"2024-09-20T21:01:26.186319+0000","last_unstale":"2024-09-20T21:01:28.186130+0000","last_undegraded":"2024-09-20T21:01:28.186130+0000","last_fullsized":"2024-09-20T21:01:28.186130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:04.716145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.187869+0000","last_change":"2024-09-20T21:01:11.220332+0000","last_active":"2024-09-20T21:01:28.187869+0000","last_peered":"2024-09-20T21:01:28.187869+0000","last_clean":"2024-09-20T21:01:28.187869+0000","last_became_active":"2024-09-20T21:01:11.219022+0000","last_became_peered":"2024-09-20T21:01:11.219022+0000","last_unstale":"2024-09-20T21:01:28.187869+0000","last_undegraded":"2024-09-20T21:01:28.187869+0000","last_fullsized":"2024-09-20T21:01:28.187869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.928114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.188009+0000","last_change":"2024-09-20T21:01:12.238819+0000","last_active":"2024-09-20T21:01:28.188009+0000","last_peered":"2024-09-20T21:01:28.188009+0000","last_clean":"2024-09-20T21:01:28.188009+0000","last_became_active":"2024-09-20T21:01:12.237939+0000","last_became_peered":"2024-09-20T21:01:12.237939+0000","last_unstale":"2024-09-20T21:01:28.188009+0000","last_undegraded":"2024-09-20T21:01:28.188009+0000","last_fullsized":"2024-09-20T21:01:28.188009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185237+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:01:28.185237+0000","last_peered":"2024-09-20T21:01:28.185237+0000","last_clean":"2024-09-20T21:01:28.185237+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:01:28.185237+0000","last_undegraded":"2024-09-20T21:01:28.185237+0000","last_fullsized":"2024-09-20T21:01:28.185237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.184756+0000","last_change":"2024-09-20T21:01:26.190436+0000","last_active":"2024-09-20T21:01:28.184756+0000","last_peered":"2024-09-20T21:01:28.184756+0000","last_clean":"2024-09-20T21:01:28.184756+0000","last_became_active":"2024-09-20T21:01:26.186848+0000","last_became_peered":"2024-09-20T21:01:26.186848+0000","last_unstale":"2024-09-20T21:01:28.184756+0000","last_undegraded":"2024-09-20T21:01:28.184756+0000","last_fullsized":"2024-09-20T21:01:28.184756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:03:53.389519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-20T21:01:28.185206+0000","last_change":"2024-09-20T21:01:11.222738+0000","last_active":"2024-09-20T21:01:28.185206+0000","last_peered":"2024-09-20T21:01:28.185206+0000","last_clean":"2024-09-20T21:01:28.185206+0000","last_became_active":"2024-09-20T21:01:11.221990+0000","last_became_peered":"2024-09-20T21:01:11.221990+0000","last_unstale":"2024-09-20T21:01:28.185206+0000","last_undegraded":"2024-09-20T21:01:28.185206+0000","last_fullsized":"2024-09-20T21:01:28.185206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":635174912,"num_objects":9692,"num_object_clones":0,"num_object_copies":19384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9692,"num_write_kb":620288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79384576,"data_stored":1270153216,"data_compressed":6064033,"data_compressed_allocated":79384576,"data_compressed_original":1270153216,"omap_allocated":0,"internal_metadata":0},"log_size":9692,"ondisk_log_size":9692,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56620,"kb_used_data":17112,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315220,"statfs":{"total":96636764160,"available":96578785280,"internally_reserved":0,"allocated":17522688,"data_stored":276122663,"data_compressed":1326086,"data_compressed_allocated":17256448,"data_compressed_original":276021248,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,4,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56624,"kb_used_data":17120,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315216,"statfs":{"total":96636764160,"available":96578781184,"internally_reserved":0,"allocated":17530880,"data_stored":276057762,"data_compressed":1325722,"data_compressed_allocated":17252352,"data_compressed_original":275955712,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68472,"kb_used_data":28964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94303368,"statfs":{"total":96636764160,"available":96566648832,"internally_reserved":0,"allocated":29659136,"data_stored":470893952,"data_compressed":2247697,"data_compressed_allocated":29425664,"data_compressed_original":470810624,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,5],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32202752,"data_stored":515244032,"data_compressed":2459911,"data_compressed_allocated":32202752,"data_compressed_original":515244032,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24760320,"data_stored":396165120,"data_compressed":1891397,"data_compressed_allocated":24760320,"data_compressed_original":396165120,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22421504,"data_stored":358744064,"data_compressed":1712725,"data_compressed_allocated":22421504,"data_compressed_original":358744064,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:01:36.627 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:36.666 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:36.662+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:36.766 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:36.765+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:36.793 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:36.793 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:01:36.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:01:36.793 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:36.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.793 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.794 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:36.794 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.597490762, 2024-09-20T21:01:36.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:01:36.794 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.794 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.794 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.794 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:36.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.795 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:36.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.795 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:01:36.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:36.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:01:36.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:01:36.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.597400726, 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.801 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:36.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:01:36.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:36.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:01:36.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:01:36.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:01:36.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:01:36.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.806 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.806 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:01:36.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:01:36.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.806 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:36.806 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:01:36.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.808 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.597314373, 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:01:36.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.813 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.814 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:01:36.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.816 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.597245564000001, 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:01:36.820 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:01:36.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.821 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:01:36.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:01:36.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.821 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:36.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:01:36.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.822 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.823 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.597212704, 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.826 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:01:36.827 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:01:36.828 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.831 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.597170686999998, 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:36.832 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.833 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.834 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:01:36.835 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:01:36.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:36.838 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.597045581, 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.839 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:01:36.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:01:36.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.596953232000001, 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.845 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:01:36.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:01:36.850 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 24.596868860000001, 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.851 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:01:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.856 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:2 5.8 5:124aadbb:::benchmark_data_smithi112_23632_object1:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.5504440380000002, 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017726502000000002, 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.857 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 2 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243120+0000", 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3799999999999999e-06 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243306+0000", 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018621499999999999 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243327+0000", 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1036e-05 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243341+0000", 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.412e-05 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243477+0000", 2024-09-20T21:01:36.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136286 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243492+0000", 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5033e-05 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252641+0000", 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0091492480000000004 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252748+0000", 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106724 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252867+0000", 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011846899999999999 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255666+0000", 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002799368 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260766+0000", 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050996940000000001 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260809+0000", 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2972999999999997e-05 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260845+0000", 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5955999999999999e-05 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:5 5.4 5:272d9688:::benchmark_data_smithi112_23632_object4:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:36.864 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.5499775089999996, 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015407461000000001, 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 5 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243586+0000", 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0300000000000001e-06 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243695+0000", 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0001097 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243712+0000", 2024-09-20T21:01:36.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7073000000000001e-05 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243721+0000", 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9360000000000005e-06 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243834+0000", 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000112186 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243849+0000", 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5347000000000001e-05 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.251959+0000", 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0081103449999999997 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252062+0000", 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010262 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252178+0000", 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011608900000000001 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256938+0000", 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047595249999999997 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258912+0000", 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019745470000000001 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258955+0000", 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2568000000000003e-05 2024-09-20T21:01:36.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258992+0000", 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7494999999999999e-05 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:7 5.4 5:2e77bfa8:::benchmark_data_smithi112_23632_object6:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:36.872 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.5498168400000001, 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016326288000000001, 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 7 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243747+0000", 2024-09-20T21:01:36.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2300000000000001e-06 2024-09-20T21:01:36.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243903+0000", 2024-09-20T21:01:36.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015672599999999999 2024-09-20T21:01:36.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243918+0000", 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4355999999999999e-05 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243927+0000", 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3340000000000008e-06 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244038+0000", 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110612 2024-09-20T21:01:36.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244046+0000", 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9869999999999999e-06 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252713+0000", 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0086670889999999993 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253039+0000", 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032610099999999997 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253414+0000", 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037573700000000001 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256958+0000", 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035431759999999999 2024-09-20T21:01:36.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259926+0000", 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002968077 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260003+0000", 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7208999999999999e-05 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260072+0000", 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8653999999999997e-05 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:9 5.0 5:0418dd6f:::benchmark_data_smithi112_23632_object8:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243948+0000", 2024-09-20T21:01:36.880 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.5496136749999998, 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014983845000000001, 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 9 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243948+0000", 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243948+0000", 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243950+0000", 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2270000000000001e-06 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244080+0000", 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000130149 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244097+0000", 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6886000000000001e-05 2024-09-20T21:01:36.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244106+0000", 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7970000000000006e-06 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244169+0000", 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3299999999999994e-05 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244175+0000", 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9229999999999999e-06 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.249939+0000", 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0057645550000000002 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.250595+0000", 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065572899999999997 2024-09-20T21:01:36.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.250929+0000", 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000333467 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254107+0000", 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003178878 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258836+0000", 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047288620000000003 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258893+0000", 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6743000000000002e-05 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258932+0000", 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9329000000000002e-05 2024-09-20T21:01:36.887 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:10 5.0 5:0c1d9875:::benchmark_data_smithi112_23632_object9:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244126+0000", 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.5494364390000008, 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014913087, 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.888 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 10 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244126+0000", 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244126+0000", 2024-09-20T21:01:36.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244127+0000", 2024-09-20T21:01:36.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.24e-06 2024-09-20T21:01:36.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244238+0000", 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000111295 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244271+0000", 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2894e-05 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244280+0000", 2024-09-20T21:01:36.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6559999999999998e-06 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244333+0000", 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3125999999999999e-05 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244338+0000", 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3600000000000004e-06 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.251927+0000", 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0075885090000000002 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252042+0000", 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011513100000000001 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252178+0000", 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013604700000000001 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254889+0000", 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027108560000000002 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258974+0000", 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040847050000000001 2024-09-20T21:01:36.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259020+0000", 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6312e-05 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259039+0000", 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8955999999999999e-05 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.895 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:14 5.0 5:04cc51db:::benchmark_data_smithi112_23632_object13:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.5491042890000006, 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017127937999999999, 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.896 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 14 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244459+0000", 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0699999999999999e-06 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244569+0000", 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010965 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244594+0000", 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5066e-05 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244607+0000", 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3152999999999999e-05 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244663+0000", 2024-09-20T21:01:36.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6360000000000002e-05 2024-09-20T21:01:36.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:36.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244670+0000", 2024-09-20T21:01:36.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8199999999999999e-06 2024-09-20T21:01:36.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252692+0000", 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0080222069999999999 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252990+0000", 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000297788 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253360+0000", 2024-09-20T21:01:36.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00036990699999999999 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255672+0000", 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023116529999999999 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261302+0000", 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0056302890000000001 2024-09-20T21:01:36.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261450+0000", 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000148016 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261586+0000", 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135959 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.903 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:15 5.4 5:26d45dc5:::benchmark_data_smithi112_23632_object14:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.5489374999999992, 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015746412000000001, 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.904 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 15 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244626+0000", 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1170000000000001e-06 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244735+0000", 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108902 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244767+0000", 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2767e-05 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244780+0000", 2024-09-20T21:01:36.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2823000000000001e-05 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244832+0000", 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2102999999999999e-05 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244838+0000", 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2129999999999999e-06 2024-09-20T21:01:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254299+0000", 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0094618670000000005 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254554+0000", 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025405099999999998 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255233+0000", 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000679852 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.257421+0000", 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00218761 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260171+0000", 2024-09-20T21:01:36.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027496119999999998 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260302+0000", 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000131025 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260371+0000", 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9469999999999997e-05 2024-09-20T21:01:36.911 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:157 5.4 5:2a681351:::benchmark_data_smithi112_23632_object156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.4817209420000008, 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016166680999999999, 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 157 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311842+0000", 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2389999999999999e-06 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311879+0000", 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6520000000000003e-05 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311893+0000", 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3814e-05 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311903+0000", 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7969999999999995e-06 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311963+0000", 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0773999999999998e-05 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.312056+0000", 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2264999999999998e-05 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.312153+0000", 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7118000000000001e-05 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.317062+0000", 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0049092420000000003 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.327952+0000", 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010889708999999999 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.327985+0000", 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3519000000000002e-05 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.328008+0000", 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2684000000000002e-05 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16441 5.4 5:231ae493:::benchmark_data_smithi112_23632_object16440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.5699586889999999, 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018694967999999999, 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.919 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16441 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:36.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223604+0000", 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0020000000000001e-06 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223754+0000", 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014907899999999999 2024-09-20T21:01:36.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5207e-05 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223787+0000", 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8685000000000002e-05 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223852+0000", 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5012999999999996e-05 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017955400000000001 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224223+0000", 2024-09-20T21:01:36.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000191428 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225787+0000", 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001563617 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242143+0000", 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01635615 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242235+0000", 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2250000000000006e-05 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242298+0000", 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2983000000000003e-05 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16442 5.0 5:07f91168:::benchmark_data_smithi112_23632_object16441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.569753876, 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018432022999999999, 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.926 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16442 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:36.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223809+0000", 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223867+0000", 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8365000000000001e-05 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223878+0000", 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.058e-05 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223886+0000", 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6490000000000008e-06 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223943+0000", 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6879000000000002e-05 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224078+0000", 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135549 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224243+0000", 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016484900000000001 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226958+0000", 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027148490000000001 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242135+0000", 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015176858 2024-09-20T21:01:36.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242185+0000", 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0254999999999999e-05 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242240+0000", 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.541e-05 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.932 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16446 5.0 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.5695825570000004, 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018538079999999998, 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:36.933 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16446 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:36.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5799999999999999e-07 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224021+0000", 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1053000000000001e-05 2024-09-20T21:01:36.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.111e-05 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224040+0000", 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5480000000000004e-06 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225554+0000", 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001513749 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225818+0000", 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026389300000000002 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:36.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226084+0000", 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026617999999999998 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.227457+0000", 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013727030000000001 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242319+0000", 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014862492 2024-09-20T21:01:36.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242426+0000", 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107291 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242518+0000", 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1403000000000006e-05 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.939 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.940 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.940 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:36.940 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:36.940 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:36.941 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:36.941+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:36.942 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:37.042 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:37.038+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:37.106 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:37.106 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:37.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.106 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:29888 5.3 5:c96bd34d:::benchmark_data_smithi112_23632_object29887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:37.106 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:37.103778+0000", 2024-09-20T21:01:37.106 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0026764670000000001, 2024-09-20T21:01:37.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002702271, 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 29888 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103778+0000", 2024-09-20T21:01:37.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103778+0000", 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103779+0000", 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7899999999999997e-07 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103886+0000", 2024-09-20T21:01:37.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010672500000000001 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103896+0000", 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0121e-05 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103902+0000", 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4030000000000004e-06 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103940+0000", 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7694999999999997e-05 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104017+0000", 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6490999999999997e-05 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104115+0000", 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8381999999999994e-05 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.105383+0000", 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001268361 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:29890 5.6 5:63db1ea7:::benchmark_data_smithi112_23632_object29889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:37.104604+0000", 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00185082, 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019746120000000002, 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 29890 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104604+0000", 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104604+0000", 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104605+0000", 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9400000000000004e-07 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104676+0000", 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1645999999999998e-05 2024-09-20T21:01:37.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104687+0000", 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.092e-05 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104692+0000", 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0139999999999998e-06 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104740+0000", 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7725000000000001e-05 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104867+0000", 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012694099999999999 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104987+0000", 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119522 2024-09-20T21:01:37.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.106446+0000", 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001459346 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:29891 5.2 5:4ae90dc6:::benchmark_data_smithi112_23632_object29890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:37.104831+0000", 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0016241230000000001, 2024-09-20T21:01:37.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001838793, 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 29891 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104831+0000", 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104831+0000", 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104831+0000", 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3600000000000003e-07 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104900+0000", 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9084000000000005e-05 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104907+0000", 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6529999999999997e-06 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104911+0000", 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8430000000000003e-06 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104947+0000", 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6010999999999998e-05 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.105025+0000", 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7702999999999998e-05 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.105113+0000", 2024-09-20T21:01:37.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7887999999999996e-05 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.106199+0000", 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010861880000000001 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:29896 5.3 5:c7bd2657:::benchmark_data_smithi112_23632_object29895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:37.106478+0000", 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9999771, 2024-09-20T21:01:37.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025360500000000001, 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 29896 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.106478+0000", 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.106478+0000", 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.106479+0000", 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8700000000000004e-07 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.106615+0000", 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000135971 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.106624+0000", 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4259999999999992e-06 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.106631+0000", 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4250000000000003e-06 2024-09-20T21:01:37.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.106672+0000", 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1820000000000003e-05 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:29885 5.2 5:4fe165a1:::benchmark_data_smithi112_23632_object29884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:37.103158+0000", 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0032964740000000002, 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0036099700000000001, 2024-09-20T21:01:37.125 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 29885 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103158+0000", 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103158+0000", 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103159+0000", 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0669999999999999e-06 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103195+0000", 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5292e-05 2024-09-20T21:01:37.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103207+0000", 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2026e-05 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103213+0000", 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1650000000000003e-06 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103263+0000", 2024-09-20T21:01:37.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0563999999999999e-05 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103405+0000", 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014113400000000001 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.103497+0000", 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2854000000000002e-05 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:37.104817+0000", 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013197059999999999 2024-09-20T21:01:37.129 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:01:37.130 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 5 2024-09-20T21:01:37.130 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:37.131 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:37.143 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:37.141+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:37.232 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:01:37.239 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 10 16 30263 30247 189.025 166.188 0.00712493 0.00528499 2024-09-20T21:01:37.243 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:37.245+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:37.341 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:37.341 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:01:37.341 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:01:37.341 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:01:37.341 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:37.344 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:37.345+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:37.363 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:37.445 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:37.445+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:37.522 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.326577082, 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:01:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:01:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.326442882999999, 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:01:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.326337877, 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:01:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:01:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.326218352000001, 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.326148345, 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:01:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:01:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:01:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:01:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.326073293, 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:01:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:01:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.325986267000001, 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:01:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.325917493999999, 2024-09-20T21:01:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:01:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:01:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:01:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:01:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.325831234999999, 2024-09-20T21:01:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:01:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:01:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159 5.a 5:5db82723:::benchmark_data_smithi112_23632_object158:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.210415254999999, 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015345846, 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310395+0000", 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.48e-06 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310489+0000", 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4293e-05 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310510+0000", 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1073e-05 2024-09-20T21:01:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310554+0000", 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3797000000000001e-05 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310670+0000", 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115442 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311025+0000", 2024-09-20T21:01:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035569399999999999 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311335+0000", 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030994099999999999 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322334+0000", 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010998888 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325578+0000", 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032433850000000001 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325667+0000", 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9127000000000002e-05 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325739+0000", 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2725999999999995e-05 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:157 5.4 e23/21 5:2a681351:::benchmark_data_smithi112_23632_object156:head v 23'9, mlcod=23'7)", 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.210176293, 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015433034, 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310634+0000", 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6959999999999999e-06 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310717+0000", 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3245999999999995e-05 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310740+0000", 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2957000000000001e-05 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310757+0000", 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6646e-05 2024-09-20T21:01:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320083+0000", 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0093255790000000005 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320124+0000", 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1635999999999999e-05 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325970+0000", 2024-09-20T21:01:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058456879999999999 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.326066+0000", 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5586000000000003e-05 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16445 5.2 5:4d443432:::benchmark_data_smithi112_23632_object16444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.2984768019999997, 2024-09-20T21:01:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01791187, 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16445 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222333+0000", 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0699999999999996e-07 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222428+0000", 2024-09-20T21:01:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5198000000000006e-05 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222438+0000", 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6889999999999999e-06 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222481+0000", 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3157e-05 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222551+0000", 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9915999999999999e-05 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222632+0000", 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1650999999999995e-05 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222733+0000", 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100153 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227624+0000", 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048913309999999996 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240156+0000", 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012531927 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240205+0000", 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9363999999999997e-05 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240244+0000", 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8577e-05 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16448 5.3 5:ceed33ed:::benchmark_data_smithi112_23632_object16447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.2982392799999998, 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017689621999999999, 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16448 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222570+0000", 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222617+0000", 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6493999999999999e-05 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222626+0000", 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5959999999999993e-06 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222633+0000", 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222677+0000", 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4029000000000001e-05 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222798+0000", 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000120586 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222928+0000", 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013065400000000001 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227036+0000", 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0041077190000000001 2024-09-20T21:01:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240183+0000", 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013146817999999999 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240229+0000", 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6619999999999997e-05 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240259+0000", 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9791e-05 2024-09-20T21:01:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16451 5.1 5:80cd9f79:::benchmark_data_smithi112_23632_object16450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.2980981800000002, 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017604979, 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16451 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.13e-07 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222743+0000", 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2079000000000002e-05 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222752+0000", 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9369999999999993e-06 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222758+0000", 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7320000000000003e-06 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222814+0000", 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6450000000000003e-05 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222950+0000", 2024-09-20T21:01:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013559600000000001 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223083+0000", 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132676 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227057+0000", 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039746499999999997 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240270+0000", 2024-09-20T21:01:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013212911000000001 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240294+0000", 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4261e-05 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240316+0000", 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1073999999999998e-05 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16441 5.4 e25/21 5:231ae493:::benchmark_data_smithi112_23632_object16440:head v 25'1007, mlcod=25'1005)", 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.297231547, 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016533478000000001, 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223578+0000", 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7800000000000001e-07 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223630+0000", 2024-09-20T21:01:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2011000000000001e-05 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223639+0000", 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4919999999999999e-06 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223646+0000", 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3069999999999999e-06 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223697+0000", 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0822999999999998e-05 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223710+0000", 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3002e-05 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240081+0000", 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016371753999999999 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240111+0000", 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9311000000000001e-05 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16442 5.0 e25/21 5:07f91168:::benchmark_data_smithi112_23632_object16441:head v 25'1017, mlcod=25'1015)", 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.2971451099999998, 2024-09-20T21:01:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016425138999999998, 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9200000000000002e-07 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223700+0000", 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5911999999999998e-05 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223705+0000", 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5990000000000001e-06 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223709+0000", 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8060000000000001e-06 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9803000000000003e-05 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223788+0000", 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8838000000000002e-05 2024-09-20T21:01:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240052+0000", 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016264361000000001 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240089+0000", 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6528e-05 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16452 5.1 5:835745ce:::benchmark_data_smithi112_23632_object16451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.297069821, 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016631607999999999, 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16452 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223740+0000", 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7899999999999997e-07 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223780+0000", 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9892999999999999e-05 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223790+0000", 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0708e-05 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223798+0000", 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0860000000000002e-06 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223929+0000", 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013030299999999999 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224044+0000", 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114875 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224173+0000", 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012932800000000001 2024-09-20T21:01:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227092+0000", 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029195739999999999 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240319+0000", 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013226813 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240353+0000", 2024-09-20T21:01:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3686000000000002e-05 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240371+0000", 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7563000000000001e-05 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16446 5.0 e25/21 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head v 25'1018, mlcod=25'1015)", 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.2963365720000004, 2024-09-20T21:01:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015653869000000001, 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224473+0000", 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5300000000000004e-07 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224536+0000", 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3554999999999997e-05 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224544+0000", 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3200000000000002e-06 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224548+0000", 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7350000000000004e-06 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224582+0000", 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3303999999999998e-05 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224595+0000", 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3199e-05 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240095+0000", 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015500323999999999 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240126+0000", 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0778999999999998e-05 2024-09-20T21:01:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16454 5.a 5:5e808c04:::benchmark_data_smithi112_23632_object16453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.2962167219999996, 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016518115999999999, 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16454 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224593+0000", 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2999999999999999e-07 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224635+0000", 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1711000000000001e-05 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224646+0000", 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1015999999999999e-05 2024-09-20T21:01:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224653+0000", 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449999999999998e-06 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224714+0000", 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0835000000000003e-05 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224838+0000", 2024-09-20T21:01:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124053 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224978+0000", 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014017200000000001 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240105+0000", 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015127148999999999 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241034+0000", 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00092821600000000005 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241065+0000", 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1149999999999998e-05 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241110+0000", 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5439000000000003e-05 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.626 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16457 5.a 5:53c53296:::benchmark_data_smithi112_23632_object16456:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.226630+0000", 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.2941784959999998, 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014568424999999999, 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16457 2024-09-20T21:01:37.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.226630+0000", 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.226630+0000", 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:37.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.226631+0000", 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5899999999999996e-07 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.226685+0000", 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4256999999999999e-05 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.226694+0000", 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2930000000000006e-06 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.226702+0000", 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1609999999999997e-06 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.226742+0000", 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0092999999999997e-05 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.226824+0000", 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2130000000000001e-05 2024-09-20T21:01:37.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.226904+0000", 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0352999999999995e-05 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240143+0000", 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013239048999999999 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241120+0000", 2024-09-20T21:01:37.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00097647299999999995 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241163+0000", 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3066999999999999e-05 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241199+0000", 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5889999999999997e-05 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:37.633 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:37.633 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:37.634 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:37.635 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:37.630+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:37.735 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:37.733+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:37.785 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:37.785 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:37.785 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.785 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:31663 5.d e27/21 5:b11f4189:::benchmark_data_smithi112_23632_object31662:head v 27'1932, mlcod=27'1926)", 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:37.785295+0000", 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.001074162, 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00108979, 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.785295+0000", 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.786 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.785295+0000", 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.785296+0000", 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.37e-07 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.785328+0000", 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.2317999999999998e-05 2024-09-20T21:01:37.787 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.785341+0000", 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2925000000000001e-05 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.785349+0000", 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.8979999999999996e-06 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:37.788 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.785399+0000", 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0161000000000003e-05 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.785418+0000", 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8794999999999999e-05 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:31670 5.c e27/21 5:3c673174:::benchmark_data_smithi112_23632_object31669:head v 27'1956, mlcod=27'1953)", 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:37.786043+0000", 2024-09-20T21:01:37.789 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00032647999999999998, 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00038065100000000003, 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.786043+0000", 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:37.790 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.786043+0000", 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.786043+0000", 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8100000000000002e-07 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.786097+0000", 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4265999999999998e-05 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.791 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.786110+0000", 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2517000000000001e-05 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.786116+0000", 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.0190000000000003e-06 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.786164+0000", 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.8250000000000001e-05 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:37.792 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:37.793 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:37.793 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:37.786177+0000", 2024-09-20T21:01:37.793 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2326e-05 2024-09-20T21:01:37.793 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:37.793 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:37.793 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:37.793 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:37.793 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:01:37.793 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 2 2024-09-20T21:01:37.793 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:37.804 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:37.849 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:37.849+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:37.917 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:01:37.936 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:37.937+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:37.952 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:37.952 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:01:37.952 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:01:37.952 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:01:37.952 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:37.971 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:38.036 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:38.037+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:38.072 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:38.072 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:38.090 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:38.091 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:38.109 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:38.109 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:38.137 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:38.137+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:38.155 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:38.155 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:38.174 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:38.238 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:38.237+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:38.240 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 11 16 32884 32868 186.732 163.812 0.00266194 0.00534955 2024-09-20T21:01:38.336 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:38.336 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:38.338 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:38.334+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:38.357 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:38.444 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:38.445+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:38.540 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:38.538+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:38.561 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:38.561 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:38.581 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:38.641 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:38.638+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:38.742 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:38.738+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:38.771 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:38.771 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:38.794 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:38.843 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:38.841+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:38.943 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:38.941+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:38.953 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:38.953 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:38.975 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:39.044 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:39.045+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:39.132 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:39.132 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:39.144 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:39.145+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:39.152 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:39.240 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 12 16 35363 35347 184.08 154.938 0.00656971 0.00542783 2024-09-20T21:01:39.245 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:39.245+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:39.259 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T21:01:39.317 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:39.317 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:39.336 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:39.346 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:39.345+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:39.447 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:39.445+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:39.490 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:39.490 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:39.513 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:39.548 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:39.546+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:39.649 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:39.646+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:39.699 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:39.700 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:39.719 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:39.750 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:39.746+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:39.851 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:39.850+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:39.863 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:39.863 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:39.885 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:39.952 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:39.950+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:40.053 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:40.053+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:40.054 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:40.054 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:40.076 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:40.126 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:01:40.227 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:40.169+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:40.234 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-20T21:01:40.240 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 13 16 37732 37716 181.308 148.062 0.00742137 0.0055092 2024-09-20T21:01:40.252 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:40.252 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:40.255 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:40.254+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:40.272 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:40.286 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:40.286 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:40.308 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:40.308 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:40.326 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:40.327 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:40.356 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:40.354+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:40.434 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.232750131, 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:01:40.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.232660095, 2024-09-20T21:01:40.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:01:40.442 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.442 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.442 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.442 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.442 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.442 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:40.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:01:40.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:40.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:01:40.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.447 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.232573742, 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:01:40.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:40.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.232504933000001, 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:01:40.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:01:40.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:01:40.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.232472073, 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.461 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:01:40.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.232430055999998, 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.467 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:40.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:01:40.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.473 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.23230495, 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:01:40.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:01:40.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.479 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.232212601000001, 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:01:40.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:01:40.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.232128229000001, 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:2 5.8 5:124aadbb:::benchmark_data_smithi112_23632_object1:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.185703407, 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017726502000000002, 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.489 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 2 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243120+0000", 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3799999999999999e-06 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243306+0000", 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018621499999999999 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243327+0000", 2024-09-20T21:01:40.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1036e-05 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243341+0000", 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.412e-05 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243477+0000", 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136286 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243492+0000", 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5033e-05 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252641+0000", 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0091492480000000004 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252748+0000", 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106724 2024-09-20T21:01:40.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252867+0000", 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011846899999999999 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255666+0000", 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002799368 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260766+0000", 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050996940000000001 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260809+0000", 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2972999999999997e-05 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260845+0000", 2024-09-20T21:01:40.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5955999999999999e-05 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:5 5.4 5:272d9688:::benchmark_data_smithi112_23632_object4:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.185236878, 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015407461000000001, 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.496 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 5 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243586+0000", 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0300000000000001e-06 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243695+0000", 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0001097 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243712+0000", 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7073000000000001e-05 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243721+0000", 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9360000000000005e-06 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243834+0000", 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000112186 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243849+0000", 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5347000000000001e-05 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.251959+0000", 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0081103449999999997 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252062+0000", 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010262 2024-09-20T21:01:40.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252178+0000", 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011608900000000001 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256938+0000", 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047595249999999997 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258912+0000", 2024-09-20T21:01:40.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019745470000000001 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258955+0000", 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2568000000000003e-05 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258992+0000", 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7494999999999999e-05 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.502 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:7 5.4 5:2e77bfa8:::benchmark_data_smithi112_23632_object6:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.185076209, 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016326288000000001, 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.503 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 7 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243747+0000", 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2300000000000001e-06 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243903+0000", 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015672599999999999 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243918+0000", 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4355999999999999e-05 2024-09-20T21:01:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243927+0000", 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3340000000000008e-06 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244038+0000", 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110612 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244046+0000", 2024-09-20T21:01:40.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9869999999999999e-06 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252713+0000", 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0086670889999999993 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253039+0000", 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032610099999999997 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253414+0000", 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037573700000000001 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256958+0000", 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035431759999999999 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259926+0000", 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002968077 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260003+0000", 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7208999999999999e-05 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260072+0000", 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8653999999999997e-05 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:9 5.0 5:0418dd6f:::benchmark_data_smithi112_23632_object8:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243948+0000", 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.184873044, 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014983845000000001, 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 9 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.510 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243948+0000", 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243948+0000", 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243950+0000", 2024-09-20T21:01:40.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2270000000000001e-06 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244080+0000", 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000130149 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244097+0000", 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6886000000000001e-05 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244106+0000", 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7970000000000006e-06 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244169+0000", 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3299999999999994e-05 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244175+0000", 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9229999999999999e-06 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.249939+0000", 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0057645550000000002 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.250595+0000", 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065572899999999997 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.250929+0000", 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000333467 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254107+0000", 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003178878 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258836+0000", 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047288620000000003 2024-09-20T21:01:40.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258893+0000", 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6743000000000002e-05 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258932+0000", 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9329000000000002e-05 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:10 5.0 5:0c1d9875:::benchmark_data_smithi112_23632_object9:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244126+0000", 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.184695808000001, 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014913087, 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 10 2024-09-20T21:01:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244126+0000", 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244126+0000", 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244127+0000", 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.24e-06 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244238+0000", 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000111295 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244271+0000", 2024-09-20T21:01:40.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2894e-05 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244280+0000", 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6559999999999998e-06 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244333+0000", 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3125999999999999e-05 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:40.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244338+0000", 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3600000000000004e-06 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.251927+0000", 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0075885090000000002 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252042+0000", 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011513100000000001 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252178+0000", 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013604700000000001 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254889+0000", 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027108560000000002 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258974+0000", 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040847050000000001 2024-09-20T21:01:40.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259020+0000", 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6312e-05 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259039+0000", 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8955999999999999e-05 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:14 5.0 5:04cc51db:::benchmark_data_smithi112_23632_object13:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.184363658000001, 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017127937999999999, 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 14 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.524 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244459+0000", 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0699999999999999e-06 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244569+0000", 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010965 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244594+0000", 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5066e-05 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244607+0000", 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3152999999999999e-05 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244663+0000", 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6360000000000002e-05 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244670+0000", 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8199999999999999e-06 2024-09-20T21:01:40.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252692+0000", 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0080222069999999999 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252990+0000", 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000297788 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253360+0000", 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00036990699999999999 2024-09-20T21:01:40.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255672+0000", 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023116529999999999 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261302+0000", 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0056302890000000001 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261450+0000", 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000148016 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261586+0000", 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135959 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:15 5.4 5:26d45dc5:::benchmark_data_smithi112_23632_object14:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:40.530 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.184196869000001, 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015746412000000001, 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 15 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:40.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244626+0000", 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1170000000000001e-06 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244735+0000", 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108902 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244767+0000", 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2767e-05 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244780+0000", 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2823000000000001e-05 2024-09-20T21:01:40.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244832+0000", 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2102999999999999e-05 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244838+0000", 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2129999999999999e-06 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254299+0000", 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0094618670000000005 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254554+0000", 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025405099999999998 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255233+0000", 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000679852 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.257421+0000", 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00218761 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260171+0000", 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027496119999999998 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260302+0000", 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000131025 2024-09-20T21:01:40.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260371+0000", 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9469999999999997e-05 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:157 5.4 5:2a681351:::benchmark_data_smithi112_23632_object156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.116980311000001, 2024-09-20T21:01:40.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016166680999999999, 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 157 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311842+0000", 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2389999999999999e-06 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311879+0000", 2024-09-20T21:01:40.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6520000000000003e-05 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311893+0000", 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3814e-05 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311903+0000", 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7969999999999995e-06 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311963+0000", 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0773999999999998e-05 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.312056+0000", 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2264999999999998e-05 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.312153+0000", 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7118000000000001e-05 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.317062+0000", 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0049092420000000003 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.327952+0000", 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010889708999999999 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.327985+0000", 2024-09-20T21:01:40.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3519000000000002e-05 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.328008+0000", 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2684000000000002e-05 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16441 5.4 5:231ae493:::benchmark_data_smithi112_23632_object16440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:40.543 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.2052180579999998, 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018694967999999999, 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16441 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223604+0000", 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0020000000000001e-06 2024-09-20T21:01:40.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223754+0000", 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014907899999999999 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5207e-05 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223787+0000", 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8685000000000002e-05 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223852+0000", 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5012999999999996e-05 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017955400000000001 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224223+0000", 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000191428 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225787+0000", 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001563617 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242143+0000", 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01635615 2024-09-20T21:01:40.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242235+0000", 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2250000000000006e-05 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242298+0000", 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2983000000000003e-05 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16442 5.0 5:07f91168:::benchmark_data_smithi112_23632_object16441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.205013245, 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018432022999999999, 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16442 2024-09-20T21:01:40.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223809+0000", 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223867+0000", 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8365000000000001e-05 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223878+0000", 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.058e-05 2024-09-20T21:01:40.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223886+0000", 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6490000000000008e-06 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223943+0000", 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6879000000000002e-05 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224078+0000", 2024-09-20T21:01:40.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135549 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224243+0000", 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016484900000000001 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226958+0000", 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027148490000000001 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242135+0000", 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015176858 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242185+0000", 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0254999999999999e-05 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242240+0000", 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.541e-05 2024-09-20T21:01:40.555 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16446 5.0 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.2048419260000003, 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018538079999999998, 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16446 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:40.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5799999999999999e-07 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224021+0000", 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1053000000000001e-05 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.111e-05 2024-09-20T21:01:40.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224040+0000", 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5480000000000004e-06 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225554+0000", 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001513749 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:40.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225818+0000", 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026389300000000002 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226084+0000", 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026617999999999998 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.227457+0000", 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013727030000000001 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242319+0000", 2024-09-20T21:01:40.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014862492 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242426+0000", 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107291 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242518+0000", 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1403000000000006e-05 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:40.561 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:40.562 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:40.563 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:40.561+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:40.563 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:40.663 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:40.661+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:40.717 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:38837 5.2 5:4b8fa10d:::benchmark_data_smithi112_23632_object38836:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:40.715185+0000", 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002606784, 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026363530000000001, 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.718 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 38837 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715185+0000", 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715185+0000", 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715186+0000", 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4399999999999999e-07 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715220+0000", 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3812000000000001e-05 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715228+0000", 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5089999999999993e-06 2024-09-20T21:01:40.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715234+0000", 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2110000000000003e-06 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715316+0000", 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1587000000000003e-05 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715462+0000", 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014636900000000001 2024-09-20T21:01:40.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715613+0000", 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150221 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:38839 5.3 5:c8be5400:::benchmark_data_smithi112_23632_object38838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:40.715249+0000", 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0025433830000000002, 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002659603, 2024-09-20T21:01:40.722 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 38839 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715249+0000", 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715249+0000", 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715249+0000", 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1200000000000003e-07 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715280+0000", 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0534999999999998e-05 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715287+0000", 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3499999999999999e-06 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715293+0000", 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.806e-06 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715420+0000", 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127002 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715551+0000", 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013135800000000001 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715649+0000", 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8251999999999994e-05 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:38841 5.7 5:e6a43bf4:::benchmark_data_smithi112_23632_object38840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:40.715731+0000", 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0020605049999999998, 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022506570000000001, 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 38841 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:40.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715731+0000", 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715731+0000", 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715732+0000", 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1699999999999997e-07 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715836+0000", 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010431 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715846+0000", 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2320000000000007e-06 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715851+0000", 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.933e-06 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715900+0000", 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8986000000000002e-05 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716035+0000", 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000135499 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716181+0000", 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014550399999999999 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.730 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:38845 5.5 5:a1d1b77f:::benchmark_data_smithi112_23632_object38844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:40.715866+0000", 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001925441, 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021931429999999998, 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.731 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 38845 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715866+0000", 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715866+0000", 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715867+0000", 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8500000000000001e-07 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715921+0000", 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4042000000000002e-05 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:40.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715927+0000", 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6389999999999997e-06 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715930+0000", 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6619999999999998e-06 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.715972+0000", 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1530999999999999e-05 2024-09-20T21:01:40.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716095+0000", 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000123041 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716209+0000", 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011391 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:38842 5.0 e28/21 5:0fca7399:::benchmark_data_smithi112_23632_object38841:head v 28'2357, mlcod=28'2355)", 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:40.716289+0000", 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0015031249999999999, 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001846487, 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716289+0000", 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716289+0000", 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716289+0000", 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5899999999999996e-07 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716332+0000", 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2485999999999999e-05 2024-09-20T21:01:40.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716342+0000", 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8490000000000001e-06 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716346+0000", 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6410000000000001e-06 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716422+0000", 2024-09-20T21:01:40.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5616000000000002e-05 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716440+0000", 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7652999999999999e-05 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:38849 5.2 5:498b8425:::benchmark_data_smithi112_23632_object38848:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:40.716363+0000", 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001428899, 2024-09-20T21:01:40.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0018383, 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 38849 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716363+0000", 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716363+0000", 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716364+0000", 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1900000000000002e-07 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716472+0000", 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108292 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716482+0000", 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0015e-05 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716489+0000", 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0330000000000003e-06 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.717158+0000", 2024-09-20T21:01:40.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00066872399999999999 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.717271+0000", 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113441 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.717352+0000", 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0977999999999996e-05 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:38843 5.4 e28/21 5:2a06a96b:::benchmark_data_smithi112_23632_object38842:head v 28'2418, mlcod=28'2416)", 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:40.716398+0000", 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001394345, 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001872528, 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716398+0000", 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716398+0000", 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716398+0000", 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4299999999999999e-07 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716524+0000", 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012591499999999999 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:40.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716549+0000", 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5122000000000001e-05 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716556+0000", 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.849e-06 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716605+0000", 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8998000000000001e-05 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716621+0000", 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6183000000000001e-05 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:38850 5.7 5:ec830706:::benchmark_data_smithi112_23632_object38849:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:40.716506+0000", 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001286019, 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001826879, 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:40.747 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 38850 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716506+0000", 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:40.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716506+0000", 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716506+0000", 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2900000000000004e-07 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716560+0000", 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3559e-05 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716566+0000", 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9499999999999998e-06 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.716570+0000", 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1350000000000002e-06 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.717580+0000", 2024-09-20T21:01:40.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001010029 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.717684+0000", 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010391900000000001 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.717799+0000", 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115432 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.751 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:40.752 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.752 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:40.752 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:01:40.752 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 8 2024-09-20T21:01:40.752 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:40.753 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:40.764 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:40.761+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:40.864 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:40.861+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:40.911 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:40.911 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:01:40.911 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:01:40.911 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:01:40.911 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:40.932 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:40.965 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:40.965+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:41.066 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:41.062+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:41.086 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.890441031000002, 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:01:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.890306832, 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:01:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:01:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.890201825999998, 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:01:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:01:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:01:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.890082301, 2024-09-20T21:01:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:01:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:01:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:01:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.890012294000002, 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:01:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:01:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.889937241999998, 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:01:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.889850215999999, 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:01:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.889781443, 2024-09-20T21:01:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.889695184000001, 2024-09-20T21:01:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:01:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:01:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159 5.a 5:5db82723:::benchmark_data_smithi112_23632_object158:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.774279204000001, 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015345846, 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310395+0000", 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.48e-06 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310489+0000", 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4293e-05 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310510+0000", 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1073e-05 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310554+0000", 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3797000000000001e-05 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310670+0000", 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115442 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311025+0000", 2024-09-20T21:01:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035569399999999999 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311335+0000", 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030994099999999999 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322334+0000", 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010998888 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325578+0000", 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032433850000000001 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325667+0000", 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9127000000000002e-05 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325739+0000", 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2725999999999995e-05 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:157 5.4 e23/21 5:2a681351:::benchmark_data_smithi112_23632_object156:head v 23'9, mlcod=23'7)", 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.774040242, 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015433034, 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310634+0000", 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6959999999999999e-06 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310717+0000", 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3245999999999995e-05 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310740+0000", 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2957000000000001e-05 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310757+0000", 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6646e-05 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320083+0000", 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0093255790000000005 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320124+0000", 2024-09-20T21:01:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1635999999999999e-05 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325970+0000", 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058456879999999999 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.326066+0000", 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5586000000000003e-05 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16445 5.2 5:4d443432:::benchmark_data_smithi112_23632_object16444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8623407509999996, 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01791187, 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16445 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222333+0000", 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0699999999999996e-07 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222428+0000", 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5198000000000006e-05 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222438+0000", 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6889999999999999e-06 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222481+0000", 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3157e-05 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222551+0000", 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9915999999999999e-05 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222632+0000", 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1650999999999995e-05 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222733+0000", 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100153 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227624+0000", 2024-09-20T21:01:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048913309999999996 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240156+0000", 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012531927 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240205+0000", 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9363999999999997e-05 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240244+0000", 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8577e-05 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16448 5.3 5:ceed33ed:::benchmark_data_smithi112_23632_object16447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8621032290000006, 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017689621999999999, 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16448 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222570+0000", 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222617+0000", 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6493999999999999e-05 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222626+0000", 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5959999999999993e-06 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222633+0000", 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222677+0000", 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4029000000000001e-05 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222798+0000", 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000120586 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222928+0000", 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013065400000000001 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227036+0000", 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0041077190000000001 2024-09-20T21:01:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240183+0000", 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013146817999999999 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240229+0000", 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6619999999999997e-05 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240259+0000", 2024-09-20T21:01:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9791e-05 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16451 5.1 5:80cd9f79:::benchmark_data_smithi112_23632_object16450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8619621290000001, 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017604979, 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16451 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.13e-07 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222743+0000", 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2079000000000002e-05 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222752+0000", 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9369999999999993e-06 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222758+0000", 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7320000000000003e-06 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222814+0000", 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6450000000000003e-05 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222950+0000", 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013559600000000001 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223083+0000", 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132676 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227057+0000", 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039746499999999997 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240270+0000", 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013212911000000001 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240294+0000", 2024-09-20T21:01:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4261e-05 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240316+0000", 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1073999999999998e-05 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16441 5.4 e25/21 5:231ae493:::benchmark_data_smithi112_23632_object16440:head v 25'1007, mlcod=25'1005)", 2024-09-20T21:01:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8610954960000008, 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016533478000000001, 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223578+0000", 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7800000000000001e-07 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223630+0000", 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2011000000000001e-05 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223639+0000", 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4919999999999999e-06 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223646+0000", 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3069999999999999e-06 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223697+0000", 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0822999999999998e-05 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223710+0000", 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3002e-05 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240081+0000", 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016371753999999999 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240111+0000", 2024-09-20T21:01:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9311000000000001e-05 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16442 5.0 e25/21 5:07f91168:::benchmark_data_smithi112_23632_object16441:head v 25'1017, mlcod=25'1015)", 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8610090590000006, 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016425138999999998, 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9200000000000002e-07 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223700+0000", 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5911999999999998e-05 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223705+0000", 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5990000000000001e-06 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223709+0000", 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8060000000000001e-06 2024-09-20T21:01:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9803000000000003e-05 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223788+0000", 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8838000000000002e-05 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240052+0000", 2024-09-20T21:01:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016264361000000001 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240089+0000", 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6528e-05 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16452 5.1 5:835745ce:::benchmark_data_smithi112_23632_object16451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8609337700000008, 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016631607999999999, 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16452 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223740+0000", 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7899999999999997e-07 2024-09-20T21:01:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223780+0000", 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9892999999999999e-05 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223790+0000", 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0708e-05 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223798+0000", 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0860000000000002e-06 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223929+0000", 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013030299999999999 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224044+0000", 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114875 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224173+0000", 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012932800000000001 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227092+0000", 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029195739999999999 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240319+0000", 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013226813 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240353+0000", 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3686000000000002e-05 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240371+0000", 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7563000000000001e-05 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16446 5.0 e25/21 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head v 25'1018, mlcod=25'1015)", 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8602005209999994, 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015653869000000001, 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224473+0000", 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5300000000000004e-07 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224536+0000", 2024-09-20T21:01:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3554999999999997e-05 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224544+0000", 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3200000000000002e-06 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224548+0000", 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7350000000000004e-06 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224582+0000", 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3303999999999998e-05 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224595+0000", 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3199e-05 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240095+0000", 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015500323999999999 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240126+0000", 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0778999999999998e-05 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16454 5.a 5:5e808c04:::benchmark_data_smithi112_23632_object16453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8600806710000004, 2024-09-20T21:01:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016518115999999999, 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16454 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224593+0000", 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2999999999999999e-07 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224635+0000", 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1711000000000001e-05 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224646+0000", 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1015999999999999e-05 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224653+0000", 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449999999999998e-06 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224714+0000", 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0835000000000003e-05 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224838+0000", 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124053 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224978+0000", 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014017200000000001 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240105+0000", 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015127148999999999 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241034+0000", 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00092821600000000005 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241065+0000", 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1149999999999998e-05 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241110+0000", 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5439000000000003e-05 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:39379 5.5 5:a5330d0c:::benchmark_data_smithi112_23632_object39378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:40.939980+0000", 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.14469222700000001, 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014757706000000001, 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 39379 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.939980+0000", 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.939980+0000", 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.939981+0000", 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1399999999999997e-07 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940026+0000", 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4845000000000002e-05 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940034+0000", 2024-09-20T21:01:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5359999999999992e-06 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940041+0000", 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1580000000000002e-06 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940100+0000", 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9669000000000001e-05 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940178+0000", 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8003999999999994e-05 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940257+0000", 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8536999999999997e-05 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.943479+0000", 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032217650000000001 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.954633+0000", 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011153972999999999 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.954690+0000", 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7456e-05 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.954738+0000", 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8149000000000003e-05 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:41.202 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:41.203 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:41.204 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:41.202+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:41.240 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 14 16 40114 40098 178.991 148.875 0.00295615 0.00558187 2024-09-20T21:01:41.304 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:41.301+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:41.360 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:40432 5.1 e28/21 5:8b2cffee:::benchmark_data_smithi112_23632_object40431:head v 28'2592, mlcod=28'2590)", 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:41.359293+0000", 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0022407799999999999, 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0022574919999999998, 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.361 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359293+0000", 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359293+0000", 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359293+0000", 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.4400000000000001e-07 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.362 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359347+0000", 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4041e-05 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359357+0000", 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0045e-05 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359363+0000", 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4639999999999997e-06 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.363 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359409+0000", 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.6761000000000002e-05 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359422+0000", 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2282e-05 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.364 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:40436 5.d e28/21 5:b2f983e9:::benchmark_data_smithi112_23632_object40435:head v 28'2439, mlcod=28'2437)", 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:41.359849+0000", 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0016845149999999999, 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0017576099999999999, 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359849+0000", 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.365 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359849+0000", 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359849+0000", 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.68e-07 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359893+0000", 2024-09-20T21:01:41.366 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.3745000000000002e-05 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359902+0000", 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359907+0000", 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1649999999999997e-06 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.367 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359958+0000", 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0691e-05 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.359975+0000", 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7391999999999999e-05 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:40438 5.9 e28/21 5:94e1c833:::benchmark_data_smithi112_23632_object40437:head v 28'2560, mlcod=28'2558)", 2024-09-20T21:01:41.368 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:41.360985+0000", 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.000547877, 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00067258699999999999, 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.360985+0000", 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.369 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.360985+0000", 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.360986+0000", 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.8100000000000003e-07 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.361044+0000", 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.8149999999999997e-05 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.370 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.361052+0000", 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0609999999999996e-06 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.361057+0000", 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.369e-06 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.361108+0000", 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1799000000000003e-05 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.371 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.372 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:41.361130+0000", 2024-09-20T21:01:41.372 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1488000000000002e-05 2024-09-20T21:01:41.372 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.372 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.372 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.372 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.372 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:01:41.372 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 3 2024-09-20T21:01:41.372 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:41.380 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:41.404 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:41.405+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:41.504 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:41.505+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:41.527 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:41.528 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:01:41.528 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:01:41.528 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:01:41.528 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:41.548 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:41.627 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T21:01:41.627 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:01:41.627 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-20T21:01:41.627 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T21:01:41.627 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T21:01:41.627 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-20T21:01:41.637 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:41.637+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:41.707 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:41.705+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:41.743 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:41.743 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:01:41.743 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:01:41.743 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:41.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.779700964, 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:01:41.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:01:41.749 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 38.774706190000003, 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:41.751 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.752 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.753 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.754 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:01:41.755 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.756 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.546766794, 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.757 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.758 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.759 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.760 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.761 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:01:41.762 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.546619575000001, 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.763 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:01:41.764 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.765 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:01:41.766 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.767 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:01:41.768 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.546493643000002, 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.769 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:01:41.770 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.772 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:01:41.773 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.774 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.546409047000001, 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.775 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.776 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:01:41.777 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.778 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.779 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.780 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.546091445999998, 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.781 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.782 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.783 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.784 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:01:41.785 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.545989729999999, 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.786 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.787 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.788 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.789 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.790 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:01:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.545909133999999, 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.792 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.793 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.794 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:01:41.795 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:01:41.796 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.797 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.545832067999999, 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.798 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:01:41.799 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:01:41.800 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.801 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.802 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.545620599999999, 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.803 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.804 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:01:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.806 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:41.808 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.545544762999999, 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.809 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:01:41.810 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:01:41.811 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:01:41.812 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.813 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.545422701, 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.814 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.815 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.816 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.817 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:01:41.818 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.545354452000002, 2024-09-20T21:01:41.819 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.820 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.821 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.822 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:01:41.823 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:01:41.824 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.545261666000002, 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.825 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.826 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.827 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.828 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.829 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.54519981, 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.830 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:01:41.832 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:01:41.833 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.834 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.835 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.545117434000002, 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.836 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.837 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:01:41.838 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.839 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.840 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.545032874, 2024-09-20T21:01:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.844 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.845 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:01:41.846 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.544968967999999, 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:41.847 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.848 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.849 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:01:41.850 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:41.851 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.852 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 29.544906224999998, 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.853 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:41.854 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.855 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:01:41.856 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.857 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.857 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.857 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:41.857 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:41.857 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:41.859 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:41.859 INFO:teuthology.orchestra.run.smithi203.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-20T21:01:41.859 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:41.859 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:41.860 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:41.857+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:41.958 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:41.957+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:42097 5.e 5:78c758b5:::benchmark_data_smithi112_23632_object42096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:42.014902+0000", 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0040542449999999997, 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040744320000000002, 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 42097 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.014902+0000", 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.014902+0000", 2024-09-20T21:01:42.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.014903+0000", 2024-09-20T21:01:42.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8800000000000001e-07 2024-09-20T21:01:42.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.014975+0000", 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2015999999999996e-05 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.014984+0000", 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8060000000000006e-06 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.014991+0000", 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4130000000000003e-06 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015046+0000", 2024-09-20T21:01:42.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5139000000000002e-05 2024-09-20T21:01:42.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015126+0000", 2024-09-20T21:01:42.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0212999999999999e-05 2024-09-20T21:01:42.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015200+0000", 2024-09-20T21:01:42.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4282000000000005e-05 2024-09-20T21:01:42.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017781+0000", 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0025808609999999998 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:42099 5.0 5:00f3d582:::benchmark_data_smithi112_23632_object42098:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:42.015328+0000", 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0036284049999999999, 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0037003130000000002, 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.023 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 42099 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015328+0000", 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015328+0000", 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015328+0000", 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3799999999999996e-07 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015457+0000", 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012884699999999999 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015469+0000", 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1343e-05 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015475+0000", 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1670000000000004e-06 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015533+0000", 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8383e-05 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015680+0000", 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014645500000000001 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015831+0000", 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015171100000000001 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.018163+0000", 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023316740000000002 2024-09-20T21:01:42.027 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:42100 5.d 5:b4036e60:::benchmark_data_smithi112_23632_object42099:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:42.015596+0000", 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0033595779999999998, 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034757249999999998, 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.028 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 42100 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015596+0000", 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015596+0000", 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015597+0000", 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5600000000000005e-07 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015743+0000", 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014633199999999999 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015752+0000", 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9870000000000005e-06 2024-09-20T21:01:42.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015758+0000", 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7219999999999996e-06 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015810+0000", 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1501e-05 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.015933+0000", 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012318 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.016051+0000", 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118236 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.018146+0000", 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020945540000000002 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:42103 5.b 5:d50f0656:::benchmark_data_smithi112_23632_object42102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:42.017683+0000", 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0012729569999999999, 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0014331210000000001, 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 42103 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017683+0000", 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017683+0000", 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017684+0000", 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7899999999999997e-07 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017815+0000", 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013133200000000001 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017827+0000", 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1623e-05 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017834+0000", 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1439999999999997e-06 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017873+0000", 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9153000000000003e-05 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017994+0000", 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000120815 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.018113+0000", 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011906200000000001 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:42086 5.b e28/21)", 2024-09-20T21:01:42.037 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:42.017891+0000", 2024-09-20T21:01:42.038 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0010650169999999999, 2024-09-20T21:01:42.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0012607359999999999, 2024-09-20T21:01:42.038 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.038 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.038 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:42.038 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017891+0000", 2024-09-20T21:01:42.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017891+0000", 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017891+0000", 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017895+0000", 2024-09-20T21:01:42.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6179999999999999e-06 2024-09-20T21:01:42.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017905+0000", 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9990000000000003e-06 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017917+0000", 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1542999999999999e-05 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.042 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:42086 5.b 5:d8066402:::benchmark_data_smithi112_23632_object42085:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:42.042 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:42.007828+0000", 2024-09-20T21:01:42.042 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.011127433000000001, 2024-09-20T21:01:42.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.011351561, 2024-09-20T21:01:42.042 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.042 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.042 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:42.043 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.043 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.043 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.043 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 42086 2024-09-20T21:01:42.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.043 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007828+0000", 2024-09-20T21:01:42.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007828+0000", 2024-09-20T21:01:42.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007830+0000", 2024-09-20T21:01:42.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.096e-06 2024-09-20T21:01:42.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007888+0000", 2024-09-20T21:01:42.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8826000000000002e-05 2024-09-20T21:01:42.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007910+0000", 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1464999999999999e-05 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007919+0000", 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1719999999999996e-06 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.008812+0000", 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00089336299999999999 2024-09-20T21:01:42.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.008938+0000", 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012562900000000001 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.009086+0000", 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014804 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.014976+0000", 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0058894639999999996 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:42087 5.b 5:dc2b9d2a:::benchmark_data_smithi112_23632_object42086:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:42.007936+0000", 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.011019823, 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.011288685999999999, 2024-09-20T21:01:42.049 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.050 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.050 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:42.050 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.050 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.050 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.050 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 42087 2024-09-20T21:01:42.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.050 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007936+0000", 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007936+0000", 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007937+0000", 2024-09-20T21:01:42.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0200000000000002e-07 2024-09-20T21:01:42.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007965+0000", 2024-09-20T21:01:42.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8e-05 2024-09-20T21:01:42.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.053 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007972+0000", 2024-09-20T21:01:42.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3839999999999999e-06 2024-09-20T21:01:42.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.054 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.007978+0000", 2024-09-20T21:01:42.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2349999999999996e-06 2024-09-20T21:01:42.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.010526+0000", 2024-09-20T21:01:42.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0025480659999999999 2024-09-20T21:01:42.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.010653+0000", 2024-09-20T21:01:42.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000126983 2024-09-20T21:01:42.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.010784+0000", 2024-09-20T21:01:42.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013055099999999999 2024-09-20T21:01:42.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017301+0000", 2024-09-20T21:01:42.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0065168379999999996 2024-09-20T21:01:42.057 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.057 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.058 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.058 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:42091 5.4 5:203bb33b:::benchmark_data_smithi112_23632_object42090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:42.058 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:42.011853+0000", 2024-09-20T21:01:42.058 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0071026070000000004, 2024-09-20T21:01:42.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0074139949999999996, 2024-09-20T21:01:42.059 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.059 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.059 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:42.059 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.059 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.060 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.060 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 42091 2024-09-20T21:01:42.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.060 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.061 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.011853+0000", 2024-09-20T21:01:42.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.061 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.061 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.011853+0000", 2024-09-20T21:01:42.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.011854+0000", 2024-09-20T21:01:42.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1399999999999996e-07 2024-09-20T21:01:42.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.011933+0000", 2024-09-20T21:01:42.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8752999999999996e-05 2024-09-20T21:01:42.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.011946+0000", 2024-09-20T21:01:42.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3121e-05 2024-09-20T21:01:42.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.011954+0000", 2024-09-20T21:01:42.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4309999999999994e-06 2024-09-20T21:01:42.065 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.012126+0000", 2024-09-20T21:01:42.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017134999999999999 2024-09-20T21:01:42.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.066 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.012241+0000", 2024-09-20T21:01:42.066 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011526700000000001 2024-09-20T21:01:42.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.012323+0000", 2024-09-20T21:01:42.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2223000000000002e-05 2024-09-20T21:01:42.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:42.017389+0000", 2024-09-20T21:01:42.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050655309999999999 2024-09-20T21:01:42.068 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.068 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.068 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.068 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.068 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:01:42.068 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 8 2024-09-20T21:01:42.068 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:42.070 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:42.070 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:42.069+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:42.170 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:42.166+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:42.240 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 15 16 42661 42645 177.67 159.188 0.00596033 0.00562328 2024-09-20T21:01:42.257 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:01:42.268 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:42.268 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:01:42.268 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:01:42.268 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:01:42.268 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:42.271 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:42.269+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:42.290 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:42.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:01:42.373 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:42.373+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:42.473 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:42.473+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.292125667000001, 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:01:42.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.292035631000001, 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.494 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:01:42.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:01:42.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:01:42.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.291949278000001, 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.500 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:01:42.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:01:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:01:42.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:42.506 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.291880468999999, 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:01:42.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.291847609000001, 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:01:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:01:42.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.518 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.291805591999999, 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:01:42.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:01:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:42.525 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.291680486000001, 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:01:42.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:01:42.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:01:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.291588137000002, 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:42.536 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.291503765000002, 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:01:42.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.541 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:2 5.8 5:124aadbb:::benchmark_data_smithi112_23632_object1:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.245078942999999, 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017726502000000002, 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 2 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243120+0000", 2024-09-20T21:01:42.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3799999999999999e-06 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243306+0000", 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018621499999999999 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243327+0000", 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1036e-05 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243341+0000", 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.412e-05 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243477+0000", 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136286 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243492+0000", 2024-09-20T21:01:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5033e-05 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252641+0000", 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0091492480000000004 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252748+0000", 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106724 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252867+0000", 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011846899999999999 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255666+0000", 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002799368 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260766+0000", 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050996940000000001 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260809+0000", 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2972999999999997e-05 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260845+0000", 2024-09-20T21:01:42.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5955999999999999e-05 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:5 5.4 5:272d9688:::benchmark_data_smithi112_23632_object4:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.244612414000001, 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015407461000000001, 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.549 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 5 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243586+0000", 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0300000000000001e-06 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243695+0000", 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0001097 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243712+0000", 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7073000000000001e-05 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243721+0000", 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9360000000000005e-06 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243834+0000", 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000112186 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243849+0000", 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5347000000000001e-05 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.251959+0000", 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0081103449999999997 2024-09-20T21:01:42.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252062+0000", 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010262 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252178+0000", 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011608900000000001 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256938+0000", 2024-09-20T21:01:42.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047595249999999997 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258912+0000", 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019745470000000001 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258955+0000", 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2568000000000003e-05 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258992+0000", 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7494999999999999e-05 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:7 5.4 5:2e77bfa8:::benchmark_data_smithi112_23632_object6:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.244451744999999, 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016326288000000001, 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.556 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 7 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243747+0000", 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2300000000000001e-06 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243903+0000", 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015672599999999999 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243918+0000", 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4355999999999999e-05 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243927+0000", 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3340000000000008e-06 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244038+0000", 2024-09-20T21:01:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110612 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244046+0000", 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9869999999999999e-06 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252713+0000", 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0086670889999999993 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253039+0000", 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032610099999999997 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253414+0000", 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037573700000000001 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256958+0000", 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035431759999999999 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259926+0000", 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002968077 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260003+0000", 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7208999999999999e-05 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260072+0000", 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8653999999999997e-05 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.562 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:14 5.0 5:04cc51db:::benchmark_data_smithi112_23632_object13:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.243739194, 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017127937999999999, 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.563 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 14 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244459+0000", 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0699999999999999e-06 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244569+0000", 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010965 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244594+0000", 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5066e-05 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244607+0000", 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3152999999999999e-05 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244663+0000", 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6360000000000002e-05 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:42.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244670+0000", 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8199999999999999e-06 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252692+0000", 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0080222069999999999 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252990+0000", 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000297788 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253360+0000", 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00036990699999999999 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255672+0000", 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023116529999999999 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261302+0000", 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0056302890000000001 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261450+0000", 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000148016 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261586+0000", 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135959 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.569 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:15 5.4 5:26d45dc5:::benchmark_data_smithi112_23632_object14:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.243572405, 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015746412000000001, 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 15 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244626+0000", 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1170000000000001e-06 2024-09-20T21:01:42.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244735+0000", 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108902 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244767+0000", 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2767e-05 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244780+0000", 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2823000000000001e-05 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244832+0000", 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2102999999999999e-05 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244838+0000", 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2129999999999999e-06 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254299+0000", 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0094618670000000005 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254554+0000", 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025405099999999998 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255233+0000", 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000679852 2024-09-20T21:01:42.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.257421+0000", 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00218761 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260171+0000", 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027496119999999998 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260302+0000", 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000131025 2024-09-20T21:01:42.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260371+0000", 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9469999999999997e-05 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:157 5.4 5:2a681351:::benchmark_data_smithi112_23632_object156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.176355847, 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016166680999999999, 2024-09-20T21:01:42.576 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 157 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:42.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311842+0000", 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2389999999999999e-06 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311879+0000", 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6520000000000003e-05 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311893+0000", 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3814e-05 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311903+0000", 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7969999999999995e-06 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311963+0000", 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0773999999999998e-05 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.312056+0000", 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2264999999999998e-05 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.312153+0000", 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7118000000000001e-05 2024-09-20T21:01:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.317062+0000", 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0049092420000000003 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.327952+0000", 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010889708999999999 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.327985+0000", 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3519000000000002e-05 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.328008+0000", 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2684000000000002e-05 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16441 5.4 5:231ae493:::benchmark_data_smithi112_23632_object16440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:42.582 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 10.264593594000001, 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018694967999999999, 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16441 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223604+0000", 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0020000000000001e-06 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223754+0000", 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014907899999999999 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5207e-05 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223787+0000", 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8685000000000002e-05 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223852+0000", 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5012999999999996e-05 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017955400000000001 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224223+0000", 2024-09-20T21:01:42.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000191428 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225787+0000", 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001563617 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242143+0000", 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01635615 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242235+0000", 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2250000000000006e-05 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242298+0000", 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2983000000000003e-05 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16442 5.0 5:07f91168:::benchmark_data_smithi112_23632_object16441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:42.588 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 10.264388780999999, 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018432022999999999, 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16442 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223809+0000", 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:42.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223867+0000", 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8365000000000001e-05 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223878+0000", 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.058e-05 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223886+0000", 2024-09-20T21:01:42.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6490000000000008e-06 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223943+0000", 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6879000000000002e-05 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224078+0000", 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135549 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.592 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224243+0000", 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016484900000000001 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226958+0000", 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027148490000000001 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242135+0000", 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015176858 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242185+0000", 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0254999999999999e-05 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242240+0000", 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.541e-05 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16446 5.0 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:42.594 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 10.264217462, 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018538079999999998, 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16446 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:42.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5799999999999999e-07 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224021+0000", 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1053000000000001e-05 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.111e-05 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224040+0000", 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5480000000000004e-06 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225554+0000", 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001513749 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225818+0000", 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026389300000000002 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226084+0000", 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026617999999999998 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.227457+0000", 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013727030000000001 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242319+0000", 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014862492 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242426+0000", 2024-09-20T21:01:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107291 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242518+0000", 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1403000000000006e-05 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:38547 5.8 5:139337cc:::benchmark_data_smithi112_23632_object38546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:40.587197+0000", 2024-09-20T21:01:42.600 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.901000459, 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015489167, 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 38547 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587197+0000", 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587197+0000", 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587197+0000", 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7299999999999996e-07 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587231+0000", 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3717999999999998e-05 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587238+0000", 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4580000000000004e-06 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587247+0000", 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5520000000000005e-06 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.590373+0000", 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0031263530000000001 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.590473+0000", 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9270000000000003e-05 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.590614+0000", 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014140600000000001 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.598316+0000", 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.007702141 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.602580+0000", 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0042641069999999996 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.602639+0000", 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8891000000000002e-05 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.602686+0000", 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6697999999999999e-05 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:39229 5.b 5:dae339ff:::benchmark_data_smithi112_23632_object39228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:40.877385+0000", 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.610812149, 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01529838, 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:42.606 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 39229 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.877385+0000", 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.877385+0000", 2024-09-20T21:01:42.607 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.877385+0000", 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9900000000000001e-07 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.877417+0000", 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2175999999999998e-05 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.877423+0000", 2024-09-20T21:01:42.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2109999999999997e-06 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.877426+0000", 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4350000000000001e-06 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.881025+0000", 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035987580000000001 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.881115+0000", 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9893000000000001e-05 2024-09-20T21:01:42.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.881202+0000", 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6978999999999995e-05 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.884189+0000", 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029874229999999999 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.892566+0000", 2024-09-20T21:01:42.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0083767849999999994 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.892648+0000", 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2291000000000002e-05 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.892683+0000", 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5030000000000002e-05 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.611 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.612 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:42.612 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:42.612 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:42.613 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:42.613 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:42.613+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:42.614 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:42.614 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:42.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:42.615 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:42.616 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:42.714 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:42.710+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:42.772 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:42.772 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:42.795 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:42.815 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:42.812+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:42.916 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:42.913+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:42.994 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:42.994 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:43.018 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:43.017+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:43.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:43.119 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:43.117+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:43.171 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:43.172 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:43.194 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:43.219 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:43.216+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:43.240 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 16 16 44975 44959 175.603 144.625 0.00406556 0.00569028 2024-09-20T21:01:43.263 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:01:43.320 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:43.320+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:43.351 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:43.351 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:43.370 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:43.420 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:43.418+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:43.515 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:43.516 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:43.521 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:43.521+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:43.536 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:43.624 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:43.625+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:43.723 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:43.720+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:43.729 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:43.729 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:43.751 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:43.824 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:43.824+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:43.909 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:43.909 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:43.924 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:43.921+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:43.931 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:44.025 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:44.025+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:44.126 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:44.122+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:44.131 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:44.132 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:44.153 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:44.227 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:44.224+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:44.240 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 17 16 47344 47328 173.982 148.062 0.00668048 0.00574287 2024-09-20T21:01:44.310 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:44.310 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:44.328 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:44.326+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:44.331 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:44.429 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:44.426+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:44.489 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:44.490 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:44.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:44.530 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:44.528+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:44.617 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:01:44.631 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:44.630+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:44.710 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:44.710 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:44.730 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:44.777 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:44.774+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:44.777 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:44.777 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:44.795 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:44.796 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:44.813 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:44.813 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:44.832 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:44.830+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:44.930 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:44.930 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:01:44.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:01:44.930 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.734924190000001, 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:01:44.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:01:44.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:44.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:01:44.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:01:44.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:44.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:01:44.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:01:44.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:01:44.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:01:44.937 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.937 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.937 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.938 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:44.938 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:44.938 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.734789991, 2024-09-20T21:01:44.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:01:44.938 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.938 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.938 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:44.938 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:44.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:44.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:01:44.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:44.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.944 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.734684985000001, 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:01:44.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:01:44.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.734565459999999, 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:44.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:44.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:01:44.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:01:44.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:01:44.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:01:44.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:01:44.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:01:44.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.734495453000001, 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:01:44.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:01:44.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:44.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:44.964 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.734420401000001, 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:44.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:01:44.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:01:44.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:01:44.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.734333374999999, 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:01:44.971 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:01:44.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:01:44.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.734264602000003, 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:01:44.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:01:44.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.980 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.734178342999996, 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:01:44.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.985 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159 5.a 5:5db82723:::benchmark_data_smithi112_23632_object158:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.618762362999998, 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015345846, 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:44.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310394+0000", 2024-09-20T21:01:44.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310395+0000", 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.48e-06 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310489+0000", 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4293e-05 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310510+0000", 2024-09-20T21:01:44.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1073e-05 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310554+0000", 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3797000000000001e-05 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310670+0000", 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115442 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311025+0000", 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035569399999999999 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.311335+0000", 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030994099999999999 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.322334+0000", 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010998888 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325578+0000", 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032433850000000001 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325667+0000", 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9127000000000002e-05 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325739+0000", 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2725999999999995e-05 2024-09-20T21:01:44.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:157 5.4 e23/21 5:2a681351:::benchmark_data_smithi112_23632_object156:head v 23'9, mlcod=23'7)", 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.618523401000001, 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015433034, 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310632+0000", 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310634+0000", 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6959999999999999e-06 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310717+0000", 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3245999999999995e-05 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310740+0000", 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2957000000000001e-05 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.310757+0000", 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6646e-05 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320083+0000", 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0093255790000000005 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.320124+0000", 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1635999999999999e-05 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.325970+0000", 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058456879999999999 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:27.326066+0000", 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5586000000000003e-05 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16445 5.2 5:4d443432:::benchmark_data_smithi112_23632_object16444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.706823910000001, 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01791187, 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:44.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16445 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:44.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222333+0000", 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0699999999999996e-07 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222428+0000", 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5198000000000006e-05 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:44.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222438+0000", 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6889999999999999e-06 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222481+0000", 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3157e-05 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222551+0000", 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9915999999999999e-05 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:44.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222632+0000", 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1650999999999995e-05 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222733+0000", 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100153 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227624+0000", 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048913309999999996 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240156+0000", 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012531927 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240205+0000", 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9363999999999997e-05 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240244+0000", 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8577e-05 2024-09-20T21:01:45.001 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16448 5.3 5:ceed33ed:::benchmark_data_smithi112_23632_object16447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.706586388, 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017689621999999999, 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:45.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16448 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:45.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222570+0000", 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222617+0000", 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6493999999999999e-05 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:45.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222626+0000", 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5959999999999993e-06 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222633+0000", 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222677+0000", 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4029000000000001e-05 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222798+0000", 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000120586 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222928+0000", 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013065400000000001 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227036+0000", 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0041077190000000001 2024-09-20T21:01:45.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240183+0000", 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013146817999999999 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240229+0000", 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6619999999999997e-05 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240259+0000", 2024-09-20T21:01:45.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9791e-05 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16451 5.1 5:80cd9f79:::benchmark_data_smithi112_23632_object16450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.706445287999999, 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017604979, 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16451 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.13e-07 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222743+0000", 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2079000000000002e-05 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222752+0000", 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9369999999999993e-06 2024-09-20T21:01:45.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222758+0000", 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7320000000000003e-06 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222814+0000", 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6450000000000003e-05 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222950+0000", 2024-09-20T21:01:45.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013559600000000001 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223083+0000", 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132676 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227057+0000", 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039746499999999997 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240270+0000", 2024-09-20T21:01:45.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013212911000000001 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240294+0000", 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4261e-05 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240316+0000", 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1073999999999998e-05 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.013 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16441 5.4 e25/21 5:231ae493:::benchmark_data_smithi112_23632_object16440:head v 25'1007, mlcod=25'1005)", 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.705578655, 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016533478000000001, 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223578+0000", 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7800000000000001e-07 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223630+0000", 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2011000000000001e-05 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223639+0000", 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4919999999999999e-06 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223646+0000", 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3069999999999999e-06 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223697+0000", 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0822999999999998e-05 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223710+0000", 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3002e-05 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240081+0000", 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016371753999999999 2024-09-20T21:01:45.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240111+0000", 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9311000000000001e-05 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16442 5.0 e25/21 5:07f91168:::benchmark_data_smithi112_23632_object16441:head v 25'1017, mlcod=25'1015)", 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.705492218, 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016425138999999998, 2024-09-20T21:01:45.018 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:45.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9200000000000002e-07 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223700+0000", 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5911999999999998e-05 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:45.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223705+0000", 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5990000000000001e-06 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223709+0000", 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8060000000000001e-06 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9803000000000003e-05 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:45.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223788+0000", 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8838000000000002e-05 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240052+0000", 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016264361000000001 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240089+0000", 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6528e-05 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:45.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16452 5.1 5:835745ce:::benchmark_data_smithi112_23632_object16451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.705416929, 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016631607999999999, 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16452 2024-09-20T21:01:45.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:45.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223740+0000", 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7899999999999997e-07 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223780+0000", 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9892999999999999e-05 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223790+0000", 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0708e-05 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223798+0000", 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0860000000000002e-06 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223929+0000", 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013030299999999999 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224044+0000", 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114875 2024-09-20T21:01:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224173+0000", 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012932800000000001 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227092+0000", 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029195739999999999 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:45.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240319+0000", 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013226813 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240353+0000", 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3686000000000002e-05 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240371+0000", 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7563000000000001e-05 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:45.028 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16446 5.0 e25/21 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head v 25'1018, mlcod=25'1015)", 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.70468368, 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015653869000000001, 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:45.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224473+0000", 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5300000000000004e-07 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224536+0000", 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3554999999999997e-05 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224544+0000", 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3200000000000002e-06 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224548+0000", 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7350000000000004e-06 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224582+0000", 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3303999999999998e-05 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224595+0000", 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3199e-05 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240095+0000", 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015500323999999999 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240126+0000", 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0778999999999998e-05 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16454 5.a 5:5e808c04:::benchmark_data_smithi112_23632_object16453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.70456383, 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016518115999999999, 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:45.033 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16454 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:45.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224593+0000", 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2999999999999999e-07 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224635+0000", 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1711000000000001e-05 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224646+0000", 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1015999999999999e-05 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224653+0000", 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449999999999998e-06 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224714+0000", 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0835000000000003e-05 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224838+0000", 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124053 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224978+0000", 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014017200000000001 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240105+0000", 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015127148999999999 2024-09-20T21:01:45.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241034+0000", 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00092821600000000005 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241065+0000", 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1149999999999998e-05 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241110+0000", 2024-09-20T21:01:45.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5439000000000003e-05 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:39379 5.5 5:a5330d0c:::benchmark_data_smithi112_23632_object39378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:40.939980+0000", 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.9891753859999999, 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014757706000000001, 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 39379 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.939980+0000", 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.939980+0000", 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.939981+0000", 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1399999999999997e-07 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940026+0000", 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4845000000000002e-05 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940034+0000", 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5359999999999992e-06 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940041+0000", 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1580000000000002e-06 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940100+0000", 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9669000000000001e-05 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940178+0000", 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8003999999999994e-05 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.940257+0000", 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8536999999999997e-05 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.943479+0000", 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032217650000000001 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.954633+0000", 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011153972999999999 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.954690+0000", 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7456e-05 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:40.954738+0000", 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8149000000000003e-05 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:45.044 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:45.045 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:45.046 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:45.046 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:45.042+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:45.147 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:45.146+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:45.200 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:45.200 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:45.200 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.200 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49556 5.6 e29/21 5:618fa410:::benchmark_data_smithi112_23632_object49555:head v 29'3128, mlcod=29'3124)", 2024-09-20T21:01:45.200 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.198709+0000", 2024-09-20T21:01:45.200 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0015196350000000001, 2024-09-20T21:01:45.200 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015591030000000001, 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198709+0000", 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198709+0000", 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.201 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198709+0000", 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.3900000000000005e-07 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198799+0000", 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0039999999999999e-05 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198809+0000", 2024-09-20T21:01:45.202 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.8730000000000002e-06 2024-09-20T21:01:45.203 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.203 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.203 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.203 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198814+0000", 2024-09-20T21:01:45.203 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.9169999999999997e-06 2024-09-20T21:01:45.203 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.203 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.203 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.204 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198867+0000", 2024-09-20T21:01:45.204 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.2439999999999999e-05 2024-09-20T21:01:45.204 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.204 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.204 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.204 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198884+0000", 2024-09-20T21:01:45.204 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7370000000000001e-05 2024-09-20T21:01:45.204 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.204 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.204 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49557 5.c e29/21 5:3c763538:::benchmark_data_smithi112_23632_object49556:head v 29'3100, mlcod=29'3097)", 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.198827+0000", 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0014015690000000001, 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001513587, 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.205 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198827+0000", 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198827+0000", 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198827+0000", 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.3200000000000001e-07 2024-09-20T21:01:45.206 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198859+0000", 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.1788999999999997e-05 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198865+0000", 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.2249999999999997e-06 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198869+0000", 2024-09-20T21:01:45.207 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.9029999999999997e-06 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198916+0000", 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.6569000000000001e-05 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198937+0000", 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1160000000000001e-05 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.208 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49558 5.7 e29/21 5:ef571836:::benchmark_data_smithi112_23632_object49557:head v 29'3049, mlcod=29'3045)", 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.199327+0000", 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00090091900000000003, 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001070964, 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.199327+0000", 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.209 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.199327+0000", 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.199334+0000", 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.533e-06 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.210 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.199385+0000", 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0902999999999997e-05 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.199411+0000", 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6237e-05 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.199424+0000", 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2906e-05 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.211 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.199491+0000", 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.7304000000000005e-05 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.199511+0000", 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9502999999999999e-05 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.212 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49542 5.6 e29/21 5:6ffeb665:::benchmark_data_smithi112_23632_object49541:head v 29'3126, mlcod=29'3124)", 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.193824+0000", 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0064039320000000002, 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0066797159999999996, 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.193824+0000", 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.213 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.193824+0000", 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.193825+0000", 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.2799999999999996e-07 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.214 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.193872+0000", 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.6465000000000003e-05 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.193881+0000", 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0250000000000008e-06 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.193886+0000", 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.2009999999999998e-06 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.215 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.193927+0000", 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.0827000000000001e-05 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.193942+0000", 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5588999999999999e-05 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.200431+0000", 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064887260000000002 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.216 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49545 5.7 e29/21 5:e687ba0f:::benchmark_data_smithi112_23632_object49544:head v 29'3047, mlcod=29'3043)", 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.194840+0000", 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0053882549999999998, 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0057954979999999996, 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.217 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.194840+0000", 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.194840+0000", 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.194841+0000", 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.32e-07 2024-09-20T21:01:45.218 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.194893+0000", 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1983e-05 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.194901+0000", 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0560000000000005e-06 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.194905+0000", 2024-09-20T21:01:45.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.0999999999999997e-06 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.194965+0000", 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.0591999999999999e-05 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.194996+0000", 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0307999999999998e-05 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.220 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49548 5.6 e29/21 5:6d0f4f3a:::benchmark_data_smithi112_23632_object49547:head v 29'3127, mlcod=29'3124)", 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.196262+0000", 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0039661289999999997, 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0044375619999999999, 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196262+0000", 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.221 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196262+0000", 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196269+0000", 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.0199999999999997e-06 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196315+0000", 2024-09-20T21:01:45.222 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.5432000000000001e-05 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196338+0000", 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3278999999999999e-05 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196359+0000", 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1104e-05 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.223 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196420+0000", 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.0646999999999997e-05 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196431+0000", 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1565e-05 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49550 5.1 e29/21 5:86241533:::benchmark_data_smithi112_23632_object49549:head v 29'3180, mlcod=29'3178)", 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.196446+0000", 2024-09-20T21:01:45.224 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0037825210000000001, 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0043173450000000002, 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196446+0000", 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196446+0000", 2024-09-20T21:01:45.225 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196447+0000", 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196543+0000", 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.6627999999999997e-05 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196554+0000", 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0519999999999999e-05 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196560+0000", 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.5980000000000002e-06 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196613+0000", 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.2775000000000002e-05 2024-09-20T21:01:45.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196628+0000", 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4983999999999999e-05 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49549 5.7 e29/21 5:e55a43c2:::benchmark_data_smithi112_23632_object49548:head v 29'3048, mlcod=29'3043)", 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.196577+0000", 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0036514910000000002, 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004249783, 2024-09-20T21:01:45.228 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196577+0000", 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196577+0000", 2024-09-20T21:01:45.229 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196577+0000", 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.2199999999999999e-07 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196616+0000", 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.8559999999999997e-05 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.230 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196625+0000", 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.9549999999999998e-06 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196631+0000", 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.8980000000000001e-06 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196700+0000", 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.9024999999999997e-05 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196726+0000", 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6305e-05 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49551 5.c e29/21 5:31048b5f:::benchmark_data_smithi112_23632_object49550:head v 29'3099, mlcod=29'3097)", 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.196647+0000", 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0035810199999999999, 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0042473650000000003, 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.232 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196647+0000", 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196647+0000", 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196648+0000", 2024-09-20T21:01:45.233 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.4700000000000002e-07 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196691+0000", 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.3371000000000002e-05 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196737+0000", 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.6159000000000003e-05 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.234 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196743+0000", 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.117e-06 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196805+0000", 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1148999999999993e-05 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196821+0000", 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6021000000000001e-05 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49553 5.f e29/21 5:f45fd0b7:::benchmark_data_smithi112_23632_object49552:head v 29'3118, mlcod=29'3114)", 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.196679+0000", 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0035491490000000001, 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0042801419999999998, 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196679+0000", 2024-09-20T21:01:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196679+0000", 2024-09-20T21:01:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196680+0000", 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3499999999999996e-07 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196761+0000", 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.1135000000000002e-05 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196778+0000", 2024-09-20T21:01:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6736999999999999e-05 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196784+0000", 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.5289999999999997e-06 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196833+0000", 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.8615999999999997e-05 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.196852+0000", 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9468999999999999e-05 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:49552 5.1 e29/21 5:823885f8:::benchmark_data_smithi112_23632_object49551:head v 29'3181, mlcod=29'3178)", 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:45.198264+0000", 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0019646099999999999, 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002751, 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198264+0000", 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198264+0000", 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198269+0000", 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.9309999999999999e-06 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198311+0000", 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.2756000000000002e-05 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198322+0000", 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0907000000000001e-05 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.242 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198329+0000", 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1330000000000004e-06 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198377+0000", 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.8371000000000002e-05 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:45.198399+0000", 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2158e-05 2024-09-20T21:01:45.243 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.244 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.244 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.244 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.244 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:01:45.244 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 11 2024-09-20T21:01:45.244 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:45.244 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 18 16 49651 49635 172.326 144.188 0.00961393 0.00579746 2024-09-20T21:01:45.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:45.247 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:45.246+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:45.288 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:01:45.348 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:45.345+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:45.390 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:45.390 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:01:45.390 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:01:45.390 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:01:45.390 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:45.409 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:45.453 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:45.453+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:45.549 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:45.549+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:45.605 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:45.605 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:01:45.606 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:01:45.606 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:45.606 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.606 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:45.606 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:45.606 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 43.640910435000002, 2024-09-20T21:01:45.606 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:01:45.607 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.607 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.607 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.607 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:45.607 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:45.607 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:45.607 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:01:45.607 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.608 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.608 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.608 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.608 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:45.608 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.608 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.608 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.608 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.609 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:45.609 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.609 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.609 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.609 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.610 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:01:45.610 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:01:45.610 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.610 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.610 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.610 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:01:45.610 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:01:45.610 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.611 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.611 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.611 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:01:45.611 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:01:45.611 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.611 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.611 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.611 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:01:45.612 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:01:45.612 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.612 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.612 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.612 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:01:45.613 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:01:45.613 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.613 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.613 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:01:45.613 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:01:45.613 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:01:45.613 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.613 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.614 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.614 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:01:45.614 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:01:45.614 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.614 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.614 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.614 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:01:45.615 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:01:45.615 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.615 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.615 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.615 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:01:45.615 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:01:45.615 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.616 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.616 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.616 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:01:45.616 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:01:45.616 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.616 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.616 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.616 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:01:45.617 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:01:45.617 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.617 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.617 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.617 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:01:45.617 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:01:45.617 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.617 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.618 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.618 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:01:45.618 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:01:45.618 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.618 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.618 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.618 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.619 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.619 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:45.619 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:45.619 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.635915660999999, 2024-09-20T21:01:45.619 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:01:45.619 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.619 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.619 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.620 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:45.620 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:45.620 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:45.620 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:01:45.620 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.620 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.620 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.620 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.621 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:45.621 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.621 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.621 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.621 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.621 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:45.622 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.622 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.622 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.622 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.623 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:01:45.623 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:01:45.623 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.623 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.623 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.623 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:01:45.623 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:01:45.624 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.624 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.624 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.624 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:01:45.624 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:01:45.624 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.624 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.624 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.625 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:01:45.625 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.626 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:01:45.627 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.628 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.407976265000002, 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.629 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.630 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.631 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.632 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.633 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.633 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:01:45.633 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:01:45.633 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.633 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.633 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.633 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:01:45.634 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:01:45.634 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.634 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.634 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.634 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:01:45.634 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:01:45.635 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.635 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.635 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.635 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:01:45.635 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:01:45.635 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.636 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.636 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.636 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.636 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.636 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.636 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:45.637 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.407829046000003, 2024-09-20T21:01:45.637 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:01:45.637 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.637 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.637 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.637 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.638 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.638 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.638 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:45.638 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.638 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.638 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.639 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.639 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:45.639 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.639 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.639 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.639 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.640 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:01:45.640 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:01:45.640 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.640 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.640 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.640 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:01:45.641 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:01:45.641 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.641 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.641 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.641 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:01:45.641 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:01:45.641 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.642 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.642 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.642 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:01:45.642 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:01:45.642 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.642 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.643 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.643 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:01:45.643 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:01:45.643 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.643 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.643 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.644 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:01:45.644 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:01:45.644 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.644 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.644 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.644 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:01:45.645 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:01:45.645 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.645 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.645 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.645 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:01:45.646 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:01:45.646 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.646 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.646 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.646 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:01:45.646 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:01:45.647 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.647 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.647 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.647 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:01:45.647 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:01:45.647 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.648 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.648 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.648 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:01:45.648 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:01:45.648 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.648 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.649 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.649 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.649 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.649 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.649 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:45.649 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.407703114, 2024-09-20T21:01:45.650 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:01:45.650 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.650 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.650 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.650 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.650 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.650 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.651 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:45.651 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.651 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.651 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.651 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.651 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:45.652 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.652 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.652 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.652 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.652 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:01:45.652 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:01:45.653 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.653 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.653 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.653 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:01:45.653 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:01:45.653 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.654 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.654 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.654 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:01:45.654 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:01:45.654 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.654 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.655 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.655 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:01:45.655 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:01:45.655 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.655 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.655 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.656 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:01:45.656 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:01:45.656 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.656 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.656 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.656 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:01:45.657 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:01:45.657 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.657 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.657 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.657 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:01:45.657 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:01:45.658 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.658 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.658 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.658 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:01:45.658 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:01:45.658 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.659 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.659 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.659 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:01:45.659 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:01:45.659 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.659 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.660 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.660 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:01:45.660 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:01:45.660 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.660 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.660 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.661 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:01:45.661 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:01:45.661 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.661 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.661 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.661 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.662 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.662 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.662 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:45.662 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.407618518, 2024-09-20T21:01:45.662 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:01:45.662 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.663 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.663 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.663 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.663 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.663 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.663 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:45.664 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.664 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.664 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.664 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.664 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:45.664 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.665 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.665 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.665 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.665 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:01:45.665 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:45.665 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.666 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.666 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.666 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:01:45.666 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:01:45.666 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.666 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.667 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.667 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:01:45.667 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:01:45.667 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.667 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.667 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.668 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:01:45.668 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:01:45.668 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.668 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.668 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.668 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:01:45.669 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:01:45.669 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.669 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.669 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.669 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:01:45.669 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:01:45.670 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.670 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.670 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.670 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:01:45.670 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:01:45.670 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.671 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.671 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.671 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:01:45.671 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:01:45.671 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.671 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.672 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.672 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:01:45.672 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:01:45.672 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.672 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.672 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.673 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:01:45.673 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:01:45.673 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.673 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.673 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.673 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:01:45.674 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:01:45.674 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.674 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.674 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.674 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.674 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.675 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.675 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:45.675 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.407300917000001, 2024-09-20T21:01:45.675 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:01:45.675 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.675 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.676 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.676 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.676 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.676 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.676 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:45.676 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.676 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.676 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:01:45.677 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:01:45.678 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:01:45.679 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.679 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.679 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.679 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:01:45.679 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:01:45.679 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.679 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.679 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.681 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:01:45.681 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:01:45.681 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.681 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.681 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:01:45.682 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.407199200999997, 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:01:45.683 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.684 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.685 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:01:45.686 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.687 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.688 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.407118605000001, 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:45.689 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.690 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.691 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.692 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.693 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.407041538999998, 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.694 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.695 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:01:45.696 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:01:45.697 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.698 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.406830071000002, 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:45.700 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:01:45.701 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.702 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.703 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.704 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.406754233999997, 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:01:45.705 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.706 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:01:45.707 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:01:45.708 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:01:45.709 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.710 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.406632172000002, 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:45.711 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.712 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.713 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.714 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.715 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.406563923, 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.716 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.717 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.718 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.719 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.720 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.721 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.406471136999997, 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.722 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.723 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:01:45.724 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:01:45.725 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.726 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.406409281000002, 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.727 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:01:45.728 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.729 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.730 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.731 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.732 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.406326905, 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.733 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.734 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.735 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.736 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.737 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.406242345000003, 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.738 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:01:45.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:01:45.742 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.406178439000001, 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:01:45.743 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.744 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:01:45.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:01:45.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 33.406115696000001, 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.749 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:01:45.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:01:45.751 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:45.752 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:45.753 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:45.754 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:45.755 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:45.750+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:45.854 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:45.850+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:45.909 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:45.909 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:45.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.909 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:51211 5.e 5:71f1c6c0:::benchmark_data_smithi112_23632_object51210:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-20T21:01:45.909 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:45.904767+0000", 2024-09-20T21:01:45.909 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.006439223, 2024-09-20T21:01:45.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0064593430000000002, 2024-09-20T21:01:45.909 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 51211 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904767+0000", 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904767+0000", 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904768+0000", 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904800+0000", 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2412000000000001e-05 2024-09-20T21:01:45.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904808+0000", 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8399999999999995e-06 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904813+0000", 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.609e-06 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904884+0000", 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0607999999999999e-05 2024-09-20T21:01:45.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.905011+0000", 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012721100000000001 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.905143+0000", 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013218099999999999 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:51213 5.4 5:2d6d5a57:::benchmark_data_smithi112_23632_object51212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:45.907055+0000", 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0041508049999999996, 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0042217490000000003, 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 51213 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:45.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907055+0000", 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907055+0000", 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907056+0000", 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.02e-07 2024-09-20T21:01:45.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907153+0000", 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6661000000000002e-05 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907163+0000", 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8879999999999992e-06 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907169+0000", 2024-09-20T21:01:45.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5599999999999999e-06 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.908386+0000", 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00121659 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.908521+0000", 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013539699999999999 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:45.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.908684+0000", 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016315500000000001 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:51216 5.4 5:23b35c2d:::benchmark_data_smithi112_23632_object51215:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:45.907235+0000", 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0039706180000000004, 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040827889999999999, 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:45.918 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 51216 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907235+0000", 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:45.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907235+0000", 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907236+0000", 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1699999999999998e-07 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907297+0000", 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1338000000000001e-05 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907307+0000", 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1800000000000002e-06 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907311+0000", 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9979999999999997e-06 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.910225+0000", 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029147359999999998 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.910319+0000", 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3350999999999994e-05 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.910401+0000", 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2781999999999994e-05 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.922 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:51217 5.f 5:f5ec0d74:::benchmark_data_smithi112_23632_object51216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:45.907753+0000", 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0034531869999999999, 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036383180000000002, 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 51217 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:45.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907753+0000", 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907753+0000", 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907754+0000", 2024-09-20T21:01:45.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.09e-07 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907813+0000", 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9172000000000002e-05 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907821+0000", 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6410000000000002e-06 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907824+0000", 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6430000000000001e-06 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907865+0000", 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0960000000000001e-05 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907951+0000", 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6131000000000006e-05 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.908037+0000", 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6044000000000005e-05 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:51218 5.8 5:16ba1efe:::benchmark_data_smithi112_23632_object51217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:45.909449+0000", 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0017575049999999999, 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020123089999999999, 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 51218 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.909449+0000", 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.909449+0000", 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.909450+0000", 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.569999999999999e-07 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.909518+0000", 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8046000000000005e-05 2024-09-20T21:01:45.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.909531+0000", 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3385e-05 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.909538+0000", 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3520000000000001e-06 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.909585+0000", 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6884e-05 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.909680+0000", 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4858999999999994e-05 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.909766+0000", 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6390999999999993e-05 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:45.931 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:51207 5.4 5:2d73c614:::benchmark_data_smithi112_23632_object51206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:45.904429+0000", 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0067767529999999999, 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0070872410000000002, 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 51207 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.932 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904429+0000", 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904429+0000", 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904430+0000", 2024-09-20T21:01:45.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2600000000000002e-07 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904523+0000", 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3251000000000006e-05 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904529+0000", 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.728e-06 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904533+0000", 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6959999999999998e-06 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904579+0000", 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6835000000000001e-05 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904707+0000", 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012726299999999999 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904835+0000", 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127952 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.910201+0000", 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.005366539 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:51208 5.9 5:989a7bfa:::benchmark_data_smithi112_23632_object51207:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-20T21:01:45.936 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:45.904543+0000", 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0066629560000000003, 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0070181210000000004, 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 51208 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904543+0000", 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904543+0000", 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904544+0000", 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5899999999999996e-07 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904611+0000", 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7083999999999997e-05 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904618+0000", 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1380000000000001e-06 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904624+0000", 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4130000000000003e-06 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.906480+0000", 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001856019 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.906636+0000", 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000155632 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.906789+0000", 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000152989 2024-09-20T21:01:45.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.909985+0000", 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0031957270000000002 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:51209 5.4 5:21b26ebe:::benchmark_data_smithi112_23632_object51208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:45.904650+0000", 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0065560699999999998, 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0069528690000000004, 2024-09-20T21:01:45.941 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 51209 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904650+0000", 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904650+0000", 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904651+0000", 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1200000000000003e-07 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904739+0000", 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8214000000000006e-05 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904749+0000", 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9329999999999996e-06 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.904756+0000", 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.092e-06 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.906764+0000", 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020084069999999998 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.906893+0000", 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012838199999999999 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:45.907033+0000", 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000140729 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:01:45.945 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 8 2024-09-20T21:01:45.946 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:45.947 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:45.955 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:45.953+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:46.056 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:46.053+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:46.105 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:46.105 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:01:46.105 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:01:46.105 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:01:46.105 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:46.125 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:46.156 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:46.154+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:46.240 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 19 15 51973 51958 170.896 145.188 0.00696373 0.00584702 2024-09-20T21:01:46.257 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:46.254+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:01:46.285 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:46.285 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:01:46.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 34.090026907000002, 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:01:46.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 34.089936870999999, 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.292 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:01:46.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:01:46.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:46.298 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 34.089850517999999, 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:01:46.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:01:46.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:01:46.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:46.306 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 34.089781709, 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:01:46.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.312 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 34.089748849000003, 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:01:46.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:01:46.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:01:46.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:46.319 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 34.089706831999997, 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:01:46.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:01:46.325 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 34.089581725999999, 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:01:46.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:01:46.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 34.089489377, 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:01:46.332 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:01:46.334 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:46.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 34.089405005000003, 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.337 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:01:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:46.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:2 5.8 5:124aadbb:::benchmark_data_smithi112_23632_object1:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 19.042980183000001, 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017726502000000002, 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.342 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 2 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.343 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243120+0000", 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3799999999999999e-06 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243306+0000", 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018621499999999999 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243327+0000", 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1036e-05 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243341+0000", 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.412e-05 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243477+0000", 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136286 2024-09-20T21:01:46.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243492+0000", 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5033e-05 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252641+0000", 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0091492480000000004 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.346 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252748+0000", 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106724 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252867+0000", 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011846899999999999 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255666+0000", 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002799368 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260766+0000", 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050996940000000001 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260809+0000", 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2972999999999997e-05 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260845+0000", 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5955999999999999e-05 2024-09-20T21:01:46.348 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:5 5.4 5:272d9688:::benchmark_data_smithi112_23632_object4:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 19.042513654, 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015407461000000001, 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.349 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 5 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243585+0000", 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.350 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243586+0000", 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0300000000000001e-06 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243695+0000", 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0001097 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243712+0000", 2024-09-20T21:01:46.351 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7073000000000001e-05 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243721+0000", 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9360000000000005e-06 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243834+0000", 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000112186 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:46.352 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243849+0000", 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5347000000000001e-05 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.251959+0000", 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0081103449999999997 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252062+0000", 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010262 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.353 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252178+0000", 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011608900000000001 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256938+0000", 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047595249999999997 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258912+0000", 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019745470000000001 2024-09-20T21:01:46.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258955+0000", 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2568000000000003e-05 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.258992+0000", 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7494999999999999e-05 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.355 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:7 5.4 5:2e77bfa8:::benchmark_data_smithi112_23632_object6:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 19.042352985000001, 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016326288000000001, 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 7 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.356 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243747+0000", 2024-09-20T21:01:46.357 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2300000000000001e-06 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243903+0000", 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015672599999999999 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243918+0000", 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4355999999999999e-05 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.358 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243927+0000", 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3340000000000008e-06 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244038+0000", 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110612 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244046+0000", 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9869999999999999e-06 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.359 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252713+0000", 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0086670889999999993 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253039+0000", 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032610099999999997 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253414+0000", 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037573700000000001 2024-09-20T21:01:46.360 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256958+0000", 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035431759999999999 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259926+0000", 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002968077 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260003+0000", 2024-09-20T21:01:46.361 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7208999999999999e-05 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260072+0000", 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8653999999999997e-05 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:14 5.0 5:04cc51db:::benchmark_data_smithi112_23632_object13:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 19.041640434000001, 2024-09-20T21:01:46.362 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017127937999999999, 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 14 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.363 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244459+0000", 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0699999999999999e-06 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244569+0000", 2024-09-20T21:01:46.364 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010965 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244594+0000", 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5066e-05 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244607+0000", 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3152999999999999e-05 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.365 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244663+0000", 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6360000000000002e-05 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244670+0000", 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8199999999999999e-06 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252692+0000", 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0080222069999999999 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.366 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252990+0000", 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000297788 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253360+0000", 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00036990699999999999 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255672+0000", 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023116529999999999 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.367 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261302+0000", 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0056302890000000001 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261450+0000", 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000148016 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261586+0000", 2024-09-20T21:01:46.368 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135959 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:15 5.4 5:26d45dc5:::benchmark_data_smithi112_23632_object14:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 19.041473645, 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015746412000000001, 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.369 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 15 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244625+0000", 2024-09-20T21:01:46.370 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244626+0000", 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1170000000000001e-06 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244735+0000", 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108902 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.371 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244767+0000", 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2767e-05 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244780+0000", 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2823000000000001e-05 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244832+0000", 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2102999999999999e-05 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.372 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244838+0000", 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2129999999999999e-06 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254299+0000", 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0094618670000000005 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.254554+0000", 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025405099999999998 2024-09-20T21:01:46.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255233+0000", 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000679852 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.257421+0000", 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00218761 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.374 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260171+0000", 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027496119999999998 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260302+0000", 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000131025 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260371+0000", 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9469999999999997e-05 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.375 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:157 5.4 5:2a681351:::benchmark_data_smithi112_23632_object156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 18.974257087000002, 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016166680999999999, 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.376 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 157 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311841+0000", 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.377 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311842+0000", 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2389999999999999e-06 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311879+0000", 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6520000000000003e-05 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311893+0000", 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3814e-05 2024-09-20T21:01:46.378 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311903+0000", 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7969999999999995e-06 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.311963+0000", 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0773999999999998e-05 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.379 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.312056+0000", 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2264999999999998e-05 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.312153+0000", 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7118000000000001e-05 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.317062+0000", 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0049092420000000003 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.380 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.327952+0000", 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010889708999999999 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.327985+0000", 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3519000000000002e-05 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.328008+0000", 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2684000000000002e-05 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.381 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16441 5.4 5:231ae493:::benchmark_data_smithi112_23632_object16440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 14.062494834000001, 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018694967999999999, 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16441 2024-09-20T21:01:46.382 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.383 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223604+0000", 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0020000000000001e-06 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223754+0000", 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014907899999999999 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5207e-05 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.384 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223787+0000", 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8685000000000002e-05 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223852+0000", 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5012999999999996e-05 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017955400000000001 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.385 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224223+0000", 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000191428 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225787+0000", 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001563617 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242143+0000", 2024-09-20T21:01:46.386 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01635615 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242235+0000", 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2250000000000006e-05 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242298+0000", 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2983000000000003e-05 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.387 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16442 5.0 5:07f91168:::benchmark_data_smithi112_23632_object16441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 14.062290021000001, 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018432022999999999, 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16442 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.388 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223809+0000", 2024-09-20T21:01:46.389 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223867+0000", 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8365000000000001e-05 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223878+0000", 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.058e-05 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.390 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223886+0000", 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6490000000000008e-06 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223943+0000", 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6879000000000002e-05 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224078+0000", 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135549 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.391 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224243+0000", 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016484900000000001 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226958+0000", 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027148490000000001 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242135+0000", 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015176858 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.392 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242185+0000", 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0254999999999999e-05 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242240+0000", 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.541e-05 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.393 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16446 5.0 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 14.062118701999999, 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018538079999999998, 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16446 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.394 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5799999999999999e-07 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.395 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224021+0000", 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1053000000000001e-05 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.111e-05 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224040+0000", 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5480000000000004e-06 2024-09-20T21:01:46.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225554+0000", 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001513749 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225818+0000", 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026389300000000002 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226084+0000", 2024-09-20T21:01:46.397 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026617999999999998 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.227457+0000", 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013727030000000001 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242319+0000", 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014862492 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.398 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242426+0000", 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107291 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242518+0000", 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1403000000000006e-05 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:38547 5.8 5:139337cc:::benchmark_data_smithi112_23632_object38546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-20T21:01:46.399 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:40.587197+0000", 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.6989016990000003, 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015489167, 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 38547 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.400 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587197+0000", 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587197+0000", 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587197+0000", 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7299999999999996e-07 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.401 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587231+0000", 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3717999999999998e-05 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587238+0000", 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4580000000000004e-06 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.587247+0000", 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5520000000000005e-06 2024-09-20T21:01:46.402 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.590373+0000", 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0031263530000000001 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.590473+0000", 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9270000000000003e-05 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.590614+0000", 2024-09-20T21:01:46.403 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014140600000000001 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.598316+0000", 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.007702141 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.602580+0000", 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0042641069999999996 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.404 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.602639+0000", 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8891000000000002e-05 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:40.602686+0000", 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6697999999999999e-05 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:51990 5.8 5:1aef5be4:::benchmark_data_smithi112_23632_object51989:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-20T21:01:46.405 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:46.249478+0000", 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.036620623999999997, 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017511240000000001, 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 51990 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:46.406 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249478+0000", 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249478+0000", 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249479+0000", 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9199999999999999e-07 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249546+0000", 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7879000000000005e-05 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249557+0000", 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.013e-05 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249563+0000", 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6250000000000001e-06 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.255959+0000", 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0063956550000000001 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.256083+0000", 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000124394 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.256208+0000", 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012492100000000001 2024-09-20T21:01:46.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.257677+0000", 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001469028 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.266876+0000", 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0091992410000000004 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:46.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.266950+0000", 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4023000000000006e-05 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.266989+0000", 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8451999999999997e-05 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:46.411 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:46.413 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:46.412+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:46.413 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:46.513 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:46.512+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:46.571 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:46.571 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:46.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.571 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52685 5.2 5:410d4263:::benchmark_data_smithi112_23632_object52684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.571 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.566191+0000", 2024-09-20T21:01:46.571 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0038755220000000002, 2024-09-20T21:01:46.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039008929999999999, 2024-09-20T21:01:46.571 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.571 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52685 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566191+0000", 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566191+0000", 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566192+0000", 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7400000000000003e-07 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566388+0000", 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019656 2024-09-20T21:01:46.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566398+0000", 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3540000000000006e-06 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566405+0000", 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0160000000000003e-06 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566500+0000", 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5348999999999998e-05 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566641+0000", 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140495 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566799+0000", 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015816800000000001 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569224+0000", 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002425544 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52686 5.3 5:c67257e6:::benchmark_data_smithi112_23632_object52685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.566646+0000", 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0034205559999999999, 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035547489999999998, 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.576 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52686 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566646+0000", 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566646+0000", 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566647+0000", 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0299999999999998e-07 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566685+0000", 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8102999999999998e-05 2024-09-20T21:01:46.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566697+0000", 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.163e-05 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566704+0000", 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566765+0000", 2024-09-20T21:01:46.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1187999999999998e-05 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566880+0000", 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114578 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.567018+0000", 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013839599999999999 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:46.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570186+0000", 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031674369999999999 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52687 5.3 5:cd5743c2:::benchmark_data_smithi112_23632_object52686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.566735+0000", 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0033312960000000001, 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003631801, 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:46.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52687 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566735+0000", 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566735+0000", 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566736+0000", 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9400000000000005e-07 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566777+0000", 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0927000000000003e-05 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566785+0000", 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2309999999999996e-06 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.566791+0000", 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9819999999999996e-06 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.568621+0000", 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001829336 2024-09-20T21:01:46.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.568751+0000", 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000130164 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.568901+0000", 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014987099999999999 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:52688 5.e e30/21 5:71a335d9:::benchmark_data_smithi112_23632_object52687:head v 30'3327, mlcod=30'3324)", 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.567322+0000", 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0027447079999999998, 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031249189999999999, 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.567322+0000", 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.567322+0000", 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.567323+0000", 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5899999999999996e-07 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.567387+0000", 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.478e-05 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.567400+0000", 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2601e-05 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.567406+0000", 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0820000000000004e-06 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.567459+0000", 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2484000000000001e-05 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.567480+0000", 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1775000000000001e-05 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:52689 5.e e30/21 5:771cb78d:::benchmark_data_smithi112_23632_object52688:head v 30'3328, mlcod=30'3324)", 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.568656+0000", 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001410747, 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0018503149999999999, 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.568656+0000", 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.568656+0000", 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.568657+0000", 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8899999999999999e-07 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.568704+0000", 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7737000000000001e-05 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.568713+0000", 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.568717+0000", 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5410000000000002e-06 2024-09-20T21:01:46.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569329+0000", 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000611544 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569348+0000", 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.98e-05 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52691 5.3 5.bf67e6f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.569344+0000", 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00072230500000000002, 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011948410000000001, 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52691 2024-09-20T21:01:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569344+0000", 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569344+0000", 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569345+0000", 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0130000000000001e-06 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569434+0000", 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8147999999999997e-05 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569440+0000", 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5590000000000002e-06 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569446+0000", 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0589999999999999e-06 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52692 5.6 5:6b69376e:::benchmark_data_smithi112_23632_object52691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.569784+0000", 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000282897, 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00078712699999999999, 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.597 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52692 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569784+0000", 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569784+0000", 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569785+0000", 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5199999999999996e-07 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569825+0000", 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0416000000000001e-05 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569835+0000", 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7499999999999998e-06 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569841+0000", 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9649999999999996e-06 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569889+0000", 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8007000000000003e-05 2024-09-20T21:01:46.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570001+0000", 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011231900000000001 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570098+0000", 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6445000000000002e-05 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52673 5.3 5:ce1b22ff:::benchmark_data_smithi112_23632_object52672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.557969+0000", 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.012097838, 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012652135, 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52673 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.602 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.557969+0000", 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.557969+0000", 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.557970+0000", 2024-09-20T21:01:46.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.44e-07 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.557997+0000", 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7770999999999999e-05 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.558016+0000", 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8643000000000001e-05 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.558023+0000", 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.764e-06 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.559797+0000", 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0017744130000000001 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.559927+0000", 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012961400000000001 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.560033+0000", 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106545 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.564601+0000", 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0045677249999999999 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52693 5.6 5.64db2616 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.569853+0000", 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00021363799999999999, 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00081187499999999999, 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52693 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569853+0000", 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569853+0000", 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569854+0000", 2024-09-20T21:01:46.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0100000000000005e-07 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569880+0000", 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6710999999999999e-05 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569888+0000", 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.187e-06 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569893+0000", 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5589999999999996e-06 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52694 5.5 5:ade3dd4f:::benchmark_data_smithi112_23632_object52693:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.569946+0000", 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000120505, 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00075074799999999998, 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.610 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52694 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569946+0000", 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569946+0000", 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.569947+0000", 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1799999999999995e-07 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570014+0000", 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6660000000000002e-05 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570025+0000", 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1371e-05 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570033+0000", 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5939999999999996e-06 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570079+0000", 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6354999999999999e-05 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570203+0000", 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012384700000000001 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570336+0000", 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133077 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:52690 5.e e30/21 5:718eff2e:::benchmark_data_smithi112_23632_object52689:head v 30'3329, mlcod=30'3325)", 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.570160+0000", 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.999907, 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00060147200000000003, 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570160+0000", 2024-09-20T21:01:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570160+0000", 2024-09-20T21:01:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570160+0000", 2024-09-20T21:01:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8400000000000004e-07 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570210+0000", 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9792e-05 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570218+0000", 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0989999999999999e-06 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570224+0000", 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4430000000000002e-06 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570743+0000", 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00051903400000000003 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570760+0000", 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7572999999999999e-05 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.618 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:52683 5.6 e30/21)", 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.570270+0000", 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9997973, 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00054451, 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570270+0000", 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570270+0000", 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570270+0000", 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4799999999999999e-07 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570273+0000", 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570282+0000", 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7610000000000002e-06 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570288+0000", 2024-09-20T21:01:46.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1630000000000004e-06 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52696 5.5 5.72754e55 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.570366+0000", 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.999701, 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00051111199999999998, 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.622 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52696 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570366+0000", 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570366+0000", 2024-09-20T21:01:46.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570367+0000", 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2699999999999999e-07 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570404+0000", 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7079000000000002e-05 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570416+0000", 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2693e-05 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570423+0000", 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6059999999999999e-06 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52697 5.7 5:e4370a4f:::benchmark_data_smithi112_23632_object52696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.625 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.570434+0000", 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9996324, 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049704000000000003, 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52697 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570434+0000", 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570434+0000", 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570435+0000", 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1699999999999998e-07 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570463+0000", 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8520000000000001e-05 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570473+0000", 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3510000000000008e-06 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570478+0000", 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6799999999999998e-06 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570535+0000", 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6116000000000003e-05 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570632+0000", 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7658000000000006e-05 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570703+0000", 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0424000000000002e-05 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:52673 5.3 e30/21)", 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.570807+0000", 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9992595, 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019080599999999999, 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.630 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570807+0000", 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570807+0000", 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570808+0000", 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0499999999999999e-07 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570813+0000", 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9989999999999999e-06 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570822+0000", 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7299999999999994e-06 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570828+0000", 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7100000000000001e-06 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:52686 5.3 e30/21)", 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.570845+0000", 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9992213, 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000193539, 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.633 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570845+0000", 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570845+0000", 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570846+0000", 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4900000000000002e-07 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570848+0000", 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2570000000000002e-06 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570854+0000", 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5050000000000004e-06 2024-09-20T21:01:46.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570859+0000", 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52698 5.6 5.fd5057b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.570777+0000", 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.99929, 2024-09-20T21:01:46.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000303868, 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52698 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570777+0000", 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570777+0000", 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570778+0000", 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7599999999999996e-07 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570886+0000", 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108553 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570894+0000", 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2810000000000008e-06 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.570900+0000", 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.908e-06 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52683 5.6 5:6eea4cf0:::benchmark_data_smithi112_23632_object52682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.564977+0000", 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0050898829999999999, 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061564580000000001, 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52683 2024-09-20T21:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.564977+0000", 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.564977+0000", 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.564978+0000", 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.353e-06 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.565136+0000", 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000158049 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.565146+0000", 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0122999999999999e-05 2024-09-20T21:01:46.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.565153+0000", 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7299999999999999e-06 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.565194+0000", 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0429999999999997e-05 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.565276+0000", 2024-09-20T21:01:46.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2058000000000006e-05 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.565355+0000", 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9710999999999996e-05 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.567253+0000", 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001897209 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.644 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:46.645 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:01:46.645 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 18 2024-09-20T21:01:46.645 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:46.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:46.647 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:46.645+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:46.746 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:46.744+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:46.799 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:46.799 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:01:46.799 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:01:46.799 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:01:46.799 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:46.821 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:46.831 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:01:46.848 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:46.848+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:46.860 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T21:01:46.860 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:01:46.861 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-20T21:01:46.861 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T21:01:46.861 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T21:01:46.861 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-20T21:01:46.948 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:46.948+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:46.997 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:46.997 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:46.998 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:46.998 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:01:46.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:01:46.998 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:46.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.998 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.799331932000001, 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:46.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:01:47.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:01:47.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.004 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.799197733, 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:01:47.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:01:47.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.799092727000001, 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:01:47.011 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:01:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:01:47.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.017 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.798973201999999, 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:01:47.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.798903195000001, 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:01:47.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:01:47.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:47.030 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.798828143000001, 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:01:47.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:01:47.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.798741116999999, 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:01:47.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.798672344000003, 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:01:47.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.798586084999997, 2024-09-20T21:01:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:01:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:01:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16445 5.2 5:4d443432:::benchmark_data_smithi112_23632_object16444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.771231652000001, 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01791187, 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:47.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16445 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:47.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222333+0000", 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0699999999999996e-07 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222428+0000", 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5198000000000006e-05 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222438+0000", 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6889999999999999e-06 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222481+0000", 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3157e-05 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222551+0000", 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9915999999999999e-05 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222632+0000", 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1650999999999995e-05 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222733+0000", 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100153 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227624+0000", 2024-09-20T21:01:47.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048913309999999996 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240156+0000", 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012531927 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240205+0000", 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9363999999999997e-05 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240244+0000", 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8577e-05 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16448 5.3 5:ceed33ed:::benchmark_data_smithi112_23632_object16447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.77099413, 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017689621999999999, 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.057 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16448 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222570+0000", 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222617+0000", 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6493999999999999e-05 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222626+0000", 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5959999999999993e-06 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222633+0000", 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222677+0000", 2024-09-20T21:01:47.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4029000000000001e-05 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222798+0000", 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000120586 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222928+0000", 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013065400000000001 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227036+0000", 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0041077190000000001 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240183+0000", 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013146817999999999 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240229+0000", 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6619999999999997e-05 2024-09-20T21:01:47.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240259+0000", 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9791e-05 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16451 5.1 5:80cd9f79:::benchmark_data_smithi112_23632_object16450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.77085303, 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017604979, 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.063 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16451 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:47.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.13e-07 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222743+0000", 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2079000000000002e-05 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222752+0000", 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9369999999999993e-06 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222758+0000", 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7320000000000003e-06 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222814+0000", 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6450000000000003e-05 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222950+0000", 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013559600000000001 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223083+0000", 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132676 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227057+0000", 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039746499999999997 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240270+0000", 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013212911000000001 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240294+0000", 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4261e-05 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240316+0000", 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1073999999999998e-05 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16441 5.4 e25/21 5:231ae493:::benchmark_data_smithi112_23632_object16440:head v 25'1007, mlcod=25'1005)", 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.769986397, 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016533478000000001, 2024-09-20T21:01:47.069 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223577+0000", 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223578+0000", 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7800000000000001e-07 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223630+0000", 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2011000000000001e-05 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223639+0000", 2024-09-20T21:01:47.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4919999999999999e-06 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223646+0000", 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3069999999999999e-06 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223697+0000", 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0822999999999998e-05 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223710+0000", 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3002e-05 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240081+0000", 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016371753999999999 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240111+0000", 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9311000000000001e-05 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.073 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16442 5.0 e25/21 5:07f91168:::benchmark_data_smithi112_23632_object16441:head v 25'1017, mlcod=25'1015)", 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.76989996, 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016425138999999998, 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223664+0000", 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9200000000000002e-07 2024-09-20T21:01:47.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223700+0000", 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5911999999999998e-05 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223705+0000", 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5990000000000001e-06 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223709+0000", 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8060000000000001e-06 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9803000000000003e-05 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223788+0000", 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8838000000000002e-05 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240052+0000", 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016264361000000001 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240089+0000", 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6528e-05 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16452 5.1 5:835745ce:::benchmark_data_smithi112_23632_object16451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:47.078 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.769824671, 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016631607999999999, 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16452 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223739+0000", 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223740+0000", 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7899999999999997e-07 2024-09-20T21:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223780+0000", 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9892999999999999e-05 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223790+0000", 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0708e-05 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223798+0000", 2024-09-20T21:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0860000000000002e-06 2024-09-20T21:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223929+0000", 2024-09-20T21:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013030299999999999 2024-09-20T21:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224044+0000", 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114875 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224173+0000", 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012932800000000001 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227092+0000", 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029195739999999999 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240319+0000", 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013226813 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240353+0000", 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3686000000000002e-05 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240371+0000", 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7563000000000001e-05 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:16446 5.0 e25/21 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head v 25'1018, mlcod=25'1015)", 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.769091422000001, 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015653869000000001, 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.085 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224472+0000", 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224473+0000", 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5300000000000004e-07 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224536+0000", 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3554999999999997e-05 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224544+0000", 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3200000000000002e-06 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224548+0000", 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7350000000000004e-06 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224582+0000", 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3303999999999998e-05 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224595+0000", 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3199e-05 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240095+0000", 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015500323999999999 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240126+0000", 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0778999999999998e-05 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16454 5.a 5:5e808c04:::benchmark_data_smithi112_23632_object16453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:47.089 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.768971572, 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016518115999999999, 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16454 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.090 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224592+0000", 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224593+0000", 2024-09-20T21:01:47.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2999999999999999e-07 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224635+0000", 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1711000000000001e-05 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224646+0000", 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1015999999999999e-05 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224653+0000", 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449999999999998e-06 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224714+0000", 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0835000000000003e-05 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224838+0000", 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124053 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.224978+0000", 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014017200000000001 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240105+0000", 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015127148999999999 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241034+0000", 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00092821600000000005 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241065+0000", 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1149999999999998e-05 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.241110+0000", 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5439000000000003e-05 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52673 5.3 5:ce1b22ff:::benchmark_data_smithi112_23632_object52672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.557969+0000", 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.43559467299999999, 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016452259, 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52673 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.557969+0000", 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.557969+0000", 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.557970+0000", 2024-09-20T21:01:47.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.44e-07 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.557997+0000", 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7770999999999999e-05 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.558016+0000", 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8643000000000001e-05 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.558023+0000", 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.764e-06 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.559797+0000", 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0017744130000000001 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.559927+0000", 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012961400000000001 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.560033+0000", 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106545 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.564601+0000", 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0045677249999999999 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.574263+0000", 2024-09-20T21:01:47.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.009661467 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.574374+0000", 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011167000000000001 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.574421+0000", 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7002999999999997e-05 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.101 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:52947 5.3 5:c064326e:::benchmark_data_smithi112_23632_object52946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.684717+0000", 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.30884674899999998, 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016544069000000002, 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:47.102 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 52947 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.684717+0000", 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.684717+0000", 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.684718+0000", 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2800000000000005e-07 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.684835+0000", 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011733100000000001 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.684846+0000", 2024-09-20T21:01:47.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0710000000000001e-05 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.684853+0000", 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2099999999999996e-06 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.688811+0000", 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039578119999999998 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.689075+0000", 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026437900000000002 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.689199+0000", 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124053 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.693009+0000", 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038098720000000002 2024-09-20T21:01:47.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.701158+0000", 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0081485080000000005 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.701211+0000", 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3041999999999998e-05 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.701261+0000", 2024-09-20T21:01:47.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0223999999999999e-05 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:53373 5.6 5:698192c8:::benchmark_data_smithi112_23632_object53372:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.894522+0000", 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.099041891000000007, 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016033308, 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:47.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 53373 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.894522+0000", 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.894522+0000", 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.894522+0000", 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4099999999999998e-07 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.894550+0000", 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7929999999999999e-05 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.894558+0000", 2024-09-20T21:01:47.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8320000000000006e-06 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.894566+0000", 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.627e-06 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.900497+0000", 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059308779999999997 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.900614+0000", 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117614 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.900698+0000", 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3932999999999998e-05 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:47.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.906742+0000", 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060439220000000002 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.910467+0000", 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003725332 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.910518+0000", 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0192000000000003e-05 2024-09-20T21:01:47.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:47.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:47.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:47.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.910555+0000", 2024-09-20T21:01:47.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7407000000000003e-05 2024-09-20T21:01:47.114 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.114 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.114 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.114 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:47.114 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:47.114 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:47.115 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:47.116 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:47.116 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:47.117 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:47.119 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:47.119 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-20T21:01:47.119 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:47.119 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:47.114+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:47.120 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:47.217 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:47.217+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:47.240 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:2024-09-20T21:01:47.244016+0000 min lat: 0.00142862 max lat: 0.0745779 avg lat: 0.00591352 2024-09-20T21:01:47.241 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-20T21:01:47.241 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 20 16 54093 54077 168.973 132.438 0.00865132 0.00591352 2024-09-20T21:01:47.274 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:47.274 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:47.295 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:47.337 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:47.337+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:47.418 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:47.416+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:47.482 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:47.482 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:47.504 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:47.519 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:47.518+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:47.620 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:47.618+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:47.653 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:47.653 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:47.672 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:47.721 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:47.721+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:47.821 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:47.821 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:47.822 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:47.821+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:47.842 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:47.922 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:47.920+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:47.991 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:47.992 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:48.010 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:48.023 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:48.022+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:48.125 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:48.124+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:48.204 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:48.204 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:48.225 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:48.241 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 21 16 56341 56325 167.616 140.5 0.0061857 0.00596043 2024-09-20T21:01:48.272 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:48.272+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:48.327 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:48.324+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:48.375 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:48.376 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:48.396 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:48.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:01:48.428 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:48.428+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:48.529 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:48.528+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:48.555 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:48.555 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:48.574 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:48.629 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:48.628+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:48.729 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:48.729 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:48.730 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:48.729+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:48.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:48.831 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:48.828+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:48.902 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:48.903 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:48.923 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:48.932 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:48.930+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:49.032 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:49.030+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:49.069 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:49.069 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:49.089 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:49.120 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:01:49.134 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:49.132+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:49.234 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:49.233+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:49.236 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:49.236 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:49.241 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 22 16 58469 58453 166.042 133 0.0077643 0.00601794 2024-09-20T21:01:49.257 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:49.278 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:49.293 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:01:49.298 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:49.298 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:49.317 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:49.317 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:49.335 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:49.332+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:49.412 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:49.412 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:49.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.412 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:58823 5.b 5:d0e6a0fe:::benchmark_data_smithi112_23632_object58822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:49.412 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.407720+0000", 2024-09-20T21:01:49.412 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.005837961, 2024-09-20T21:01:49.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0058680299999999998, 2024-09-20T21:01:49.412 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.412 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 58823 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.407720+0000", 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.407720+0000", 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.407722+0000", 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2589999999999999e-06 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.407760+0000", 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8844999999999998e-05 2024-09-20T21:01:49.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.415 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.407783+0000", 2024-09-20T21:01:49.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.3101000000000001e-05 2024-09-20T21:01:49.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.415 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.407795+0000", 2024-09-20T21:01:49.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.118e-05 2024-09-20T21:01:49.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408760+0000", 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00096512400000000004 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408882+0000", 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000122717 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.409064+0000", 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018179399999999999 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:58825 5.4 5:20619088:::benchmark_data_smithi112_23632_object58824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.408550+0000", 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0050077289999999998, 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0051211130000000001, 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.417 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 58825 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408550+0000", 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408550+0000", 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408551+0000", 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8999999999999995e-07 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408607+0000", 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5753e-05 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.419 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408618+0000", 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0584000000000001e-05 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408624+0000", 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0909999999999998e-06 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408664+0000", 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0436999999999999e-05 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408777+0000", 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113173 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.408874+0000", 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6898000000000006e-05 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:58829 5.b 5:ddd63fd8:::benchmark_data_smithi112_23632_object58828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:49.421 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.409644+0000", 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0039145719999999998, 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0041022369999999999, 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 58829 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.409644+0000", 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.409644+0000", 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.409645+0000", 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.034e-06 2024-09-20T21:01:49.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.409693+0000", 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8466e-05 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.409708+0000", 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4395e-05 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.424 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.409716+0000", 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410983+0000", 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001267373 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411121+0000", 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000137651 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411320+0000", 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00019943000000000001 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:58830 5.b 5:dccb8534:::benchmark_data_smithi112_23632_object58829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.410090+0000", 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0034681080000000001, 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0037292660000000002, 2024-09-20T21:01:49.426 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 58830 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410090+0000", 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410090+0000", 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410091+0000", 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2699999999999998e-07 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410127+0000", 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410141+0000", 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4493e-05 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410149+0000", 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8310000000000001e-06 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413049+0000", 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0028996740000000001 2024-09-20T21:01:49.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413521+0000", 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00047195100000000002 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413695+0000", 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017440399999999999 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.430 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:58831 5.e 5:7c2de8b6:::benchmark_data_smithi112_23632_object58830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.410306+0000", 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0032521719999999998, 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035866940000000001, 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.431 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 58831 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410306+0000", 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410306+0000", 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410307+0000", 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410414+0000", 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106791 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410425+0000", 2024-09-20T21:01:49.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1661999999999999e-05 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410433+0000", 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7619999999999995e-06 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410482+0000", 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8463e-05 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410578+0000", 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6779000000000003e-05 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.410656+0000", 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7373000000000006e-05 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:58833 5.8 5:1f1dd6b8:::benchmark_data_smithi112_23632_object58832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.411102+0000", 2024-09-20T21:01:49.435 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0024562099999999999, 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0028661390000000002, 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 58833 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411102+0000", 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411102+0000", 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411103+0000", 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.006e-06 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411189+0000", 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5623000000000003e-05 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411201+0000", 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.217e-05 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411209+0000", 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0749999999999998e-06 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411263+0000", 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3915000000000001e-05 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411405+0000", 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014239999999999999 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411537+0000", 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000131388 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:58835 5.f 5:f3aa96df:::benchmark_data_smithi112_23632_object58834:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.411691+0000", 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0018667449999999999, 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023598030000000002, 2024-09-20T21:01:49.440 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 58835 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411691+0000", 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.442 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.442 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411691+0000", 2024-09-20T21:01:49.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.442 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.442 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411692+0000", 2024-09-20T21:01:49.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8000000000000004e-07 2024-09-20T21:01:49.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411755+0000", 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2998999999999998e-05 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411798+0000", 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2509999999999998e-05 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411807+0000", 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8289999999999997e-06 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411858+0000", 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1725999999999999e-05 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411983+0000", 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012436700000000001 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.412110+0000", 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012730099999999999 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:58836 5.4 5:2673905e:::benchmark_data_smithi112_23632_object58835:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.411825+0000", 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0017329349999999999, 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023064700000000001, 2024-09-20T21:01:49.445 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 58836 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411825+0000", 2024-09-20T21:01:49.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411825+0000", 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411826+0000", 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8100000000000002e-07 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411862+0000", 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6018e-05 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411874+0000", 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1851000000000001e-05 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411881+0000", 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0659999999999998e-06 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411933+0000", 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1946e-05 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.412064+0000", 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000131261 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.412190+0000", 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000125587 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.449 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:58825 5.4 e31/21)", 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.411319+0000", 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0022395620000000001, 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0028846140000000002, 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411319+0000", 2024-09-20T21:01:49.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411319+0000", 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411320+0000", 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6700000000000002e-07 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.411324+0000", 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1829999999999996e-06 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413026+0000", 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001702456 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413034+0000", 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2230000000000007e-06 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.453 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:58823 5.b e31/21)", 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.413067+0000", 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000490903, 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0011803639999999999, 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413067+0000", 2024-09-20T21:01:49.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413067+0000", 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413068+0000", 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6599999999999996e-07 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413077+0000", 2024-09-20T21:01:49.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3430000000000002e-06 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413089+0000", 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1798e-05 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413095+0000", 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4099999999999996e-06 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:58832 5.a e31/21 5:5058f4d6:::benchmark_data_smithi112_23632_object58831:head v 31'3645, mlcod=31'3643)", 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:49.413111+0000", 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00044686699999999999, 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0011860499999999999, 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413111+0000", 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413111+0000", 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413112+0000", 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.0699999999999998e-07 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413144+0000", 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2792e-05 2024-09-20T21:01:49.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413152+0000", 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.926e-06 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413159+0000", 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.392e-06 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413206+0000", 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7672e-05 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:49.413230+0000", 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.3515000000000001e-05 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:01:49.461 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 11 2024-09-20T21:01:49.461 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:49.462 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:49.463 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:49.458+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:49.563 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:49.561+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:49.659 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:49.659 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:01:49.659 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:01:49.659 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:01:49.660 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:49.664 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:49.661+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:49.680 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:49.765 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:49.762+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:49.839 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:49.839 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:01:49.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:01:49.839 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:49.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.839 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:49.839 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:49.839 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.643502382999998, 2024-09-20T21:01:49.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:01:49.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:01:49.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.845 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.643412347000002, 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:49.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:49.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:01:49.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:01:49.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.643325994000001, 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:49.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:01:49.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:01:49.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:01:49.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:01:49.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:01:49.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:01:49.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:01:49.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.859 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.643257185000003, 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:01:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:01:49.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.643224324999998, 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.866 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:01:49.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:01:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:01:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:01:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:01:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.643182308, 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.873 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:01:49.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:01:49.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:01:49.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:01:49.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.643057202000001, 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.880 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:01:49.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:49.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.642964853000002, 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:49.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:01:49.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:01:49.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:49.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:01:49.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:01:49.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.642880480999999, 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:01:49.892 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:01:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:2 5.8 5:124aadbb:::benchmark_data_smithi112_23632_object1:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:49.897 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.596455659, 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017726502000000002, 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 2 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:49.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243118+0000", 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243120+0000", 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3799999999999999e-06 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243306+0000", 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018621499999999999 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243327+0000", 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1036e-05 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243341+0000", 2024-09-20T21:01:49.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.412e-05 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243477+0000", 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136286 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243492+0000", 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5033e-05 2024-09-20T21:01:49.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252641+0000", 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0091492480000000004 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252748+0000", 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106724 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252867+0000", 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011846899999999999 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255666+0000", 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002799368 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260766+0000", 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050996940000000001 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260809+0000", 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2972999999999997e-05 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260845+0000", 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5955999999999999e-05 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:7 5.4 5:2e77bfa8:::benchmark_data_smithi112_23632_object6:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.595828461, 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016326288000000001, 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 7 2024-09-20T21:01:49.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243745+0000", 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243747+0000", 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2300000000000001e-06 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243903+0000", 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015672599999999999 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243918+0000", 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4355999999999999e-05 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.243927+0000", 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3340000000000008e-06 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244038+0000", 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110612 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244046+0000", 2024-09-20T21:01:49.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9869999999999999e-06 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252713+0000", 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0086670889999999993 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253039+0000", 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032610099999999997 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253414+0000", 2024-09-20T21:01:49.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037573700000000001 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.256958+0000", 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035431759999999999 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.259926+0000", 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002968077 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260003+0000", 2024-09-20T21:01:49.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7208999999999999e-05 2024-09-20T21:01:49.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.260072+0000", 2024-09-20T21:01:49.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8653999999999997e-05 2024-09-20T21:01:49.911 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:14 5.0 5:04cc51db:::benchmark_data_smithi112_23632_object13:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.595115910000001, 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017127937999999999, 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.912 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 14 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244458+0000", 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244459+0000", 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0699999999999999e-06 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244569+0000", 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010965 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244594+0000", 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5066e-05 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244607+0000", 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3152999999999999e-05 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244663+0000", 2024-09-20T21:01:49.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6360000000000002e-05 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.244670+0000", 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8199999999999999e-06 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252692+0000", 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0080222069999999999 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.252990+0000", 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000297788 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.253360+0000", 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00036990699999999999 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.255672+0000", 2024-09-20T21:01:49.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023116529999999999 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261302+0000", 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0056302890000000001 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261450+0000", 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000148016 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:27.261586+0000", 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135959 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16441 5.4 5:231ae493:::benchmark_data_smithi112_23632_object16440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 17.615970310000002, 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018694967999999999, 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.919 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16441 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223604+0000", 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0020000000000001e-06 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223754+0000", 2024-09-20T21:01:49.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014907899999999999 2024-09-20T21:01:49.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:49.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5207e-05 2024-09-20T21:01:49.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223787+0000", 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8685000000000002e-05 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223852+0000", 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5012999999999996e-05 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017955400000000001 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224223+0000", 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000191428 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225787+0000", 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001563617 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242143+0000", 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01635615 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242235+0000", 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2250000000000006e-05 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242298+0000", 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2983000000000003e-05 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.925 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16442 5.0 5:07f91168:::benchmark_data_smithi112_23632_object16441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 17.615765497000002, 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018432022999999999, 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.926 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16442 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223809+0000", 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223867+0000", 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8365000000000001e-05 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223878+0000", 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.058e-05 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223886+0000", 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6490000000000008e-06 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223943+0000", 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6879000000000002e-05 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224078+0000", 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135549 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224243+0000", 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016484900000000001 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226958+0000", 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027148490000000001 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242135+0000", 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015176858 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242185+0000", 2024-09-20T21:01:49.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0254999999999999e-05 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242240+0000", 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.541e-05 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.932 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16446 5.0 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 17.615594177999998, 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018538079999999998, 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16446 2024-09-20T21:01:49.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5799999999999999e-07 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224021+0000", 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1053000000000001e-05 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.111e-05 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224040+0000", 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5480000000000004e-06 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225554+0000", 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001513749 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225818+0000", 2024-09-20T21:01:49.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026389300000000002 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226084+0000", 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026617999999999998 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.227457+0000", 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013727030000000001 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242319+0000", 2024-09-20T21:01:49.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014862492 2024-09-20T21:01:49.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242426+0000", 2024-09-20T21:01:49.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107291 2024-09-20T21:01:49.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242518+0000", 2024-09-20T21:01:49.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1403000000000006e-05 2024-09-20T21:01:49.939 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.939 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.939 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.940 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:51990 5.8 5:1aef5be4:::benchmark_data_smithi112_23632_object51989:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-20T21:01:49.940 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:46.249478+0000", 2024-09-20T21:01:49.940 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 3.5900961000000002, 2024-09-20T21:01:49.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017511240000000001, 2024-09-20T21:01:49.940 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.940 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.940 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.941 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.941 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.941 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.942 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 51990 2024-09-20T21:01:49.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.943 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249478+0000", 2024-09-20T21:01:49.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249478+0000", 2024-09-20T21:01:49.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249479+0000", 2024-09-20T21:01:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9199999999999999e-07 2024-09-20T21:01:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249546+0000", 2024-09-20T21:01:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7879000000000005e-05 2024-09-20T21:01:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249557+0000", 2024-09-20T21:01:49.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.013e-05 2024-09-20T21:01:49.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.249563+0000", 2024-09-20T21:01:49.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6250000000000001e-06 2024-09-20T21:01:49.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.255959+0000", 2024-09-20T21:01:49.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0063956550000000001 2024-09-20T21:01:49.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.256083+0000", 2024-09-20T21:01:49.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000124394 2024-09-20T21:01:49.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.256208+0000", 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012492100000000001 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.257677+0000", 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001469028 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.266876+0000", 2024-09-20T21:01:49.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0091992410000000004 2024-09-20T21:01:49.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.266950+0000", 2024-09-20T21:01:49.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4023000000000006e-05 2024-09-20T21:01:49.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.266989+0000", 2024-09-20T21:01:49.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8451999999999997e-05 2024-09-20T21:01:49.950 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.950 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.950 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.950 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:53367 5.4 5:2a6ad83c:::benchmark_data_smithi112_23632_object53366:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:49.950 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:46.893968+0000", 2024-09-20T21:01:49.950 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 2.9456055349999999, 2024-09-20T21:01:49.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016649145000000001, 2024-09-20T21:01:49.951 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.951 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.951 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.951 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.951 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.951 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.951 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 53367 2024-09-20T21:01:49.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.951 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.893968+0000", 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.893968+0000", 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.893969+0000", 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2799999999999996e-07 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.893995+0000", 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5870000000000001e-05 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.894004+0000", 2024-09-20T21:01:49.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2709999999999998e-06 2024-09-20T21:01:49.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.894009+0000", 2024-09-20T21:01:49.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4729999999999999e-06 2024-09-20T21:01:49.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.896815+0000", 2024-09-20T21:01:49.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0028059360000000002 2024-09-20T21:01:49.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.896902+0000", 2024-09-20T21:01:49.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6946000000000004e-05 2024-09-20T21:01:49.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.896981+0000", 2024-09-20T21:01:49.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8374999999999994e-05 2024-09-20T21:01:49.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.901917+0000", 2024-09-20T21:01:49.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004936406 2024-09-20T21:01:49.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.910418+0000", 2024-09-20T21:01:49.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0085007190000000003 2024-09-20T21:01:49.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.910521+0000", 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000103292 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.910617+0000", 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6229000000000003e-05 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.958 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:53511 5.4 5:2d6e90d5:::benchmark_data_smithi112_23632_object53510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 2.8758345969999999, 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018936089999999999, 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 53511 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963740+0000", 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0800000000000004e-07 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963784+0000", 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3857999999999999e-05 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963796+0000", 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2e-05 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963803+0000", 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2259999999999999e-06 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.964837+0000", 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010340379999999999 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.964924+0000", 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6669000000000007e-05 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.965060+0000", 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136594 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969393+0000", 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0043331259999999996 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982603+0000", 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.013210095999999999 2024-09-20T21:01:49.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982638+0000", 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4981999999999998e-05 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982675+0000", 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6893000000000001e-05 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.965 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:53515 5.4 5:2ee61bd6:::benchmark_data_smithi112_23632_object53514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:49.965 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:46.967036+0000", 2024-09-20T21:01:49.965 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 2.8725379719999999, 2024-09-20T21:01:49.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017254868999999999, 2024-09-20T21:01:49.965 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.965 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.965 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.965 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.965 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.966 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.966 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 53515 2024-09-20T21:01:49.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.966 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.967036+0000", 2024-09-20T21:01:49.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.967036+0000", 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.967037+0000", 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6899999999999996e-07 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.967127+0000", 2024-09-20T21:01:49.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0008999999999998e-05 2024-09-20T21:01:49.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.967136+0000", 2024-09-20T21:01:49.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0659999999999993e-06 2024-09-20T21:01:49.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.967143+0000", 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7780000000000002e-06 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.968115+0000", 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00097265800000000005 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.968198+0000", 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2353000000000002e-05 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.968279+0000", 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1945000000000002e-05 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969617+0000", 2024-09-20T21:01:49.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001337836 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.984229+0000", 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014611716 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.984264+0000", 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4743000000000003e-05 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.984291+0000", 2024-09-20T21:01:49.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6896000000000001e-05 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:53520 5.b 5:dfa355d7:::benchmark_data_smithi112_23632_object53519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:46.969721+0000", 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 2.8698525569999997, 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017366978000000002, 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:49.972 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 53520 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969721+0000", 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969721+0000", 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:49.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969722+0000", 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7899999999999998e-07 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969767+0000", 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5442999999999998e-05 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969776+0000", 2024-09-20T21:01:49.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4780000000000008e-06 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969782+0000", 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4899999999999997e-06 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969833+0000", 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1199000000000002e-05 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:49.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969950+0000", 2024-09-20T21:01:49.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116136 2024-09-20T21:01:49.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:49.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.970109+0000", 2024-09-20T21:01:49.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000159254 2024-09-20T21:01:49.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.975266+0000", 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.005157277 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.986998+0000", 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.011732368 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.987061+0000", 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2587000000000002e-05 2024-09-20T21:01:49.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:49.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:49.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:49.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.987088+0000", 2024-09-20T21:01:49.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7166999999999999e-05 2024-09-20T21:01:49.978 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.978 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.978 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.978 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:49.978 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:49.978 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:49.980 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:49.980+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:49.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:50.080 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:50.081+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:50.132 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:60353 5.a 5:5784dd70:::benchmark_data_smithi112_23632_object60352:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.126894+0000", 2024-09-20T21:01:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0054836190000000003, 2024-09-20T21:01:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0055112479999999998, 2024-09-20T21:01:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 60353 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.126894+0000", 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.126894+0000", 2024-09-20T21:01:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.126896+0000", 2024-09-20T21:01:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6109999999999999e-06 2024-09-20T21:01:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.126935+0000", 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8683999999999998e-05 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.126944+0000", 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5599999999999999e-06 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.126962+0000", 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7496e-05 2024-09-20T21:01:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127017+0000", 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4715e-05 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127190+0000", 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017386300000000001 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127340+0000", 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149736 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:60354 5.3 5:c08155fc:::benchmark_data_smithi112_23632_object60353:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.126979+0000", 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0053994960000000002, 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0055154979999999998, 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 60354 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.126979+0000", 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.126979+0000", 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.126979+0000", 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5899999999999996e-07 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127020+0000", 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1235000000000001e-05 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127028+0000", 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9789999999999993e-06 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127034+0000", 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0430000000000004e-06 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127067+0000", 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2820000000000001e-05 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127229+0000", 2024-09-20T21:01:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016149799999999999 2024-09-20T21:01:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127397+0000", 2024-09-20T21:01:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016861299999999999 2024-09-20T21:01:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132271+0000", 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048732960000000001 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:60356 5.6 5:63dc1155:::benchmark_data_smithi112_23632_object60355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.127047+0000", 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0053315330000000003, 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0055319510000000002, 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 60356 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127047+0000", 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127047+0000", 2024-09-20T21:01:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127047+0000", 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1399999999999997e-07 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127091+0000", 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3507000000000002e-05 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127106+0000", 2024-09-20T21:01:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5308999999999999e-05 2024-09-20T21:01:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127125+0000", 2024-09-20T21:01:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9321999999999999e-05 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127197+0000", 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1965999999999995e-05 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127340+0000", 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014269099999999999 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127468+0000", 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000128164 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:60355 5.b e31/21 5:d4e6e5e9:::benchmark_data_smithi112_23632_object60354:head v 31'3859, mlcod=31'3856)", 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.127105+0000", 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0052732769999999998, 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.005550106, 2024-09-20T21:01:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127105+0000", 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127105+0000", 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127105+0000", 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5400000000000001e-07 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127172+0000", 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6641000000000001e-05 2024-09-20T21:01:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127207+0000", 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5145999999999999e-05 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127214+0000", 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6200000000000001e-06 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129108+0000", 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0018944739999999999 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129129+0000", 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1106000000000001e-05 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:60358 5.3 5:ce3e0e38:::benchmark_data_smithi112_23632_object60357:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.127639+0000", 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0047393340000000004, 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0050761479999999999, 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 60358 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127639+0000", 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127639+0000", 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127640+0000", 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8599999999999997e-07 2024-09-20T21:01:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127748+0000", 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010799800000000001 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127759+0000", 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1353e-05 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.127766+0000", 2024-09-20T21:01:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.742e-06 2024-09-20T21:01:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129383+0000", 2024-09-20T21:01:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016172140000000001 2024-09-20T21:01:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129504+0000", 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121001 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129640+0000", 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013611799999999999 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:60359 5.2 5:4eb7cefd:::benchmark_data_smithi112_23632_object60358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.129099+0000", 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0032791140000000001, 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0036860009999999999, 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 60359 2024-09-20T21:01:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129099+0000", 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129099+0000", 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129100+0000", 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.85e-07 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129131+0000", 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1563000000000003e-05 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129144+0000", 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2243e-05 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129151+0000", 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4139999999999997e-06 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.130860+0000", 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0017085570000000001 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.131000+0000", 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014022500000000001 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.131144+0000", 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144604 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:60352 5.e e31/21 5:7dda3843:::benchmark_data_smithi112_23632_object60351:head v 31'3818, mlcod=31'3815)", 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.129173+0000", 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0032053289999999998, 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0036758580000000002, 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129173+0000", 2024-09-20T21:01:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129173+0000", 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129173+0000", 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4499999999999998e-07 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129201+0000", 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8024000000000001e-05 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129209+0000", 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8089999999999993e-06 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.129215+0000", 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1680000000000001e-06 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.130901+0000", 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016856379999999999 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.130925+0000", 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.429e-05 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:60362 5.a 5:5c05d5a7:::benchmark_data_smithi112_23632_object60361:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.132169+0000", 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00020865599999999999, 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00073741599999999996, 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 60362 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132169+0000", 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132169+0000", 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132171+0000", 2024-09-20T21:01:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.189e-06 2024-09-20T21:01:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132213+0000", 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2818000000000002e-05 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132225+0000", 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1391e-05 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132232+0000", 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0469999999999996e-06 2024-09-20T21:01:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132279+0000", 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6958e-05 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132421+0000", 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000142466 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132566+0000", 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014456399999999999 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:60360 5.e e31/21 5:73f07f02:::benchmark_data_smithi112_23632_object60359:head v 31'3819, mlcod=31'3815)", 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.132289+0000", 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8646999999999993e-05, 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00068044199999999996, 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132289+0000", 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132289+0000", 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132290+0000", 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6300000000000004e-07 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132349+0000", 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9246999999999997e-05 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132359+0000", 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1479999999999995e-06 2024-09-20T21:01:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132365+0000", 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.443e-06 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132725+0000", 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035960300000000001 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132758+0000", 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3114000000000002e-05 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:60361 5.0 e31/21 5:0d48e586:::benchmark_data_smithi112_23632_object60360:head v 31'3708, mlcod=31'3704)", 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.132476+0000", 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9999022, 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00054692200000000003, 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:50.176 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132476+0000", 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132476+0000", 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132476+0000", 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5000000000000003e-07 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132529+0000", 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3056999999999997e-05 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132541+0000", 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1849e-05 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132547+0000", 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132592+0000", 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4938999999999998e-05 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132609+0000", 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6795000000000001e-05 2024-09-20T21:01:50.179 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:60363 5.7 5:e674b1d4:::benchmark_data_smithi112_23632_object60362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.132908+0000", 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9994702, 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017219300000000001, 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.180 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 60363 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132908+0000", 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132908+0000", 2024-09-20T21:01:50.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132909+0000", 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5499999999999996e-07 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132964+0000", 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4836000000000001e-05 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132974+0000", 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0379e-05 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132981+0000", 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.635e-06 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.133043+0000", 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2936999999999997e-05 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.183 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:60344 5.6 5:6f11380e:::benchmark_data_smithi112_23632_object60343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.123003+0000", 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0093748359999999992, 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010135267, 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.184 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 60344 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.123003+0000", 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.123003+0000", 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.123004+0000", 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2900000000000003e-07 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.123122+0000", 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117713 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.123137+0000", 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143999999999999e-05 2024-09-20T21:01:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.123149+0000", 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1909000000000001e-05 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.124915+0000", 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001765796 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.125047+0000", 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132251 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.125194+0000", 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147439 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.132629+0000", 2024-09-20T21:01:50.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0074343329999999996 2024-09-20T21:01:50.189 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.189 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.189 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.189 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.189 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:01:50.189 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 12 2024-09-20T21:01:50.189 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:50.191 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:50.191 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:50.186+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:50.241 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 23 16 60598 60582 164.607 133.062 0.00629301 0.00607088 2024-09-20T21:01:50.291 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:50.289+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:50.392 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:50.389+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:50.393 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:01:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:01:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:01:50.393 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:50.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:50.493 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:50.493+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:50.575 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:50.575 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.379842463000003, 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:01:50.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:01:50.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:50.582 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.379708264000001, 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:01:50.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.379603258000003, 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:50.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:01:50.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:01:50.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.379483733000001, 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.595 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:50.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.601 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.379413726000003, 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:01:50.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:50.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:01:50.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:01:50.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.379338674000003, 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:01:50.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:01:50.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.379251648, 2024-09-20T21:01:50.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:01:50.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:50.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.379182874999998, 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.619 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:01:50.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:01:50.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.379096615999998, 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.624 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:01:50.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16445 5.2 5:4d443432:::benchmark_data_smithi112_23632_object16444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.351742182999999, 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01791187, 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.629 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16445 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222332+0000", 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222333+0000", 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0699999999999996e-07 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222428+0000", 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5198000000000006e-05 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222438+0000", 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6889999999999999e-06 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222481+0000", 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3157e-05 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222551+0000", 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9915999999999999e-05 2024-09-20T21:01:50.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222632+0000", 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1650999999999995e-05 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222733+0000", 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100153 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227624+0000", 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048913309999999996 2024-09-20T21:01:50.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240156+0000", 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012531927 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240205+0000", 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9363999999999997e-05 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240244+0000", 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8577e-05 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16448 5.3 5:ceed33ed:::benchmark_data_smithi112_23632_object16447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.351504661, 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017689621999999999, 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.635 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16448 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222569+0000", 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222570+0000", 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222617+0000", 2024-09-20T21:01:50.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6493999999999999e-05 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222626+0000", 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5959999999999993e-06 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222633+0000", 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222677+0000", 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4029000000000001e-05 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222798+0000", 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000120586 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222928+0000", 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013065400000000001 2024-09-20T21:01:50.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227036+0000", 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0041077190000000001 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240183+0000", 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013146817999999999 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240229+0000", 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6619999999999997e-05 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240259+0000", 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9791e-05 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:16451 5.1 5:80cd9f79:::benchmark_data_smithi112_23632_object16450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:50.641 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.351363560999999, 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017604979, 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16451 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222711+0000", 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.13e-07 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222743+0000", 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2079000000000002e-05 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222752+0000", 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9369999999999993e-06 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222758+0000", 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7320000000000003e-06 2024-09-20T21:01:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222814+0000", 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6450000000000003e-05 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.222950+0000", 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013559600000000001 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.223083+0000", 2024-09-20T21:01:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132676 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.227057+0000", 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039746499999999997 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240270+0000", 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013212911000000001 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240294+0000", 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4261e-05 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:32.240316+0000", 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1073999999999998e-05 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.647 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:53512 5.c 5:36560341:::benchmark_data_smithi112_23632_object53511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.962098+0000", 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.6119762529999999, 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.018674290999999999, 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 53512 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.962098+0000", 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.962098+0000", 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.962098+0000", 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0200000000000002e-07 2024-09-20T21:01:50.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.962130+0000", 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2078e-05 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.962138+0000", 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2980000000000003e-06 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.962143+0000", 2024-09-20T21:01:50.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9810000000000003e-06 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.965604+0000", 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00346109 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.965722+0000", 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117796 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.965830+0000", 2024-09-20T21:01:50.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010815999999999999 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980645+0000", 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014815672 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980688+0000", 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2422999999999997e-05 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980735+0000", 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7176999999999999e-05 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980772+0000", 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7113999999999997e-05 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:53516 5.7 5:e29b181b:::benchmark_data_smithi112_23632_object53515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:50.653 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.967546+0000", 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.6065282939999999, 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.018198378000000001, 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 53516 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967546+0000", 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967546+0000", 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967547+0000", 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3519999999999999e-06 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967582+0000", 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5126000000000002e-05 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967594+0000", 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1385e-05 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967600+0000", 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6080000000000001e-06 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980058+0000", 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012457866999999999 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980263+0000", 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205169 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980397+0000", 2024-09-20T21:01:50.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013365799999999999 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.983984+0000", 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003587083 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.985673+0000", 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016886920000000001 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.985705+0000", 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2589999999999998e-05 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.985744+0000", 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8847999999999998e-05 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.659 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:53517 5.1 5:86e5c695:::benchmark_data_smithi112_23632_object53516:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.967616+0000", 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.606458232, 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019008619000000001, 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 53517 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.660 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967616+0000", 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967616+0000", 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967616+0000", 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7e-07 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967646+0000", 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9546000000000001e-05 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967653+0000", 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.063e-06 2024-09-20T21:01:50.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967658+0000", 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8679999999999998e-06 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980078+0000", 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012419832 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980197+0000", 2024-09-20T21:01:50.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119602 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980311+0000", 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011395099999999999 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.982745+0000", 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002433578 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.986529+0000", 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037842610000000001 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.986589+0000", 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9639000000000003e-05 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.986625+0000", 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5809000000000002e-05 2024-09-20T21:01:50.665 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:53518 5.5 5:a54df542:::benchmark_data_smithi112_23632_object53517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.967672+0000", 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.6064017540000002, 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017704627000000001, 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.666 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 53518 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967672+0000", 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967672+0000", 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967673+0000", 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4700000000000002e-07 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967701+0000", 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8243e-05 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967708+0000", 2024-09-20T21:01:50.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.737e-06 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.967713+0000", 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7620000000000003e-06 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980066+0000", 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012353594000000001 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980173+0000", 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010649000000000001 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980263+0000", 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0568000000000004e-05 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.983889+0000", 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0036261560000000002 2024-09-20T21:01:50.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.985284+0000", 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013941680000000001 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.985333+0000", 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9670999999999999e-05 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.985377+0000", 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3791000000000001e-05 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:53522 5.7 5:e1267807:::benchmark_data_smithi112_23632_object53521:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.968170+0000", 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.6059038279999998, 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020713709, 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 53522 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968170+0000", 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968170+0000", 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968171+0000", 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8400000000000003e-07 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968212+0000", 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1235000000000001e-05 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968224+0000", 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1327e-05 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968229+0000", 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7599999999999999e-06 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.982171+0000", 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013941597999999999 2024-09-20T21:01:50.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.982274+0000", 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102731 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.982385+0000", 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011159599999999999 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.987357+0000", 2024-09-20T21:01:50.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049712300000000001 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.988793+0000", 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014359360000000001 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.988842+0000", 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9326999999999997e-05 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.988884+0000", 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2184999999999997e-05 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:53523 5.5 5:aa465991:::benchmark_data_smithi112_23632_object53522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.968241+0000", 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.6058332399999999, 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020676152999999999, 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.678 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 53523 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968241+0000", 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968241+0000", 2024-09-20T21:01:50.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968241+0000", 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7300000000000001e-07 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968306+0000", 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4438999999999997e-05 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968315+0000", 2024-09-20T21:01:50.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7479999999999999e-06 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.968320+0000", 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3210000000000004e-06 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.981957+0000", 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013637562000000001 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.982069+0000", 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111123 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.982182+0000", 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113851 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.987282+0000", 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0050997070000000002 2024-09-20T21:01:50.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.988830+0000", 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015480069999999999 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.988879+0000", 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8621000000000001e-05 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.988917+0000", 2024-09-20T21:01:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8300999999999998e-05 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:53524 5.7 5:e4e6cd81:::benchmark_data_smithi112_23632_object53523:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.970197+0000", 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.6038773040000001, 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020981211999999999, 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 53524 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970197+0000", 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970197+0000", 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970198+0000", 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4099999999999997e-07 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970230+0000", 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2397999999999997e-05 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970243+0000", 2024-09-20T21:01:50.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2332e-05 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970250+0000", 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.984009+0000", 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013758726000000001 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.984126+0000", 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117162 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.984240+0000", 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114168 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.988945+0000", 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047047 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.991065+0000", 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021202439999999999 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.991105+0000", 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0299000000000002e-05 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.991178+0000", 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2774999999999994e-05 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:53525 5.2 5:410b36e8:::benchmark_data_smithi112_23632_object53524:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:46.970264+0000", 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.6038103650000002, 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021013467000000001, 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:50.690 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 53525 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970264+0000", 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970264+0000", 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970264+0000", 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6100000000000001e-07 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970295+0000", 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0412e-05 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970302+0000", 2024-09-20T21:01:50.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6450000000000005e-06 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.970308+0000", 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8629999999999996e-06 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.980062+0000", 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097535209999999994 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:50.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.981745+0000", 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00168362 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.981894+0000", 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014892 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.988219+0000", 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063246070000000003 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.991181+0000", 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029624230000000001 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.991239+0000", 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7454999999999998e-05 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:46.991277+0000", 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8439999999999998e-05 2024-09-20T21:01:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:50.696 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:50.697 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:50.698 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:50.696+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:50.798 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:50.796+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:50.844 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:50.844 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:50.844 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61817 5.7 e31/21 5:e4eb388d:::benchmark_data_smithi112_23632_object61816:head v 31'3838, mlcod=31'3835)", 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.836746+0000", 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0078058729999999996, 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0078300729999999999, 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.836746+0000", 2024-09-20T21:01:50.845 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.836746+0000", 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.836747+0000", 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.6599999999999996e-07 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.846 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.836812+0000", 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.5433999999999997e-05 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.836821+0000", 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.9309999999999997e-06 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.836826+0000", 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7450000000000003e-06 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.836901+0000", 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.4949000000000004e-05 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.836936+0000", 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.5343999999999999e-05 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.848 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61818 5.f e31/21 5:ff75b6ea:::benchmark_data_smithi112_23632_object61817:head v 31'3854, mlcod=31'3852)", 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.837111+0000", 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0074411800000000004, 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0075300710000000002, 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837111+0000", 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.849 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837111+0000", 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837111+0000", 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.9000000000000002e-07 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837158+0000", 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.6570000000000003e-05 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.850 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837165+0000", 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837169+0000", 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.6519999999999999e-06 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837237+0000", 2024-09-20T21:01:50.851 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8505999999999998e-05 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837250+0000", 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2559e-05 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61822 5.1 e31/21 5:8e79f247:::benchmark_data_smithi112_23632_object61821:head v 31'3939, mlcod=31'3937)", 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.837404+0000", 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0071481460000000002, 2024-09-20T21:01:50.852 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0072991489999999996, 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837404+0000", 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837404+0000", 2024-09-20T21:01:50.853 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837404+0000", 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.2599999999999998e-07 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837458+0000", 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.3703999999999999e-05 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.854 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837465+0000", 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8920000000000003e-06 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837470+0000", 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4319999999999998e-06 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837522+0000", 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1425000000000003e-05 2024-09-20T21:01:50.855 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837539+0000", 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6915999999999999e-05 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61823 5.d e31/21 5:b5e151d0:::benchmark_data_smithi112_23632_object61822:head v 31'3798, mlcod=31'3796)", 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.837772+0000", 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0067802419999999997, 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006991092, 2024-09-20T21:01:50.856 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837772+0000", 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837772+0000", 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.857 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837772+0000", 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.9999999999999997e-07 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837833+0000", 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.0794000000000001e-05 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.858 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837844+0000", 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0915e-05 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837850+0000", 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.7899999999999996e-06 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837903+0000", 2024-09-20T21:01:50.859 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.3223000000000002e-05 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.837924+0000", 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0854000000000001e-05 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61820 5.f e31/21 5:fb04fe48:::benchmark_data_smithi112_23632_object61819:head v 31'3855, mlcod=31'3852)", 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.838839+0000", 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00571304, 2024-09-20T21:01:50.860 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059857690000000002, 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.838839+0000", 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.838839+0000", 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.861 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.838840+0000", 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1900000000000002e-07 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.838915+0000", 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5570999999999999e-05 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.862 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.838926+0000", 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0572e-05 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.838932+0000", 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6170000000000003e-06 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841663+0000", 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002731027 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.863 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841686+0000", 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2863000000000001e-05 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61825 5.d e31/21 5:b237deb0:::benchmark_data_smithi112_23632_object61824:head v 31'3799, mlcod=31'3796)", 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.840265+0000", 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0042866500000000004, 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0046159629999999998, 2024-09-20T21:01:50.864 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840265+0000", 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840265+0000", 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.865 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840266+0000", 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0399999999999996e-07 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840340+0000", 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.4531999999999997e-05 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840348+0000", 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9449999999999993e-06 2024-09-20T21:01:50.866 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840352+0000", 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.0459999999999999e-06 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841794+0000", 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0014414639999999999 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841819+0000", 2024-09-20T21:01:50.867 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5256e-05 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61828 5.5 e31/21 5:affebd66:::benchmark_data_smithi112_23632_object61827:head v 31'3853, mlcod=31'3851)", 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.840458+0000", 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0040941160000000001, 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0044822999999999998, 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.868 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840458+0000", 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840458+0000", 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840458+0000", 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.3200000000000001e-07 2024-09-20T21:01:50.869 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840481+0000", 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2456e-05 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840488+0000", 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7319999999999998e-06 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840492+0000", 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.4510000000000001e-06 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841782+0000", 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0012905320000000001 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841801+0000", 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9006000000000001e-05 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.871 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61824 5.f e31/21 5:f0ecfe94:::benchmark_data_smithi112_23632_object61823:head v 31'3856, mlcod=31'3852)", 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.840524+0000", 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.004027643, 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0044670220000000002, 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840524+0000", 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840524+0000", 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840525+0000", 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5000000000000001e-07 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.873 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840575+0000", 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.9348000000000003e-05 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840586+0000", 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1344e-05 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.840592+0000", 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.93e-06 2024-09-20T21:01:50.874 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.844693+0000", 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0041006200000000001 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.844712+0000", 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9385000000000002e-05 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.875 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61830 5.1 e31/21 5:8c9a345a:::benchmark_data_smithi112_23632_object61829:head v 31'3940, mlcod=31'3937)", 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.841217+0000", 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0033351520000000001, 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0038379120000000002, 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841217+0000", 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.876 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841217+0000", 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841217+0000", 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.6899999999999998e-07 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.877 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841282+0000", 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.4717999999999999e-05 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841289+0000", 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1160000000000001e-06 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841292+0000", 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.4300000000000002e-06 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.878 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841752+0000", 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00045959000000000001 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841771+0000", 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9446e-05 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.879 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61831 5.6 e31/21 5:690c8c7c:::benchmark_data_smithi112_23632_object61830:head v 31'3875, mlcod=31'3873)", 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.841301+0000", 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.003250878, 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0038111320000000001, 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841301+0000", 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.880 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841301+0000", 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841301+0000", 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5800000000000001e-07 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841340+0000", 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.8631000000000003e-05 2024-09-20T21:01:50.881 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841345+0000", 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.6809999999999997e-06 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841348+0000", 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0759999999999999e-06 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841383+0000", 2024-09-20T21:01:50.882 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.5580999999999997e-05 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.841398+0000", 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4693e-05 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61833 5.3 e31/21 5:c75eacb9:::benchmark_data_smithi112_23632_object61832:head v 31'3831, mlcod=31'3829)", 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.842500+0000", 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0020516699999999998, 2024-09-20T21:01:50.883 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0026727220000000002, 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.842500+0000", 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.842500+0000", 2024-09-20T21:01:50.884 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.842501+0000", 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0400000000000005e-07 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.842557+0000", 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.5670000000000001e-05 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.885 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.842568+0000", 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.135e-05 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.842574+0000", 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.2990000000000002e-06 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.842635+0000", 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.0776000000000002e-05 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.886 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.842654+0000", 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9137999999999999e-05 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61836 5.9 e31/21 5:9e7a67e8:::benchmark_data_smithi112_23632_object61835:head v 31'3863, mlcod=31'3861)", 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.843146+0000", 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.001405681, 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0020859490000000001, 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.887 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.843146+0000", 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.843146+0000", 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.888 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.843147+0000", 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.51e-07 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.843197+0000", 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0603000000000003e-05 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.843206+0000", 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.337e-06 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.889 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.843211+0000", 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.2190000000000003e-06 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.843256+0000", 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.5030000000000001e-05 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.843273+0000", 2024-09-20T21:01:50.890 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6778000000000001e-05 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:61834 5.3 e31/21 5:c0cafb3c:::benchmark_data_smithi112_23632_object61833:head v 31'3832, mlcod=31'3829)", 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:50.844371+0000", 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00018073500000000001, 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00091841299999999998, 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:50.891 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.844371+0000", 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.844371+0000", 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.844372+0000", 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.6899999999999996e-07 2024-09-20T21:01:50.892 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.844442+0000", 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.9669e-05 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.844451+0000", 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.2620000000000004e-06 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.844456+0000", 2024-09-20T21:01:50.893 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7129999999999996e-06 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.844711+0000", 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025510099999999998 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:50.844730+0000", 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.961e-05 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:50.894 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.895 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:50.895 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:01:50.895 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 13 2024-09-20T21:01:50.895 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:50.896 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:50.898 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:50.896+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:50.999 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:50.996+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:51.041 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:51.041 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:01:51.041 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:01:51.041 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:01:51.041 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:51.061 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:51.099 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:51.100+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:51.200 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:51.201+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:51.210 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:51.210 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:01:51.210 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:01:51.210 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:51.210 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.210 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:51.210 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:51.210 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 49.246754088000003, 2024-09-20T21:01:51.210 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:01:51.210 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.213 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:01:51.214 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.215 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 48.241759313999999, 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.217 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.218 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:01:51.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.220 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.221 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:01:51.222 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.013819918000003, 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.223 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.224 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.225 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.226 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:01:51.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.013672698999997, 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.231 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:01:51.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.234 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:01:51.235 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.236 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.013546767000001, 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:01:51.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.240 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:01:51.241 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.013462171, 2024-09-20T21:01:51.242 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.243 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:01:51.244 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.246 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:01:51.247 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.013144570000001, 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.248 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.249 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:01:51.250 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.251 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.252 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.253 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.013042853999998, 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.254 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:01:51.255 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:01:51.256 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.258 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012962258000002, 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:01:51.259 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.260 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:01:51.261 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:01:51.262 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.263 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.264 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012885191999999, 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:51.265 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.266 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.267 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:01:51.268 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.269 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:51.270 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012673724000003, 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.271 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.272 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:01:51.273 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:01:51.274 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.275 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012597886999998, 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.276 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:01:51.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.278 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:01:51.279 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:01:51.280 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.281 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012475825000003, 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.282 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:01:51.284 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:01:51.285 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:01:51.286 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.287 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012407576000001, 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.288 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.289 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.290 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:01:51.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:01:51.292 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012314789999998, 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:01:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:01:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012252934000003, 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:01:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:01:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012170558000001, 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:01:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:01:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012085998000003, 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:01:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.312 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:51.313 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.314 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:51.315 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.012022092000002, 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.316 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.317 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:01:51.318 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:01:51.319 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:01:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 39.011959349000001, 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:51.321 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.322 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:01:51.323 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:51.324 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:01:51.325 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:01:51.325 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.325 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.325 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.325 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:51.325 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:51.325 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:51.325 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T21:01:51.327 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 24 16 62672 62656 163.149 129.625 0.00871803 0.00612453 2024-09-20T21:01:51.327 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:51.324+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:51.328 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:51.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:01:51.427 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:51.424+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:51.478 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:51.479 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:51.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.479 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:63148 5.8 5:13fafbd0:::benchmark_data_smithi112_23632_object63147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:51.479 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:51.471191+0000", 2024-09-20T21:01:51.479 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0096538549999999994, 2024-09-20T21:01:51.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0096741450000000003, 2024-09-20T21:01:51.479 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:51.479 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:51.479 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:51.479 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 63148 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.471191+0000", 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:51.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.471191+0000", 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.471192+0000", 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6700000000000002e-07 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.471291+0000", 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8758999999999994e-05 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.471310+0000", 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8892000000000001e-05 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.471317+0000", 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9659999999999999e-06 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.472659+0000", 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001341615 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.472759+0000", 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000100034 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.472860+0000", 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000101754 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478844+0000", 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0059835410000000002 2024-09-20T21:01:51.483 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:63153 5.8 5:1bfb5533:::benchmark_data_smithi112_23632_object63152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:51.472484+0000", 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0083616309999999996, 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0084478520000000005, 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:51.484 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 63153 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.472484+0000", 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.472484+0000", 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.472485+0000", 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9599999999999998e-07 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.472558+0000", 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3271999999999999e-05 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.472568+0000", 2024-09-20T21:01:51.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0462000000000001e-05 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.472575+0000", 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9020000000000002e-06 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.474858+0000", 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022826890000000001 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:51.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.474962+0000", 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000103902 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.475063+0000", 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000101636 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.480593+0000", 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0055297339999999997 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:51.488 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:63156 5.0 5:0a3e6fd3:::benchmark_data_smithi112_23632_object63155:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:51.473574+0000", 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0072709339999999997, 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0074323059999999996, 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 63156 2024-09-20T21:01:51.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.473574+0000", 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.473574+0000", 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.473575+0000", 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8899999999999998e-07 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.473655+0000", 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0149999999999997e-05 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.473666+0000", 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0258000000000001e-05 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.473671+0000", 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.254e-06 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.474873+0000", 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0012019039999999999 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.474992+0000", 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000119002 2024-09-20T21:01:51.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.475117+0000", 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000124898 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.480600+0000", 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0054836529999999998 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:63161 5.8 5:1cf3cfa8:::benchmark_data_smithi112_23632_object63160:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:51.476992+0000", 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0038532620000000001, 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040699270000000001, 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 63161 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.494 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.476992+0000", 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.476992+0000", 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:51.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.476993+0000", 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.096e-06 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477027+0000", 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4209999999999999e-05 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477035+0000", 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4900000000000003e-06 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477040+0000", 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2469999999999999e-06 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477205+0000", 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016479299999999999 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477291+0000", 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5803000000000005e-05 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477380+0000", 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9178999999999994e-05 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:63164 5.8 5:1dc7ed4f:::benchmark_data_smithi112_23632_object63163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:51.477224+0000", 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0036210349999999999, 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038886099999999998, 2024-09-20T21:01:51.498 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 63164 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477224+0000", 2024-09-20T21:01:51.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477224+0000", 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477225+0000", 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3e-07 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477270+0000", 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5491000000000002e-05 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477277+0000", 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9020000000000002e-06 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.477282+0000", 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1150000000000004e-06 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478873+0000", 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0015910500000000001 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478997+0000", 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012399000000000001 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479138+0000", 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014166100000000001 2024-09-20T21:01:51.502 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:63166 5.d 5:bdb67923:::benchmark_data_smithi112_23632_object63165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:51.478522+0000", 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0023231010000000002, 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026458459999999999, 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:51.503 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 63166 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478522+0000", 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478522+0000", 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478523+0000", 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1100000000000005e-07 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478581+0000", 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8325999999999997e-05 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478592+0000", 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0912e-05 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478600+0000", 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6559999999999992e-06 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478651+0000", 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0832999999999999e-05 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478761+0000", 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110605 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478840+0000", 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8725000000000003e-05 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:63167 5.d 5:baa9912a:::benchmark_data_smithi112_23632_object63166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:51.478924+0000", 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001920976, 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022866710000000001, 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:51.507 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 63167 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478924+0000", 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478924+0000", 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478925+0000", 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.093e-06 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478983+0000", 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7262999999999997e-05 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.478993+0000", 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0332e-05 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479000+0000", 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.956e-06 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.480451+0000", 2024-09-20T21:01:51.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0014513270000000001 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.480544+0000", 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2856999999999995e-05 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.480652+0000", 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010775 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:63168 5.8 5:1655c28d:::benchmark_data_smithi112_23632_object63167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:51.479088+0000", 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0017575150000000001, 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0021623760000000001, 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 63168 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:51.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479088+0000", 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479088+0000", 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479089+0000", 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3399999999999998e-07 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479147+0000", 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8103000000000003e-05 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479155+0000", 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8710000000000003e-06 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479161+0000", 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6570000000000002e-06 2024-09-20T21:01:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.480620+0000", 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0014590409999999999 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.480746+0000", 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012611400000000001 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.480903+0000", 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015673400000000001 2024-09-20T21:01:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:63148 5.8 e31/21)", 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:51.479255+0000", 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001590359, 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020312720000000002, 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479255+0000", 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479255+0000", 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479256+0000", 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6300000000000005e-07 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479259+0000", 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4070000000000002e-06 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479270+0000", 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1446e-05 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:51.479276+0000", 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1649999999999997e-06 2024-09-20T21:01:51.518 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.519 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:51.519 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.519 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:51.519 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:01:51.519 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 9 2024-09-20T21:01:51.519 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:51.520 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:51.529 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:51.529 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:51.547 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:51.547 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:51.564 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:51.564+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:51.565 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:51.628 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:51.629+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:51.718 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:51.719 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:51.730 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:51.729+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:51.739 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:51.830 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:51.826+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:51.890 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:51.890 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:51.913 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:51.959 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:51.958+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:52.032 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:52.033+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:52.065 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:52.066 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:52.088 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:52.120 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T21:01:52.120 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:01:52.120 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-20T21:01:52.120 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.000000 2024-09-20T21:01:52.120 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0 2024-09-20T21:01:52.133 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:52.132+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:52.233 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:52.233+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:52.241 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 25 16 64788 64772 161.913 132.25 0.00959169 0.0061718 2024-09-20T21:01:52.285 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:52.285 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:52.303 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-20T21:01:52.306 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:52.334 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:52.332+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:52.434 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:52.430+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:52.459 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:52.460 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:52.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:52.535 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:52.534+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:52.633 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:52.633 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:52.636 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:52.632+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:52.650 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:52.737 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:52.734+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:52.838 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:52.834+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:52.839 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:52.839 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:52.857 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:52.939 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:52.936+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:53.003 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:53.003 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:53.023 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:53.065 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:53.064+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:53.139 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:53.136+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:53.174 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:53.174 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:53.197 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:53.241 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:53.240+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:53.241 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 26 16 66869 66853 160.687 130.062 0.00341773 0.00621888 2024-09-20T21:01:53.317 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.1 primary-affinity to 0 (802) 2024-09-20T21:01:53.342 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:53.338+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:53.353 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:53.353 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:53.375 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:53.443 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:53.440+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:53.527 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:53.527 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:53.543 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:53.540+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:53.548 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:53.584 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:01:53.644 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:53.644+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:53.705 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:53.705 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:53.726 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:53.742 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:53.742 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:53.744 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:53.744+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:53.761 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:53.779 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:53.779 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:53.845 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:53.842+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:53.878 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:53.878 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:01:53.878 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:01:53.878 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:01:53.878 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:53.900 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:53.946 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:53.944+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:54.046 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:54.042+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.904418155000002, 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.100 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:01:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.904283956, 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:01:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:01:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.904178950000002, 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:01:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.904059425, 2024-09-20T21:01:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:01:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.903989418000002, 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:01:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.903914366000002, 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:01:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.903827339999999, 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:01:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.903758566999997, 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:01:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:01:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.903672307999997, 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:01:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:01:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62101 5.8 e31/21 5:186de704:::benchmark_data_smithi112_23632_object62100:head v 31'3911, mlcod=31'3909)", 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.1378513520000002, 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02729376, 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960799+0000", 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960852+0000", 2024-09-20T21:01:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3016000000000002e-05 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960860+0000", 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7370000000000006e-06 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960864+0000", 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3209999999999998e-06 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960904+0000", 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9703000000000003e-05 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960917+0000", 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2794e-05 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988055+0000", 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027138394 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988092+0000", 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7104999999999998e-05 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62103 5.c 5:3565fe84:::benchmark_data_smithi112_23632_object62102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.1373323439999998, 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026906978000000002, 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62103 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961319+0000", 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.128e-06 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961404+0000", 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5373999999999999e-05 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961419+0000", 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4939e-05 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961424+0000", 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4940000000000003e-06 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961486+0000", 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1692000000000005e-05 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961602+0000", 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011565600000000001 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961724+0000", 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012265900000000001 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.967186+0000", 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054620220000000004 2024-09-20T21:01:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988148+0000", 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020962027000000001 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988190+0000", 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1585000000000002e-05 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988224+0000", 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4402e-05 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62102 5.0 e31/21 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head v 31'3819, mlcod=31'3816)", 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.1369515429999999, 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026424553999999999, 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961699+0000", 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961726+0000", 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6999e-05 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961735+0000", 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8359999999999998e-06 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961739+0000", 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7790000000000003e-06 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961785+0000", 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5707000000000001e-05 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961803+0000", 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7609e-05 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988095+0000", 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026292257999999999 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988123+0000", 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810999999999999e-05 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62110 5.c 5:31284d1b:::benchmark_data_smithi112_23632_object62109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.1359980969999999, 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025650796, 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62110 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962653+0000", 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1100000000000005e-07 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962762+0000", 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109282 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962771+0000", 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4080000000000004e-06 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962777+0000", 2024-09-20T21:01:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.857e-06 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964273+0000", 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001495959 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964527+0000", 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025392500000000001 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964653+0000", 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126033 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988138+0000", 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023485176 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988231+0000", 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2940000000000001e-05 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988272+0000", 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0713999999999997e-05 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988303+0000", 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0691000000000001e-05 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62105 5.8 e31/21 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head v 31'3912, mlcod=31'3909)", 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.1350263209999998, 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024588011999999999, 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7999999999999995e-07 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963684+0000", 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0146000000000003e-05 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963695+0000", 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0939e-05 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963701+0000", 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.241e-06 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964203+0000", 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050127400000000001 2024-09-20T21:01:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964220+0000", 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7410000000000001e-05 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988152+0000", 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023932235999999999 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988212+0000", 2024-09-20T21:01:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9185999999999999e-05 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62106 5.0 e31/21 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head v 31'3820, mlcod=31'3816)", 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.1349153400000001, 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024416087999999999, 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963735+0000", 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6000000000000004e-07 2024-09-20T21:01:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963800+0000", 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4455000000000005e-05 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963808+0000", 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9530000000000005e-06 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963814+0000", 2024-09-20T21:01:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0009999999999998e-06 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964329+0000", 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00051435800000000002 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964339+0000", 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0438999999999999e-05 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988125+0000", 2024-09-20T21:01:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023785555999999999 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988151+0000", 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5766e-05 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62111 5.2 5:44febcde:::benchmark_data_smithi112_23632_object62110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.1347375299999998, 2024-09-20T21:01:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024229619000000001, 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62111 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963913+0000", 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1200000000000002e-07 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964060+0000", 2024-09-20T21:01:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147355 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964069+0000", 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1120000000000002e-06 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964074+0000", 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8199999999999996e-06 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964334+0000", 2024-09-20T21:01:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025997599999999998 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964443+0000", 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108497 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964549+0000", 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105781 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.976088+0000", 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011539822 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988059+0000", 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011970550999999999 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988107+0000", 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8473999999999997e-05 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988142+0000", 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4518999999999999e-05 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:62098 5.3 e31/21 ondisk, result = 0)", 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.13404493, 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023464459999999999, 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8000000000000001e-07 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964608+0000", 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9620000000000002e-06 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964618+0000", 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8870000000000004e-06 2024-09-20T21:01:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964629+0000", 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0679000000000001e-05 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965787+0000", 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011576959999999999 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965795+0000", 2024-09-20T21:01:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0779999999999996e-06 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988069+0000", 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022274777999999999 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62114 5.e e31/21 5:7d451501:::benchmark_data_smithi112_23632_object62113:head v 31'3936, mlcod=31'3934)", 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.1327679260000001, 2024-09-20T21:01:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025697174999999999, 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965883+0000", 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6499999999999999e-07 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965942+0000", 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9815999999999998e-05 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965950+0000", 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8590000000000005e-06 2024-09-20T21:01:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965956+0000", 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9460000000000003e-06 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965999+0000", 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3214999999999999e-05 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966030+0000", 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.01e-05 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991550+0000", 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025520185000000001 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991579+0000", 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9388999999999999e-05 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62116 5.4 e31/21 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head v 31'3927, mlcod=31'3925)", 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.1324179970000001, 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024173271, 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.44e-07 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966300+0000", 2024-09-20T21:01:54.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7484999999999995e-05 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966309+0000", 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5730000000000008e-06 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966315+0000", 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9630000000000003e-06 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966374+0000", 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.94e-05 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966390+0000", 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6412000000000001e-05 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.990372+0000", 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023981372000000001 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.990405+0000", 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3422e-05 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62115 5.e e31/21 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head v 31'3937, mlcod=31'3934)", 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.1306332600000002, 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023580685000000001, 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.201 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:54.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7800000000000001e-07 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968091+0000", 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3468999999999997e-05 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968100+0000", 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.645e-06 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968107+0000", 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.725e-06 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.970256+0000", 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021493810000000001 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.970272+0000", 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5489e-05 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991582+0000", 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021310490000000001 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991597+0000", 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4808e-05 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:54.205 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:54.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:54.207 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:54.204+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:54.241 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 27 16 68903 68887 159.444 127.125 0.00858053 0.0062673 2024-09-20T21:01:54.308 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:54.308+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:54.326 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:01:54.354 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:54.355 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:01:54.355 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 0 2024-09-20T21:01:54.355 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:54.375 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:54.421 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:54.420+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:54.509 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:54.506+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:54.523 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:54.523 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:01:54.523 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:01:54.523 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:01:54.523 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:54.545 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:54.633 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:54.632+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:54.711 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:54.710+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 52.772197308000003, 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.737 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.738 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:01:54.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.741 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.742 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.743 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.767202533999999, 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.744 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:01:54.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:01:54.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.749 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.539263138000003, 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.750 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.751 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.752 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:01:54.753 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:01:54.754 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.755 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.539115918999997, 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.756 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:01:54.757 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.758 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.759 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.760 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.538989987000001, 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.761 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.762 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.763 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:01:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:01:54.765 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.766 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.538905391, 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:54.767 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:01:54.768 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.769 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.770 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.771 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.538587790000001, 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.772 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.773 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:01:54.774 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.775 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.776 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.777 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.538486073999998, 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.778 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.779 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.780 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.780 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:54.780 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:01:54.780 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.780 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.780 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.780 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:01:54.781 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.783 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.538405478000001, 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.784 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.785 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.786 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:01:54.787 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:01:54.788 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.789 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.538328411999998, 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.790 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.792 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:01:54.793 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.794 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:54.795 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.538116944000002, 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:54.796 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.797 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.799 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.800 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:54.801 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.538041106999998, 2024-09-20T21:01:54.802 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:01:54.802 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.802 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.802 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.802 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.802 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.802 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.802 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:01:54.803 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:01:54.804 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:54.805 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:01:54.806 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:01:54.806 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.806 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.806 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.806 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:01:54.806 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:01:54.806 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.806 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.807 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.807 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:01:54.807 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:01:54.807 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.807 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.807 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.807 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:01:54.808 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:01:54.808 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.808 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.808 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.808 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:01:54.808 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:01:54.808 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.809 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.809 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.809 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.809 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.809 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.809 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:54.809 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.537919045000002, 2024-09-20T21:01:54.810 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:01:54.810 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.810 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.810 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.810 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.810 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.810 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.810 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:54.811 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.811 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.811 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.811 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.811 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:54.811 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.812 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.812 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.812 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.812 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:01:54.812 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:54.812 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.813 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.813 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.813 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:01:54.813 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:01:54.813 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.813 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.814 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.815 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:01:54.815 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:01:54.815 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.815 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.815 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.815 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:01:54.815 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:01:54.816 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.816 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.816 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:54.816 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:01:54.816 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:01:54.816 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.816 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.817 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.817 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:01:54.817 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:01:54.817 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.817 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.817 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.818 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:01:54.818 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:01:54.818 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.818 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.818 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.818 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:01:54.818 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:01:54.818 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.819 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.819 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.819 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:01:54.819 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:01:54.819 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.819 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.819 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.819 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.819 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.819 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.820 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:54.820 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.537850796000001, 2024-09-20T21:01:54.820 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:01:54.820 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.820 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.820 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.820 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.821 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.822 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.822 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:01:54.822 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:01:54.822 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.822 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.822 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.822 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:01:54.822 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:01:54.822 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.822 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.823 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.823 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:01:54.823 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:01:54.823 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.823 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.823 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.823 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:01:54.823 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:54.824 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.825 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.826 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.537758009999997, 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.827 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:01:54.828 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:01:54.829 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.830 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.831 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.537696154000002, 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.832 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.833 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.834 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:01:54.835 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.836 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.837 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.537613778000001, 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.838 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:01:54.839 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.841 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.842 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.537529218000003, 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.844 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:01:54.845 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.846 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.847 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.848 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.537465312000002, 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:01:54.849 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.850 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:01:54.851 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:01:54.852 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:54.853 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.854 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 42.537402569000001, 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:54.856 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.857 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.858 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.859 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.859 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:54.859 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:54.859 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:54.860 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:54.861 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:54.858+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:54.961 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:54.960+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:55.021 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:55.021 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:55.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.021 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:70562 5.4 5:2a632c55:::benchmark_data_smithi112_23632_object70561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-20T21:01:55.021 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.011455+0000", 2024-09-20T21:01:55.021 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.010749837, 2024-09-20T21:01:55.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010780652999999999, 2024-09-20T21:01:55.021 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 70562 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.011455+0000", 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.011455+0000", 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.011456+0000", 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.057e-06 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.011577+0000", 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000120402 2024-09-20T21:01:55.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.011590+0000", 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3271999999999999e-05 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.011597+0000", 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.34e-06 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.011649+0000", 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1644999999999998e-05 2024-09-20T21:01:55.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.011781+0000", 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000131617 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.011918+0000", 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000137873 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016708+0000", 2024-09-20T21:01:55.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047898300000000001 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:70567 5.b 5:d6a46f3a:::benchmark_data_smithi112_23632_object70566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.016389+0000", 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0058160019999999998, 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0059365670000000002, 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.026 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 70567 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016389+0000", 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016389+0000", 2024-09-20T21:01:55.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016390+0000", 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6899999999999997e-07 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016424+0000", 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4100999999999998e-05 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016430+0000", 2024-09-20T21:01:55.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3029999999999996e-06 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016434+0000", 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.16e-06 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016641+0000", 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207216 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016767+0000", 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012543600000000001 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016877+0000", 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110529 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.030 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:70568 5.b 5:d5b787f9:::benchmark_data_smithi112_23632_object70567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.016447+0000", 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0057580560000000001, 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0059517099999999998, 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 70568 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016447+0000", 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016447+0000", 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016448+0000", 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9599999999999998e-07 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016512+0000", 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4626000000000001e-05 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016520+0000", 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6170000000000001e-06 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016524+0000", 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2150000000000003e-06 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.018700+0000", 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0021760949999999999 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.018920+0000", 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021938799999999999 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.019144+0000", 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000224303 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.034 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:70570 5.b 5:d54c4141:::benchmark_data_smithi112_23632_object70569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.016531+0000", 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0056737810000000001, 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0059393320000000003, 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 70570 2024-09-20T21:01:55.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016531+0000", 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016531+0000", 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016532+0000", 2024-09-20T21:01:55.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.27e-07 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016586+0000", 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4478999999999998e-05 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016592+0000", 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3759999999999999e-06 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016596+0000", 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1989999999999999e-06 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021201+0000", 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0046049680000000001 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021343+0000", 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014238799999999999 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021499+0000", 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015614000000000001 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:70571 5.4 5:23fa7a0b:::benchmark_data_smithi112_23632_object70570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.016625+0000", 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0055800299999999997, 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0059161939999999996, 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.039 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 70571 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016625+0000", 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016625+0000", 2024-09-20T21:01:55.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016626+0000", 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5300000000000004e-07 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016676+0000", 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0621000000000002e-05 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016683+0000", 2024-09-20T21:01:55.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9990000000000002e-06 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016698+0000", 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.469e-05 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016770+0000", 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2291000000000003e-05 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.016901+0000", 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013069199999999999 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.017050+0000", 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014870500000000001 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022419+0000", 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0053694779999999996 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:70577 5.4 5:22cf7416:::benchmark_data_smithi112_23632_object70576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.019624+0000", 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0025806100000000001, 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029949210000000002, 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 70577 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.019624+0000", 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.019624+0000", 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.019626+0000", 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.412e-06 2024-09-20T21:01:55.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.019693+0000", 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7224999999999994e-05 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.019707+0000", 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3713999999999999e-05 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.019717+0000", 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:01:55.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.019771+0000", 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3730000000000002e-05 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.019920+0000", 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014915600000000001 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020070+0000", 2024-09-20T21:01:55.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014949000000000001 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:70578 5.9 5:9d2cc99f:::benchmark_data_smithi112_23632_object70577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.020353+0000", 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0018521900000000001, 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002340258, 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 70578 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020353+0000", 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020353+0000", 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020354+0000", 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1699999999999997e-07 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020453+0000", 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8930000000000003e-05 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020463+0000", 2024-09-20T21:01:55.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0069e-05 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020467+0000", 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8709999999999996e-06 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020523+0000", 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5445999999999997e-05 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020660+0000", 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136768 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020820+0000", 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000159927 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:70580 5.0 5:098c749f:::benchmark_data_smithi112_23632_object70579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-20T21:01:55.052 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.020620+0000", 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001585368, 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002150707, 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 70580 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.053 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020620+0000", 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020620+0000", 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020620+0000", 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7199999999999998e-07 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020756+0000", 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135675 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020766+0000", 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.013e-05 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020773+0000", 2024-09-20T21:01:55.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3139999999999998e-06 2024-09-20T21:01:55.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020823+0000", 2024-09-20T21:01:55.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9252999999999998e-05 2024-09-20T21:01:55.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020914+0000", 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1039999999999996e-05 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.020996+0000", 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2025000000000002e-05 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:70567 5.b e33/21)", 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.021359+0000", 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00084580300000000001, 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0014753329999999999, 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021359+0000", 2024-09-20T21:01:55.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021359+0000", 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021360+0000", 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1299999999999999e-07 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021365+0000", 2024-09-20T21:01:55.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5229999999999997e-06 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021375+0000", 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0386e-05 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021382+0000", 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1280000000000002e-06 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.060 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:70581 5.8 5:13719a77:::benchmark_data_smithi112_23632_object70580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.021654+0000", 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00055057999999999995, 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001238903, 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 70581 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.061 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021654+0000", 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021654+0000", 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021655+0000", 2024-09-20T21:01:55.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9800000000000002e-07 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021727+0000", 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1279000000000007e-05 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021741+0000", 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3947999999999999e-05 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021748+0000", 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3889999999999999e-06 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021821+0000", 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2540999999999995e-05 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022012+0000", 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000191254 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022142+0000", 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000129763 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:70584 5.f 5:f7e9dcb3:::benchmark_data_smithi112_23632_object70583:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.021763+0000", 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00044254400000000001, 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0012100069999999999, 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.065 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 70584 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021763+0000", 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.066 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021763+0000", 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021763+0000", 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1600000000000001e-07 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021824+0000", 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0448999999999997e-05 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021832+0000", 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6170000000000007e-06 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021838+0000", 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8069999999999996e-06 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.021901+0000", 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2856999999999998e-05 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022045+0000", 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014457700000000001 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022183+0000", 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000137904 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.069 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:70583 5.a e33/21 5:565268d3:::benchmark_data_smithi112_23632_object70582:head v 33'4354, mlcod=33'4352)", 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:55.022453+0000", 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9997516, 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00059535800000000004, 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022453+0000", 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.070 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022453+0000", 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022454+0000", 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8400000000000004e-07 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022502+0000", 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.757e-05 2024-09-20T21:01:55.071 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022512+0000", 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0453e-05 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022518+0000", 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3709999999999996e-06 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022576+0000", 2024-09-20T21:01:55.072 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7113e-05 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:55.022595+0000", 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9003000000000001e-05 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 12 2024-09-20T21:01:55.073 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:55.075 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:55.075 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:55.072+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:55.175 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:55.172+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:55.242 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 28 15 71056 71041 158.557 134.625 0.00690877 0.00630245 2024-09-20T21:01:55.270 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:55.271 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:01:55.271 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:01:55.271 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:01:55.271 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:55.276 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:55.276+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:55.292 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:55.346 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:01:55.377 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:55.374+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:55.478 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:55.476+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:55.489 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 43.293512450000001, 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:01:55.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 43.293422413999998, 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.496 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:01:55.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:55.502 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 43.293336060999998, 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:01:55.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:01:55.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:01:55.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:01:55.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:01:55.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:01:55.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 43.293267252, 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:55.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:01:55.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:01:55.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 43.293234392000002, 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.515 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:01:55.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:55.521 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 43.293192374999997, 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:55.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:01:55.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 43.293067268999998, 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:01:55.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:01:55.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.533 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 43.292974919999999, 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:55.538 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 43.292890548000003, 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:01:55.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16441 5.4 5:231ae493:::benchmark_data_smithi112_23632_object16440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.265980376999998, 2024-09-20T21:01:55.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018694967999999999, 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16441 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:55.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223604+0000", 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0020000000000001e-06 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223754+0000", 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014907899999999999 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5207e-05 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223787+0000", 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8685000000000002e-05 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223852+0000", 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5012999999999996e-05 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017955400000000001 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224223+0000", 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000191428 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225787+0000", 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001563617 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242143+0000", 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01635615 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242235+0000", 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2250000000000006e-05 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242298+0000", 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2983000000000003e-05 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16442 5.0 5:07f91168:::benchmark_data_smithi112_23632_object16441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.265775563999998, 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018432022999999999, 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.549 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16442 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223808+0000", 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223809+0000", 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223867+0000", 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8365000000000001e-05 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223878+0000", 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.058e-05 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223886+0000", 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6490000000000008e-06 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223943+0000", 2024-09-20T21:01:55.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6879000000000002e-05 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224078+0000", 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135549 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224243+0000", 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016484900000000001 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226958+0000", 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027148490000000001 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242135+0000", 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015176858 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242185+0000", 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0254999999999999e-05 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242240+0000", 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.541e-05 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16446 5.0 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.265604244999999, 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018538079999999998, 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.555 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16446 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5799999999999999e-07 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224021+0000", 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1053000000000001e-05 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.111e-05 2024-09-20T21:01:55.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224040+0000", 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5480000000000004e-06 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225554+0000", 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001513749 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225818+0000", 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026389300000000002 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226084+0000", 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026617999999999998 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.227457+0000", 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013727030000000001 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242319+0000", 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014862492 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242426+0000", 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107291 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242518+0000", 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1403000000000006e-05 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.560 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:53511 5.4 5:2d6e90d5:::benchmark_data_smithi112_23632_object53510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.5258446639999992, 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018936089999999999, 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 53511 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.561 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963740+0000", 2024-09-20T21:01:55.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0800000000000004e-07 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963784+0000", 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3857999999999999e-05 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963796+0000", 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2e-05 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.563 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963803+0000", 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2259999999999999e-06 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.964837+0000", 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010340379999999999 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.964924+0000", 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6669000000000007e-05 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.965060+0000", 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136594 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969393+0000", 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0043331259999999996 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982603+0000", 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.013210095999999999 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982638+0000", 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4981999999999998e-05 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982675+0000", 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6893000000000001e-05 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:55.566 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.5274310920000005, 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.569 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:01:55.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:01:55.572 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.5268790860000001, 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:01:55.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:01:55.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.5262515050000003, 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.578 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:01:55.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:01:55.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:01:55.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.526140496, 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.584 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:01:55.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:01:55.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:01:55.589 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.5224739840000003, 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:01:55.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:01:55.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.5221596499999999, 2024-09-20T21:01:55.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:01:55.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:01:55.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.5219775320000002, 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:55.601 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:01:55.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:01:55.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:01:55.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:01:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:01:55.607 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.607 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.607 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.607 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:55.607 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:55.607 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:55.608 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:55.606+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:55.609 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:55.709 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:55.708+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:55.755 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:72089 5.2 e34/21)", 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.754378+0000", 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001076731, 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010894120000000001, 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754378+0000", 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754378+0000", 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754378+0000", 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1699999999999998e-07 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754381+0000", 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0539999999999999e-06 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754392+0000", 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.062e-05 2024-09-20T21:01:55.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754398+0000", 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1149999999999999e-06 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:72097 5.a 5.286469ca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.754489+0000", 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00096550800000000001, 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001008782, 2024-09-20T21:01:55.759 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 72097 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754489+0000", 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754489+0000", 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754490+0000", 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0920000000000001e-06 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754636+0000", 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014630099999999999 2024-09-20T21:01:55.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754651+0000", 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4867e-05 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754659+0000", 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4919999999999996e-06 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:72088 5.c 5:3690ec82:::benchmark_data_smithi112_23632_object72087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.748656+0000", 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0067981550000000002, 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006877172, 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 72088 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.763 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.748656+0000", 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.748656+0000", 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.748657+0000", 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7e-07 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.748692+0000", 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5447000000000001e-05 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.748701+0000", 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7159999999999992e-06 2024-09-20T21:01:55.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.748706+0000", 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.938e-06 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751018+0000", 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023117469999999998 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:55.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751489+0000", 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00047173099999999997 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751675+0000", 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185465 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754327+0000", 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002651675 2024-09-20T21:01:55.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:72078 5.b e34/21 5:d2eb878c:::benchmark_data_smithi112_23632_object72077:head v 34'4600, mlcod=34'4594)", 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.749955+0000", 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.005499543, 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056215070000000004, 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.749955+0000", 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.749955+0000", 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.749956+0000", 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0500000000000003e-07 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.750051+0000", 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5585e-05 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.750061+0000", 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0009e-05 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.750068+0000", 2024-09-20T21:01:55.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0550000000000002e-06 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751812+0000", 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00174384 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751829+0000", 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7346999999999998e-05 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:72089 5.2 5:419d7bcc:::benchmark_data_smithi112_23632_object72088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.750979+0000", 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0044754269999999997, 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046332639999999998, 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 72089 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.772 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.750979+0000", 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.750979+0000", 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.750980+0000", 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.102e-06 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751010+0000", 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9867999999999999e-05 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751021+0000", 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1117999999999999e-05 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751028+0000", 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9439999999999999e-06 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751080+0000", 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.202e-05 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751217+0000", 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000136847 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751372+0000", 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015543800000000001 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:72091 5.a 5:59462e59:::benchmark_data_smithi112_23632_object72090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.751812+0000", 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0036421180000000002, 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038722969999999998, 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 72091 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751812+0000", 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751812+0000", 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751813+0000", 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.23e-07 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751961+0000", 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014760700000000001 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751969+0000", 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.174e-06 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.751973+0000", 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3760000000000001e-06 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752016+0000", 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2901000000000001e-05 2024-09-20T21:01:55.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752135+0000", 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011862 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752254+0000", 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011959 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.780 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:72094 5.a 5:546cff07:::benchmark_data_smithi112_23632_object72093:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.752080+0000", 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0033746539999999999, 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0036796350000000001, 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 72094 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752080+0000", 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752080+0000", 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752081+0000", 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7899999999999997e-07 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752173+0000", 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2702999999999997e-05 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752182+0000", 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4509999999999992e-06 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752188+0000", 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9959999999999999e-06 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.753894+0000", 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001706377 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.753994+0000", 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9628000000000002e-05 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754095+0000", 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100777 2024-09-20T21:01:55.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:72095 5.a 5:50323b9e:::benchmark_data_smithi112_23632_object72094:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.752199+0000", 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0032558859999999999, 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003640973, 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:55.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 72095 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752199+0000", 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752199+0000", 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752199+0000", 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9299999999999998e-07 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752235+0000", 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6189000000000002e-05 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752243+0000", 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6590000000000007e-06 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752249+0000", 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4480000000000002e-06 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.755667+0000", 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034185420000000001 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.755812+0000", 2024-09-20T21:01:55.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014442 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:72081 5.b e34/21 5:df68bf87:::benchmark_data_smithi112_23632_object72080:head v 34'4601, mlcod=34'4596)", 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.752219+0000", 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0032352129999999998, 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0036885049999999999, 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752219+0000", 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752219+0000", 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752220+0000", 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8599999999999998e-07 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752248+0000", 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7733999999999999e-05 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752257+0000", 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3049999999999998e-06 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752263+0000", 2024-09-20T21:01:55.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1e-06 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.753377+0000", 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011134109999999999 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.753388+0000", 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1756000000000001e-05 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.792 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:72093 5.4 e34/21 5:2afbaeee:::benchmark_data_smithi112_23632_object72092:head v 34'4553, mlcod=34'4551)", 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.752436+0000", 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003018139, 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035322050000000001, 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752436+0000", 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752436+0000", 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752437+0000", 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000002e-07 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752509+0000", 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1921000000000005e-05 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752517+0000", 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.994e-06 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.752522+0000", 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1590000000000001e-06 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754208+0000", 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001685853 2024-09-20T21:01:55.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754228+0000", 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0171999999999999e-05 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:72084 5.b e34/21 5:d706e878:::benchmark_data_smithi112_23632_object72083:head v 34'4602, mlcod=34'4596)", 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:55.753735+0000", 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001720007, 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023413539999999999, 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:55.796 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.753735+0000", 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.753735+0000", 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.753735+0000", 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3600000000000003e-07 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.753782+0000", 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6501000000000001e-05 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.753791+0000", 2024-09-20T21:01:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3659999999999998e-06 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.753797+0000", 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2859999999999996e-06 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754744+0000", 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00094635100000000001 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:55.754754+0000", 2024-09-20T21:01:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0265000000000001e-05 2024-09-20T21:01:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:01:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 11 2024-09-20T21:01:55.800 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:55.800 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:01:55.801 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:55.810 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:55.808+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:55.910 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:55.906+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:55.964 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:55.965 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:55.965 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:55.982 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:55.983 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:55.987 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:56.002 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:56.002 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:56.031 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:56.030+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:56.112 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:56.112+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:56.182 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:56.182 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:56.204 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:56.213 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:56.210+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:56.242 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 29 16 73103 73087 157.498 127.875 0.00852062 0.00634443 2024-09-20T21:01:56.314 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:56.312+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:56.352 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:56.352 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:56.373 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:56.415 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:56.412+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:56.516 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:56.512+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:56.521 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:56.522 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:56.544 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:56.617 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:56.616+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:56.719 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:56.714+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:56.755 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:56.819 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:56.814+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:56.913 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:56.913 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:56.919 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:56.916+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:56.934 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:57.020 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:57.016+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:57.121 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:57.120+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:57.132 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:57.132 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:57.151 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:57.222 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:57.218+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:57.242 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 30 16 75213 75197 156.644 131.875 0.0115888 0.00637936 2024-09-20T21:01:57.310 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:57.310 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:57.323 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:57.320+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:57.330 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:57.373 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:01:57.424 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:57.424+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:57.483 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:57.483 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:57.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:57.525 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:57.524+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:57.626 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:57.624+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:57.658 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:57.658 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:57.679 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:57.727 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:57.726+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:57.828 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:57.826+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:57.838 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:57.838 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:57.860 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:57.929 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:57.926+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:58.010 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:01:58.010 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:01:58.020 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:01:58.029 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:58.028+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:58.031 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:01:58.130 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:58.128+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:58.181 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:01:58.182 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:01:58.200 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:01:58.200 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:01:58.218 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:01:58.218 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:01:58.221 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:58.222 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:01:58.222 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:01:58.222 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:01:58.222 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:58.231 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:58.230+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:58.242 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 31 16 77274 77258 155.746 128.812 0.00538825 0.00641615 2024-09-20T21:01:58.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:01:58.331 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:58.328+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:58.343 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T21:01:58.343 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:01:58.343 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-20T21:01:58.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-20T21:01:58.363 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:01:58.391 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:01:58.391 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:01:58.391 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:01:58.391 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:01:58.391 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.391 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:58.391 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:58.391 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 56.426985344000002, 2024-09-20T21:01:58.391 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.392 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.393 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:01:58.394 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.395 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.396 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.397 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.421990569999998, 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:01:58.398 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.399 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:01:58.400 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.401 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.402 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:01:58.403 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.404 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.404 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.404 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:01:58.404 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:01:58.404 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.404 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.404 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.404 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.404 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.404 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.194051174000002, 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.405 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:01:58.406 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.407 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:01:58.408 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:01:58.408 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.408 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.408 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.408 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:01:58.408 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:01:58.408 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.409 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.409 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.409 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:01:58.409 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.410 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.411 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.193903955000003, 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.412 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.413 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:01:58.414 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.415 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.416 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.193778023, 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.417 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.418 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.419 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:01:58.420 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:01:58.421 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.422 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.193693426999999, 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:58.423 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:58.424 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:01:58.425 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.426 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.427 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.428 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.193375826, 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.429 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.430 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.432 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:01:58.433 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.193274109999997, 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.435 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:01:58.436 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.437 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:01:58.438 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.439 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.193193514000001, 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.440 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:01:58.441 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.442 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.443 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.444 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.193116447999998, 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.445 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.446 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:01:58.447 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:01:58.448 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:01:58.449 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:58.450 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.192904980000002, 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:58.451 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.452 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.453 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.454 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.455 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.192829142999997, 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.456 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:01:58.457 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.458 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.459 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.460 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.461 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.192707081000002, 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.462 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.463 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:01:58.464 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:01:58.465 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:01:58.466 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.192638832, 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.467 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.468 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.469 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.470 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:01:58.471 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.472 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.192546045999997, 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.473 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.474 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:01:58.475 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:01:58.476 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.477 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.192484190000002, 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.478 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:01:58.479 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:01:58.480 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.481 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.482 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:58.483 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.192401814, 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:01:58.484 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.485 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.486 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:01:58.487 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.488 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.192317254000002, 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.489 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:01:58.490 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.491 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.492 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.493 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.494 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.192253348000001, 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.495 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:01:58.496 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:01:58.497 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:01:58.498 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.499 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 46.192190605, 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:01:58.500 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:01:58.501 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.502 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:01:58.503 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:01:58.504 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:01:58.504 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:01:58.504 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:01:58.504 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:01:58.504 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.504 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.504 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.504 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:01:58.504 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:01:58.504 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:01:58.506 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:01:58.506 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:58.504+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:58.606 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:58.603+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:58.659 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:58.659 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-20T21:01:58.659 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 35, 2024-09-20T21:01:58.659 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "095c2509-1828-40cb-9515-44c079c52d3b", 2024-09-20T21:01:58.659 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-20T21:00:50.259405+0000", 2024-09-20T21:01:58.659 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-20T21:01:58.350758+0000", 2024-09-20T21:01:58.659 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-20T21:00:59.725541+0000", 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-20T21:00:51.161270+0000", 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.94999998807907104, 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-20T21:01:58.660 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 5, 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 3, 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-20T21:01:00.930905+0000", 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-20T21:01:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-20T21:01:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "11", 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T21:01:58.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-20T21:01:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.665 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-20T21:01:58.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-09-20T21:01:58.667 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 2, 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "rbd", 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-20T21:01:05.455429+0000", 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 8193, 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-20T21:01:58.668 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 8, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 8, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 8, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 8, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 8, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-20T21:01:58.669 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "15", 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 2, 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 15, 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-20T21:01:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-20T21:01:58.671 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-20T21:01:58.672 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "options": {}, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd": {} 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.25, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.25, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1.5, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-20T21:01:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 3, 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-20T21:01:10.047761+0000", 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-20T21:01:58.674 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-20T21:01:58.675 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "18", 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-20T21:01:58.676 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T21:01:58.677 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T21:01:58.678 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.190000057220459, 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.190000057220459, 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1.5, 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.7799999713897705, 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.7799999713897705, 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 4, 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-20T21:01:10.524533+0000", 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T21:01:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-20T21:01:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "19", 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-20T21:01:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-20T21:01:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-20T21:01:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-20T21:01:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1, 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1, 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1.5, 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.5, 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.5, 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 5, 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "unique_pool_0", 2024-09-20T21:01:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-20T21:01:24.988072+0000", 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-20T21:01:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 16, 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 16, 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 16, 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 16, 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 16, 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "23", 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-20T21:01:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-20T21:01:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "options": {}, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "rados": {} 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1, 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1, 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1.5, 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.5, 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.5, 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-20T21:01:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "238496db-6b3e-463e-90eb-e476e93f06e3", 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 8, 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 21, 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-20T21:01:58.694 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.139:6800", 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2576994201 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.139:6801", 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2576994201 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.695 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.139:6802", 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2576994201 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.139:6803", 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2576994201 2024-09-20T21:01:58.696 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.139:6806", 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2576994201 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.697 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.139:6807", 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2576994201 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.139:6804", 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2576994201 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.698 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.139:6805", 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2576994201 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.139:6801/2576994201", 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.139:6803/2576994201", 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2576994201", 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2576994201", 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "5e46dfeb-5456-40e0-b0a3-d85993becaef", 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 0, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 8, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 17, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-20T21:01:58.700 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.161:6800", 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2769075992 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.161:6801", 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2769075992 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.701 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.161:6802", 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2769075992 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.161:6803", 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2769075992 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.702 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.161:6806", 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2769075992 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.161:6807", 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2769075992 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.703 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.161:6804", 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2769075992 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.161:6805", 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2769075992 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.161:6801/2769075992", 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.161:6803/2769075992", 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.161:6807/2769075992", 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.161:6805/2769075992", 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "f5e294ac-6f79-4615-93d7-8870379d28e4", 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-20T21:01:58.705 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 8, 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 21, 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.203:6800", 2024-09-20T21:01:58.706 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1237842363 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.203:6801", 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1237842363 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.203:6802", 2024-09-20T21:01:58.707 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1237842363 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.203:6803", 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1237842363 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.203:6806", 2024-09-20T21:01:58.708 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1237842363 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.203:6807", 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1237842363 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.203:6804", 2024-09-20T21:01:58.709 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1237842363 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.203:6805", 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1237842363 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.203:6801/1237842363", 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.203:6803/1237842363", 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.203:6807/1237842363", 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.203:6805/1237842363", 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-20T21:01:58.710 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-20T21:01:58.711 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-20T21:00:57.078073+0000", 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-20T21:00:57.075785+0000", 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-20T21:01:58.712 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-20T21:00:57.190829+0000", 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-20T21:01:58.713 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-20T21:01:58.714 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-20T21:01:58.715 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-20T21:01:58.715 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-20T21:01:58.715 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-20T21:01:58.715 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-20T21:01:58.715 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-20T21:01:58.715 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-20T21:01:58.715 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-20T21:01:58.715 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-20T21:01:58.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-20T21:01:58.715 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-20T21:01:58.717 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:58.712+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:78129 5.4 5:27cccd2d:::benchmark_data_smithi112_23632_object78128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.653403+0000", 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0076596269999999996, 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0076797209999999996, 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:58.718 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 78129 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653403+0000", 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:58.719 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653403+0000", 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653403+0000", 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.99e-07 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653459+0000", 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5486999999999999e-05 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.720 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653468+0000", 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9870000000000005e-06 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653473+0000", 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1959999999999999e-06 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653513+0000", 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9820999999999997e-05 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653637+0000", 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000124497 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653764+0000", 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012662900000000001 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660115+0000", 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0063506630000000003 2024-09-20T21:01:58.722 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:78130 5.b 5:df62755a:::benchmark_data_smithi112_23632_object78129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.653587+0000", 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0074750880000000004, 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0075591920000000002, 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:58.723 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 78130 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653587+0000", 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653587+0000", 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653588+0000", 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4e-07 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653674+0000", 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5765000000000003e-05 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653682+0000", 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4300000000000006e-06 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.725 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653687+0000", 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9490000000000004e-06 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653725+0000", 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7555999999999998e-05 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653803+0000", 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8213999999999993e-05 2024-09-20T21:01:58.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.653881+0000", 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8064000000000003e-05 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:78138 5.b 5:d2fd3cf8:::benchmark_data_smithi112_23632_object78137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.656461+0000", 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00460145, 2024-09-20T21:01:58.727 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047279610000000001, 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 78138 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656461+0000", 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.728 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656461+0000", 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656462+0000", 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0729999999999999e-06 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656537+0000", 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5309999999999996e-05 2024-09-20T21:01:58.729 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656548+0000", 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0368e-05 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656553+0000", 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5489999999999997e-06 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656598+0000", 2024-09-20T21:01:58.730 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4319e-05 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656679+0000", 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1493000000000001e-05 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656762+0000", 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2651000000000005e-05 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.731 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:78137 5.a e35/21 5:52c97a36:::benchmark_data_smithi112_23632_object78136:head v 35'4854, mlcod=35'4851)", 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.656781+0000", 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0042812650000000002, 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0044915729999999996, 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656781+0000", 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.732 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656781+0000", 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656782+0000", 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9500000000000002e-07 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656822+0000", 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0074000000000003e-05 2024-09-20T21:01:58.733 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656830+0000", 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7710000000000006e-06 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656837+0000", 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1620000000000002e-06 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.734 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656884+0000", 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7561000000000001e-05 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.656903+0000", 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9157e-05 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.735 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:78139 5.8 5:11ee66c1:::benchmark_data_smithi112_23632_object78138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.657924+0000", 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0031379849999999998, 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00341071, 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 78139 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.736 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.657924+0000", 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.657924+0000", 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.657925+0000", 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0130000000000001e-06 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.737 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.657995+0000", 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9512999999999997e-05 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.658007+0000", 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2048000000000001e-05 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.658014+0000", 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2840000000000001e-06 2024-09-20T21:01:58.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.658062+0000", 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7590999999999999e-05 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.658154+0000", 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2571999999999994e-05 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:58.739 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.658236+0000", 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1501000000000005e-05 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.661331+0000", 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0030949580000000001 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:78140 5.b 5:d99bafb4:::benchmark_data_smithi112_23632_object78139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.659469+0000", 2024-09-20T21:01:58.740 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0015936660000000001, 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00197117, 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 78140 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:58.741 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.659469+0000", 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.659469+0000", 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.659469+0000", 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7499999999999999e-07 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.742 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.659535+0000", 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5924000000000001e-05 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.659545+0000", 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8060000000000006e-06 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.659551+0000", 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8799999999999996e-06 2024-09-20T21:01:58.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.659605+0000", 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3823000000000003e-05 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.659691+0000", 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5742999999999995e-05 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:58.744 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.659772+0000", 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1032000000000006e-05 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:78141 5.4 5:23af94ac:::benchmark_data_smithi112_23632_object78140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.660276+0000", 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00078623500000000004, 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001243475, 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:58.745 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 78141 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660276+0000", 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660276+0000", 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660277+0000", 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2399999999999997e-07 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660319+0000", 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1820999999999998e-05 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.747 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660330+0000", 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0949e-05 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660336+0000", 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9449999999999998e-06 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660388+0000", 2024-09-20T21:01:58.748 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2475999999999997e-05 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660506+0000", 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000117422 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660676+0000", 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000170846 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:58.749 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:78143 5.9 5:9f2138d7:::benchmark_data_smithi112_23632_object78142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.660349+0000", 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00071340399999999995, 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001245976, 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:58.750 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 78143 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660349+0000", 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660349+0000", 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.751 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660349+0000", 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7599999999999997e-07 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660486+0000", 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013678400000000001 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660496+0000", 2024-09-20T21:01:58.752 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5910000000000002e-06 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660503+0000", 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1400000000000002e-06 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660559+0000", 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5742999999999998e-05 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660700+0000", 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000140965 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.660847+0000", 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014688200000000001 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:78145 5.0 5.e12cbb00 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:58.754 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.661299+0000", 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9997635, 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00033359299999999998, 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 78145 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:58.755 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.661299+0000", 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.661299+0000", 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.661300+0000", 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8400000000000002e-07 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.756 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.661385+0000", 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4851999999999993e-05 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.661401+0000", 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5792000000000001e-05 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.661408+0000", 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3939999999999998e-06 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.757 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:58.758 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.758 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:58.758 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:01:58.758 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 9 2024-09-20T21:01:58.758 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:58.759 INFO:tasks.thrashosds.thrasher:j is {'epoch': 35, 'fsid': '095c2509-1828-40cb-9515-44c079c52d3b', 'created': '2024-09-20T21:00:50.259405+0000', 'modified': '2024-09-20T21:01:58.350758+0000', 'last_up_change': '2024-09-20T21:00:59.725541+0000', 'last_in_change': '2024-09-20T21:00:51.161270+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-20T21:01:00.930905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-20T21:01:05.455429+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1.5, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-20T21:01:10.047761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1.5, 'raw_score_acting': 1.7799999713897705, 'raw_score_stable': 1.7799999713897705, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-20T21:01:10.524533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1, 'score_stable': 1, 'optimal_score': 1.5, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-20T21:01:24.988072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1, 'score_stable': 1, 'optimal_score': 1.5, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}], 'osds': [{'osd': 0, 'uuid': '238496db-6b3e-463e-90eb-e476e93f06e3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2576994201}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2576994201}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2576994201}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2576994201}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2576994201}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2576994201}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2576994201}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2576994201}]}, 'public_addr': '172.21.15.139:6801/2576994201', 'cluster_addr': '172.21.15.139:6803/2576994201', 'heartbeat_back_addr': '172.21.15.139:6807/2576994201', 'heartbeat_front_addr': '172.21.15.139:6805/2576994201', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '5e46dfeb-5456-40e0-b0a3-d85993becaef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6800', 'nonce': 2769075992}, {'type': 'v1', 'addr': '172.21.15.161:6801', 'nonce': 2769075992}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6802', 'nonce': 2769075992}, {'type': 'v1', 'addr': '172.21.15.161:6803', 'nonce': 2769075992}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6806', 'nonce': 2769075992}, {'type': 'v1', 'addr': '172.21.15.161:6807', 'nonce': 2769075992}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6804', 'nonce': 2769075992}, {'type': 'v1', 'addr': '172.21.15.161:6805', 'nonce': 2769075992}]}, 'public_addr': '172.21.15.161:6801/2769075992', 'cluster_addr': '172.21.15.161:6803/2769075992', 'heartbeat_back_addr': '172.21.15.161:6807/2769075992', 'heartbeat_front_addr': '172.21.15.161:6805/2769075992', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f5e294ac-6f79-4615-93d7-8870379d28e4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6800', 'nonce': 1237842363}, {'type': 'v1', 'addr': '172.21.15.203:6801', 'nonce': 1237842363}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6802', 'nonce': 1237842363}, {'type': 'v1', 'addr': '172.21.15.203:6803', 'nonce': 1237842363}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6806', 'nonce': 1237842363}, {'type': 'v1', 'addr': '172.21.15.203:6807', 'nonce': 1237842363}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6804', 'nonce': 1237842363}, {'type': 'v1', 'addr': '172.21.15.203:6805', 'nonce': 1237842363}]}, 'public_addr': '172.21.15.203:6801/1237842363', 'cluster_addr': '172.21.15.203:6803/1237842363', 'heartbeat_back_addr': '172.21.15.203:6807/1237842363', 'heartbeat_front_addr': '172.21.15.203:6805/1237842363', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T21:00:57.078073+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T21:00:57.075785+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T21:00:57.190829+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-20T21:01:58.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:01:58.760 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:01:58.818 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:58.816+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:58.916 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:58.916 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:01:58.917 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:01:58.917 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:01:58.917 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:58.919 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:58.917+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:58.937 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:01:59.020 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:59.015+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:01:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:01:59.100 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:01:59.100 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:01:59.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:01:59.100 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.903709143, 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:59.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:01:59.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:01:59.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.903619106999997, 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:01:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.108 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:01:59.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:59.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.113 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.903532753999997, 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.114 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:01:59.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:01:59.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:01:59.120 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.120 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.120 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.120 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.120 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:59.120 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.903463944999999, 2024-09-20T21:01:59.120 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:01:59.120 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:59.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:01:59.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:01:59.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:01:59.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:01:59.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:01:59.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.125 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:01:59.127 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.903431085000001, 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:01:59.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:01:59.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:01:59.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:01:59.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:01:59.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:01:59.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:01:59.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.903389068000003, 2024-09-20T21:01:59.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:01:59.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:01:59.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:01:59.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.903263961999997, 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.141 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:01:59.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.903171612999998, 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:01:59.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.152 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.903087241000001, 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:01:59.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:01:59.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:01:59.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:01:59.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16441 5.4 5:231ae493:::benchmark_data_smithi112_23632_object16440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 26.876177070000001, 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018694967999999999, 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16441 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223604+0000", 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0020000000000001e-06 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223754+0000", 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014907899999999999 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5207e-05 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223787+0000", 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8685000000000002e-05 2024-09-20T21:01:59.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223852+0000", 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5012999999999996e-05 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017955400000000001 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224223+0000", 2024-09-20T21:01:59.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000191428 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225787+0000", 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001563617 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242143+0000", 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01635615 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242235+0000", 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2250000000000006e-05 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242298+0000", 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2983000000000003e-05 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.164 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16446 5.0 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 26.875800938000001, 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018538079999999998, 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16446 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:59.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:59.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:01:59.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5799999999999999e-07 2024-09-20T21:01:59.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224021+0000", 2024-09-20T21:01:59.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1053000000000001e-05 2024-09-20T21:01:59.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.111e-05 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224040+0000", 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5480000000000004e-06 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225554+0000", 2024-09-20T21:01:59.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001513749 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225818+0000", 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026389300000000002 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226084+0000", 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026617999999999998 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.227457+0000", 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013727030000000001 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242319+0000", 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014862492 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242426+0000", 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107291 2024-09-20T21:01:59.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242518+0000", 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1403000000000006e-05 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:53511 5.4 5:2d6e90d5:::benchmark_data_smithi112_23632_object53510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:01:59.171 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 12.136041357, 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018936089999999999, 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 53511 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:01:59.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963740+0000", 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0800000000000004e-07 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963784+0000", 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3857999999999999e-05 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963796+0000", 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2e-05 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963803+0000", 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2259999999999999e-06 2024-09-20T21:01:59.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.964837+0000", 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010340379999999999 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.964924+0000", 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6669000000000007e-05 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.965060+0000", 2024-09-20T21:01:59.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136594 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969393+0000", 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0043331259999999996 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982603+0000", 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.013210095999999999 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982638+0000", 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4981999999999998e-05 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982675+0000", 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6893000000000001e-05 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:59.177 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.1376277849999994, 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:01:59.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:01:59.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:01:59.183 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.1370757789999999, 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.184 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:01:59.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:01:59.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:01:59.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:01:59.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.1364481980000001, 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.190 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:01:59.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:01:59.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:01:59.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:01:59.196 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.1363371890000007, 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.197 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:01:59.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:59.202 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:01:59.203 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.1326706770000001, 2024-09-20T21:01:59.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:01:59.203 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.203 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.203 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.203 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.203 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.203 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.203 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:01:59.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.1323563429999997, 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:01:59.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.214 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.215 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.215 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:59.215 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:01:59.215 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.132174225, 2024-09-20T21:01:59.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:01:59.215 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.215 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.216 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.216 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.216 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.216 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.216 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:01:59.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.216 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:01:59.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:01:59.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.221 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:78251 5.4 5:2834294e:::benchmark_data_smithi112_23632_object78250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.712374+0000", 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.387406906, 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019217326999999999, 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:01:59.222 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 78251 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712374+0000", 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712374+0000", 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712374+0000", 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4700000000000001e-07 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712439+0000", 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4790999999999997e-05 2024-09-20T21:01:59.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712447+0000", 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0069999999999997e-06 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712452+0000", 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1959999999999999e-06 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.716939+0000", 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0044865620000000004 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.717044+0000", 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000104867 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:01:59.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.717169+0000", 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012548 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.722430+0000", 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0052605880000000001 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.731515+0000", 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0090854549999999992 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.731549+0000", 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3485999999999998e-05 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.731591+0000", 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2348000000000002e-05 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:01:59.228 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:01:59.230 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:59.225+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:59.231 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-20T21:01:58.871971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4617472925,"num_objects":70474,"num_object_clones":0,"num_object_copies":140948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70474,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":70698,"num_write_kb":4512148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60847,"ondisk_log_size":60847,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":785908,"kb_used_data":553512,"kb_used_omap":4,"kb_used_meta":232315,"kb_avail":282329612,"statfs":{"total":289910292480,"available":289105522688,"internally_reserved":0,"allocated":566796288,"data_stored":9051227256,"data_compressed":43359466,"data_compressed_allocated":565686272,"data_compressed_original":9050816512,"omap_allocated":4788,"internal_metadata":237890892},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,4,6,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":684064768,"num_objects":10438,"num_object_clones":0,"num_object_copies":20876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10438,"num_write_kb":668032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002024"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321295+0000","last_change":"2024-09-20T21:01:12.240709+0000","last_active":"2024-09-20T21:01:53.321295+0000","last_peered":"2024-09-20T21:01:53.321295+0000","last_clean":"2024-09-20T21:01:53.321295+0000","last_became_active":"2024-09-20T21:01:12.239599+0000","last_became_peered":"2024-09-20T21:01:12.239599+0000","last_unstale":"2024-09-20T21:01:53.321295+0000","last_undegraded":"2024-09-20T21:01:53.321295+0000","last_fullsized":"2024-09-20T21:01:53.321295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.320818+0000","last_change":"2024-09-20T21:01:12.236761+0000","last_active":"2024-09-20T21:01:53.320818+0000","last_peered":"2024-09-20T21:01:53.320818+0000","last_clean":"2024-09-20T21:01:53.320818+0000","last_became_active":"2024-09-20T21:01:12.235613+0000","last_became_peered":"2024-09-20T21:01:12.235613+0000","last_unstale":"2024-09-20T21:01:53.320818+0000","last_undegraded":"2024-09-20T21:01:53.320818+0000","last_fullsized":"2024-09-20T21:01:53.320818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322280+0000","last_change":"2024-09-20T21:01:26.196187+0000","last_active":"2024-09-20T21:01:53.322280+0000","last_peered":"2024-09-20T21:01:53.322280+0000","last_clean":"2024-09-20T21:01:53.322280+0000","last_became_active":"2024-09-20T21:01:26.194809+0000","last_became_peered":"2024-09-20T21:01:26.194809+0000","last_unstale":"2024-09-20T21:01:53.322280+0000","last_undegraded":"2024-09-20T21:01:53.322280+0000","last_fullsized":"2024-09-20T21:01:53.322280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:32:57.333723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322029+0000","last_change":"2024-09-20T21:01:26.187140+0000","last_active":"2024-09-20T21:01:53.322029+0000","last_peered":"2024-09-20T21:01:53.322029+0000","last_clean":"2024-09-20T21:01:53.322029+0000","last_became_active":"2024-09-20T21:01:26.184626+0000","last_became_peered":"2024-09-20T21:01:26.184626+0000","last_unstale":"2024-09-20T21:01:53.322029+0000","last_undegraded":"2024-09-20T21:01:53.322029+0000","last_fullsized":"2024-09-20T21:01:53.322029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:23.486608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321121+0000","last_change":"2024-09-20T21:01:12.232080+0000","last_active":"2024-09-20T21:01:53.321121+0000","last_peered":"2024-09-20T21:01:53.321121+0000","last_clean":"2024-09-20T21:01:53.321121+0000","last_became_active":"2024-09-20T21:01:12.231429+0000","last_became_peered":"2024-09-20T21:01:12.231429+0000","last_unstale":"2024-09-20T21:01:53.321121+0000","last_undegraded":"2024-09-20T21:01:53.321121+0000","last_fullsized":"2024-09-20T21:01:53.321121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321519+0000","last_change":"2024-09-20T21:01:26.187112+0000","last_active":"2024-09-20T21:01:53.321519+0000","last_peered":"2024-09-20T21:01:53.321519+0000","last_clean":"2024-09-20T21:01:53.321519+0000","last_became_active":"2024-09-20T21:01:26.185335+0000","last_became_peered":"2024-09-20T21:01:26.185335+0000","last_unstale":"2024-09-20T21:01:53.321519+0000","last_undegraded":"2024-09-20T21:01:53.321519+0000","last_fullsized":"2024-09-20T21:01:53.321519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:16.681572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321211+0000","last_change":"2024-09-20T21:01:26.195111+0000","last_active":"2024-09-20T21:01:53.321211+0000","last_peered":"2024-09-20T21:01:53.321211+0000","last_clean":"2024-09-20T21:01:53.321211+0000","last_became_active":"2024-09-20T21:01:26.194334+0000","last_became_peered":"2024-09-20T21:01:26.194334+0000","last_unstale":"2024-09-20T21:01:53.321211+0000","last_undegraded":"2024-09-20T21:01:53.321211+0000","last_fullsized":"2024-09-20T21:01:53.321211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:32.305202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321147+0000","last_change":"2024-09-20T21:01:26.187350+0000","last_active":"2024-09-20T21:01:53.321147+0000","last_peered":"2024-09-20T21:01:53.321147+0000","last_clean":"2024-09-20T21:01:53.321147+0000","last_became_active":"2024-09-20T21:01:26.185422+0000","last_became_peered":"2024-09-20T21:01:26.185422+0000","last_unstale":"2024-09-20T21:01:53.321147+0000","last_undegraded":"2024-09-20T21:01:53.321147+0000","last_fullsized":"2024-09-20T21:01:53.321147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:54:07.656861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321619+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:01:53.321619+0000","last_peered":"2024-09-20T21:01:53.321619+0000","last_clean":"2024-09-20T21:01:53.321619+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:01:53.321619+0000","last_undegraded":"2024-09-20T21:01:53.321619+0000","last_fullsized":"2024-09-20T21:01:53.321619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.320987+0000","last_change":"2024-09-20T21:01:12.240432+0000","last_active":"2024-09-20T21:01:53.320987+0000","last_peered":"2024-09-20T21:01:53.320987+0000","last_clean":"2024-09-20T21:01:53.320987+0000","last_became_active":"2024-09-20T21:01:12.238826+0000","last_became_peered":"2024-09-20T21:01:12.238826+0000","last_unstale":"2024-09-20T21:01:53.320987+0000","last_undegraded":"2024-09-20T21:01:53.320987+0000","last_fullsized":"2024-09-20T21:01:53.320987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321559+0000","last_change":"2024-09-20T21:01:26.195459+0000","last_active":"2024-09-20T21:01:53.321559+0000","last_peered":"2024-09-20T21:01:53.321559+0000","last_clean":"2024-09-20T21:01:53.321559+0000","last_became_active":"2024-09-20T21:01:26.194481+0000","last_became_peered":"2024-09-20T21:01:26.194481+0000","last_unstale":"2024-09-20T21:01:53.321559+0000","last_undegraded":"2024-09-20T21:01:53.321559+0000","last_fullsized":"2024-09-20T21:01:53.321559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:26.903534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321584+0000","last_change":"2024-09-20T21:01:12.229580+0000","last_active":"2024-09-20T21:01:53.321584+0000","last_peered":"2024-09-20T21:01:53.321584+0000","last_clean":"2024-09-20T21:01:53.321584+0000","last_became_active":"2024-09-20T21:01:12.226915+0000","last_became_peered":"2024-09-20T21:01:12.226915+0000","last_unstale":"2024-09-20T21:01:53.321584+0000","last_undegraded":"2024-09-20T21:01:53.321584+0000","last_fullsized":"2024-09-20T21:01:53.321584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.985765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.320903+0000","last_change":"2024-09-20T21:01:12.230410+0000","last_active":"2024-09-20T21:01:53.320903+0000","last_peered":"2024-09-20T21:01:53.320903+0000","last_clean":"2024-09-20T21:01:53.320903+0000","last_became_active":"2024-09-20T21:01:12.229859+0000","last_became_peered":"2024-09-20T21:01:12.229859+0000","last_unstale":"2024-09-20T21:01:53.320903+0000","last_undegraded":"2024-09-20T21:01:53.320903+0000","last_fullsized":"2024-09-20T21:01:53.320903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.320613+0000","last_change":"2024-09-20T21:01:26.184671+0000","last_active":"2024-09-20T21:01:53.320613+0000","last_peered":"2024-09-20T21:01:53.320613+0000","last_clean":"2024-09-20T21:01:53.320613+0000","last_became_active":"2024-09-20T21:01:26.183545+0000","last_became_peered":"2024-09-20T21:01:26.183545+0000","last_unstale":"2024-09-20T21:01:53.320613+0000","last_undegraded":"2024-09-20T21:01:53.320613+0000","last_fullsized":"2024-09-20T21:01:53.320613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:55.984268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322226+0000","last_change":"2024-09-20T21:01:26.190382+0000","last_active":"2024-09-20T21:01:53.322226+0000","last_peered":"2024-09-20T21:01:53.322226+0000","last_clean":"2024-09-20T21:01:53.322226+0000","last_became_active":"2024-09-20T21:01:26.186214+0000","last_became_peered":"2024-09-20T21:01:26.186214+0000","last_unstale":"2024-09-20T21:01:53.322226+0000","last_undegraded":"2024-09-20T21:01:53.322226+0000","last_fullsized":"2024-09-20T21:01:53.322226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:54:07.656861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321283+0000","last_change":"2024-09-20T21:01:26.186757+0000","last_active":"2024-09-20T21:01:53.321283+0000","last_peered":"2024-09-20T21:01:53.321283+0000","last_clean":"2024-09-20T21:01:53.321283+0000","last_became_active":"2024-09-20T21:01:26.184738+0000","last_became_peered":"2024-09-20T21:01:26.184738+0000","last_unstale":"2024-09-20T21:01:53.321283+0000","last_undegraded":"2024-09-20T21:01:53.321283+0000","last_fullsized":"2024-09-20T21:01:53.321283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:56.030003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.323910+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:01:53.323910+0000","last_peered":"2024-09-20T21:01:53.323910+0000","last_clean":"2024-09-20T21:01:53.323910+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:01:53.323910+0000","last_undegraded":"2024-09-20T21:01:53.323910+0000","last_fullsized":"2024-09-20T21:01:53.323910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321130+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:01:53.321130+0000","last_peered":"2024-09-20T21:01:53.321130+0000","last_clean":"2024-09-20T21:01:53.321130+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:01:53.321130+0000","last_undegraded":"2024-09-20T21:01:53.321130+0000","last_fullsized":"2024-09-20T21:01:53.321130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321717+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:01:53.321717+0000","last_peered":"2024-09-20T21:01:53.321717+0000","last_clean":"2024-09-20T21:01:53.321717+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:01:53.321717+0000","last_undegraded":"2024-09-20T21:01:53.321717+0000","last_fullsized":"2024-09-20T21:01:53.321717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322062+0000","last_change":"2024-09-20T21:01:26.187783+0000","last_active":"2024-09-20T21:01:53.322062+0000","last_peered":"2024-09-20T21:01:53.322062+0000","last_clean":"2024-09-20T21:01:53.322062+0000","last_became_active":"2024-09-20T21:01:26.185081+0000","last_became_peered":"2024-09-20T21:01:26.185081+0000","last_unstale":"2024-09-20T21:01:53.322062+0000","last_undegraded":"2024-09-20T21:01:53.322062+0000","last_fullsized":"2024-09-20T21:01:53.322062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322657+0000","last_change":"2024-09-20T21:01:26.197852+0000","last_active":"2024-09-20T21:01:53.322657+0000","last_peered":"2024-09-20T21:01:53.322657+0000","last_clean":"2024-09-20T21:01:53.322657+0000","last_became_active":"2024-09-20T21:01:26.195824+0000","last_became_peered":"2024-09-20T21:01:26.195824+0000","last_unstale":"2024-09-20T21:01:53.322657+0000","last_undegraded":"2024-09-20T21:01:53.322657+0000","last_fullsized":"2024-09-20T21:01:53.322657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:41:54.555337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.320770+0000","last_change":"2024-09-20T21:01:12.230375+0000","last_active":"2024-09-20T21:01:53.320770+0000","last_peered":"2024-09-20T21:01:53.320770+0000","last_clean":"2024-09-20T21:01:53.320770+0000","last_became_active":"2024-09-20T21:01:12.228679+0000","last_became_peered":"2024-09-20T21:01:12.228679+0000","last_unstale":"2024-09-20T21:01:53.320770+0000","last_undegraded":"2024-09-20T21:01:53.320770+0000","last_fullsized":"2024-09-20T21:01:53.320770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321215+0000","last_change":"2024-09-20T21:01:12.214484+0000","last_active":"2024-09-20T21:01:53.321215+0000","last_peered":"2024-09-20T21:01:53.321215+0000","last_clean":"2024-09-20T21:01:53.321215+0000","last_became_active":"2024-09-20T21:01:12.212293+0000","last_became_peered":"2024-09-20T21:01:12.212293+0000","last_unstale":"2024-09-20T21:01:53.321215+0000","last_undegraded":"2024-09-20T21:01:53.321215+0000","last_fullsized":"2024-09-20T21:01:53.321215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322630+0000","last_change":"2024-09-20T21:01:12.229114+0000","last_active":"2024-09-20T21:01:53.322630+0000","last_peered":"2024-09-20T21:01:53.322630+0000","last_clean":"2024-09-20T21:01:53.322630+0000","last_became_active":"2024-09-20T21:01:12.227812+0000","last_became_peered":"2024-09-20T21:01:12.227812+0000","last_unstale":"2024-09-20T21:01:53.322630+0000","last_undegraded":"2024-09-20T21:01:53.322630+0000","last_fullsized":"2024-09-20T21:01:53.322630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:02.638461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321393+0000","last_change":"2024-09-20T21:01:12.237926+0000","last_active":"2024-09-20T21:01:53.321393+0000","last_peered":"2024-09-20T21:01:53.321393+0000","last_clean":"2024-09-20T21:01:53.321393+0000","last_became_active":"2024-09-20T21:01:12.234061+0000","last_became_peered":"2024-09-20T21:01:12.234061+0000","last_unstale":"2024-09-20T21:01:53.321393+0000","last_undegraded":"2024-09-20T21:01:53.321393+0000","last_fullsized":"2024-09-20T21:01:53.321393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.324082+0000","last_change":"2024-09-20T21:01:12.214728+0000","last_active":"2024-09-20T21:01:53.324082+0000","last_peered":"2024-09-20T21:01:53.324082+0000","last_clean":"2024-09-20T21:01:53.324082+0000","last_became_active":"2024-09-20T21:01:12.213159+0000","last_became_peered":"2024-09-20T21:01:12.213159+0000","last_unstale":"2024-09-20T21:01:53.324082+0000","last_undegraded":"2024-09-20T21:01:53.324082+0000","last_fullsized":"2024-09-20T21:01:53.324082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322728+0000","last_change":"2024-09-20T21:01:26.191047+0000","last_active":"2024-09-20T21:01:53.322728+0000","last_peered":"2024-09-20T21:01:53.322728+0000","last_clean":"2024-09-20T21:01:53.322728+0000","last_became_active":"2024-09-20T21:01:26.189902+0000","last_became_peered":"2024-09-20T21:01:26.189902+0000","last_unstale":"2024-09-20T21:01:53.322728+0000","last_undegraded":"2024-09-20T21:01:53.322728+0000","last_fullsized":"2024-09-20T21:01:53.322728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:15.197998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321745+0000","last_change":"2024-09-20T21:01:12.227425+0000","last_active":"2024-09-20T21:01:53.321745+0000","last_peered":"2024-09-20T21:01:53.321745+0000","last_clean":"2024-09-20T21:01:53.321745+0000","last_became_active":"2024-09-20T21:01:12.226625+0000","last_became_peered":"2024-09-20T21:01:12.226625+0000","last_unstale":"2024-09-20T21:01:53.321745+0000","last_undegraded":"2024-09-20T21:01:53.321745+0000","last_fullsized":"2024-09-20T21:01:53.321745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322582+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:01:53.322582+0000","last_peered":"2024-09-20T21:01:53.322582+0000","last_clean":"2024-09-20T21:01:53.322582+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:01:53.322582+0000","last_undegraded":"2024-09-20T21:01:53.322582+0000","last_fullsized":"2024-09-20T21:01:53.322582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.320952+0000","last_change":"2024-09-20T21:01:12.230684+0000","last_active":"2024-09-20T21:01:53.320952+0000","last_peered":"2024-09-20T21:01:53.320952+0000","last_clean":"2024-09-20T21:01:53.320952+0000","last_became_active":"2024-09-20T21:01:12.229915+0000","last_became_peered":"2024-09-20T21:01:12.229915+0000","last_unstale":"2024-09-20T21:01:53.320952+0000","last_undegraded":"2024-09-20T21:01:53.320952+0000","last_fullsized":"2024-09-20T21:01:53.320952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321335+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:01:53.321335+0000","last_peered":"2024-09-20T21:01:53.321335+0000","last_clean":"2024-09-20T21:01:53.321335+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:01:53.321335+0000","last_undegraded":"2024-09-20T21:01:53.321335+0000","last_fullsized":"2024-09-20T21:01:53.321335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321293+0000","last_change":"2024-09-20T21:01:26.187763+0000","last_active":"2024-09-20T21:01:53.321293+0000","last_peered":"2024-09-20T21:01:53.321293+0000","last_clean":"2024-09-20T21:01:53.321293+0000","last_became_active":"2024-09-20T21:01:26.185774+0000","last_became_peered":"2024-09-20T21:01:26.185774+0000","last_unstale":"2024-09-20T21:01:53.321293+0000","last_undegraded":"2024-09-20T21:01:53.321293+0000","last_fullsized":"2024-09-20T21:01:53.321293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:07.330848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321716+0000","last_change":"2024-09-20T21:01:12.232814+0000","last_active":"2024-09-20T21:01:53.321716+0000","last_peered":"2024-09-20T21:01:53.321716+0000","last_clean":"2024-09-20T21:01:53.321716+0000","last_became_active":"2024-09-20T21:01:12.232026+0000","last_became_peered":"2024-09-20T21:01:12.232026+0000","last_unstale":"2024-09-20T21:01:53.321716+0000","last_undegraded":"2024-09-20T21:01:53.321716+0000","last_fullsized":"2024-09-20T21:01:53.321716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322347+0000","last_change":"2024-09-20T21:01:26.197377+0000","last_active":"2024-09-20T21:01:53.322347+0000","last_peered":"2024-09-20T21:01:53.322347+0000","last_clean":"2024-09-20T21:01:53.322347+0000","last_became_active":"2024-09-20T21:01:26.194232+0000","last_became_peered":"2024-09-20T21:01:26.194232+0000","last_unstale":"2024-09-20T21:01:53.322347+0000","last_undegraded":"2024-09-20T21:01:53.322347+0000","last_fullsized":"2024-09-20T21:01:53.322347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:16.800376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322483+0000","last_change":"2024-09-20T21:01:12.230727+0000","last_active":"2024-09-20T21:01:53.322483+0000","last_peered":"2024-09-20T21:01:53.322483+0000","last_clean":"2024-09-20T21:01:53.322483+0000","last_became_active":"2024-09-20T21:01:12.229987+0000","last_became_peered":"2024-09-20T21:01:12.229987+0000","last_unstale":"2024-09-20T21:01:53.322483+0000","last_undegraded":"2024-09-20T21:01:53.322483+0000","last_fullsized":"2024-09-20T21:01:53.322483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322070+0000","last_change":"2024-09-20T21:01:11.220335+0000","last_active":"2024-09-20T21:01:53.322070+0000","last_peered":"2024-09-20T21:01:53.322070+0000","last_clean":"2024-09-20T21:01:53.322070+0000","last_became_active":"2024-09-20T21:01:11.219506+0000","last_became_peered":"2024-09-20T21:01:11.219506+0000","last_unstale":"2024-09-20T21:01:53.322070+0000","last_undegraded":"2024-09-20T21:01:53.322070+0000","last_fullsized":"2024-09-20T21:01:53.322070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:16:05.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.324451+0000","last_change":"2024-09-20T21:01:12.214329+0000","last_active":"2024-09-20T21:01:53.324451+0000","last_peered":"2024-09-20T21:01:53.324451+0000","last_clean":"2024-09-20T21:01:53.324451+0000","last_became_active":"2024-09-20T21:01:12.212104+0000","last_became_peered":"2024-09-20T21:01:12.212104+0000","last_unstale":"2024-09-20T21:01:53.324451+0000","last_undegraded":"2024-09-20T21:01:53.324451+0000","last_fullsized":"2024-09-20T21:01:53.324451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322412+0000","last_change":"2024-09-20T21:01:11.213590+0000","last_active":"2024-09-20T21:01:53.322412+0000","last_peered":"2024-09-20T21:01:53.322412+0000","last_clean":"2024-09-20T21:01:53.322412+0000","last_became_active":"2024-09-20T21:01:11.212919+0000","last_became_peered":"2024-09-20T21:01:11.212919+0000","last_unstale":"2024-09-20T21:01:53.322412+0000","last_undegraded":"2024-09-20T21:01:53.322412+0000","last_fullsized":"2024-09-20T21:01:53.322412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.040754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321706+0000","last_change":"2024-09-20T21:01:12.214556+0000","last_active":"2024-09-20T21:01:53.321706+0000","last_peered":"2024-09-20T21:01:53.321706+0000","last_clean":"2024-09-20T21:01:53.321706+0000","last_became_active":"2024-09-20T21:01:12.212508+0000","last_became_peered":"2024-09-20T21:01:12.212508+0000","last_unstale":"2024-09-20T21:01:53.321706+0000","last_undegraded":"2024-09-20T21:01:53.321706+0000","last_fullsized":"2024-09-20T21:01:53.321706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322414+0000","last_change":"2024-09-20T21:01:26.192597+0000","last_active":"2024-09-20T21:01:53.322414+0000","last_peered":"2024-09-20T21:01:53.322414+0000","last_clean":"2024-09-20T21:01:53.322414+0000","last_became_active":"2024-09-20T21:01:26.190364+0000","last_became_peered":"2024-09-20T21:01:26.190364+0000","last_unstale":"2024-09-20T21:01:53.322414+0000","last_undegraded":"2024-09-20T21:01:53.322414+0000","last_fullsized":"2024-09-20T21:01:53.322414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:26.013177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"33'4409","reported_seq":4441,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.959101+0000","last_change":"2024-09-20T21:01:26.187301+0000","last_active":"2024-09-20T21:01:54.959101+0000","last_peered":"2024-09-20T21:01:54.959101+0000","last_clean":"2024-09-20T21:01:54.959101+0000","last_became_active":"2024-09-20T21:01:26.184620+0000","last_became_peered":"2024-09-20T21:01:26.184620+0000","last_unstale":"2024-09-20T21:01:54.959101+0000","last_undegraded":"2024-09-20T21:01:54.959101+0000","last_fullsized":"2024-09-20T21:01:54.959101+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4009,"log_dups_size":0,"ondisk_log_size":4009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:40.880801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288948224,"num_objects":4409,"num_object_clones":0,"num_object_copies":8818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4409,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4409,"num_write_kb":282176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321058+0000","last_change":"2024-09-20T21:01:26.189708+0000","last_active":"2024-09-20T21:01:53.321058+0000","last_peered":"2024-09-20T21:01:53.321058+0000","last_clean":"2024-09-20T21:01:53.321058+0000","last_became_active":"2024-09-20T21:01:26.187755+0000","last_became_peered":"2024-09-20T21:01:26.187755+0000","last_unstale":"2024-09-20T21:01:53.321058+0000","last_undegraded":"2024-09-20T21:01:53.321058+0000","last_fullsized":"2024-09-20T21:01:53.321058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:22.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322728+0000","last_change":"2024-09-20T21:01:12.229503+0000","last_active":"2024-09-20T21:01:53.322728+0000","last_peered":"2024-09-20T21:01:53.322728+0000","last_clean":"2024-09-20T21:01:53.322728+0000","last_became_active":"2024-09-20T21:01:12.228540+0000","last_became_peered":"2024-09-20T21:01:12.228540+0000","last_unstale":"2024-09-20T21:01:53.322728+0000","last_undegraded":"2024-09-20T21:01:53.322728+0000","last_fullsized":"2024-09-20T21:01:53.322728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:13.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"33'4404","reported_seq":4436,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.952312+0000","last_change":"2024-09-20T21:01:26.198531+0000","last_active":"2024-09-20T21:01:54.952312+0000","last_peered":"2024-09-20T21:01:54.952312+0000","last_clean":"2024-09-20T21:01:54.952312+0000","last_became_active":"2024-09-20T21:01:26.198133+0000","last_became_peered":"2024-09-20T21:01:26.198133+0000","last_unstale":"2024-09-20T21:01:54.952312+0000","last_undegraded":"2024-09-20T21:01:54.952312+0000","last_fullsized":"2024-09-20T21:01:54.952312+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4004,"log_dups_size":0,"ondisk_log_size":4004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:54.516925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288620544,"num_objects":4404,"num_object_clones":0,"num_object_copies":8808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4404,"num_write_kb":281856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321411+0000","last_change":"2024-09-20T21:01:11.214247+0000","last_active":"2024-09-20T21:01:53.321411+0000","last_peered":"2024-09-20T21:01:53.321411+0000","last_clean":"2024-09-20T21:01:53.321411+0000","last_became_active":"2024-09-20T21:01:11.212760+0000","last_became_peered":"2024-09-20T21:01:11.212760+0000","last_unstale":"2024-09-20T21:01:53.321411+0000","last_undegraded":"2024-09-20T21:01:53.321411+0000","last_fullsized":"2024-09-20T21:01:53.321411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:20.108703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322226+0000","last_change":"2024-09-20T21:01:12.238294+0000","last_active":"2024-09-20T21:01:53.322226+0000","last_peered":"2024-09-20T21:01:53.322226+0000","last_clean":"2024-09-20T21:01:53.322226+0000","last_became_active":"2024-09-20T21:01:12.237461+0000","last_became_peered":"2024-09-20T21:01:12.237461+0000","last_unstale":"2024-09-20T21:01:53.322226+0000","last_undegraded":"2024-09-20T21:01:53.322226+0000","last_fullsized":"2024-09-20T21:01:53.322226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:11.215425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"33'4498","reported_seq":4530,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.959833+0000","last_change":"2024-09-20T21:01:26.189622+0000","last_active":"2024-09-20T21:01:54.959833+0000","last_peered":"2024-09-20T21:01:54.959833+0000","last_clean":"2024-09-20T21:01:54.959833+0000","last_became_active":"2024-09-20T21:01:26.186385+0000","last_became_peered":"2024-09-20T21:01:26.186385+0000","last_unstale":"2024-09-20T21:01:54.959833+0000","last_undegraded":"2024-09-20T21:01:54.959833+0000","last_fullsized":"2024-09-20T21:01:54.959833+0000","mapping_epoch":21,"log_start":"24'500","ondisk_log_start":"24'500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3998,"log_dups_size":0,"ondisk_log_size":3998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:50.339650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294780928,"num_objects":4498,"num_object_clones":0,"num_object_copies":8996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4498,"num_write_kb":287872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322387+0000","last_change":"2024-09-20T21:01:26.195674+0000","last_active":"2024-09-20T21:01:53.322387+0000","last_peered":"2024-09-20T21:01:53.322387+0000","last_clean":"2024-09-20T21:01:53.322387+0000","last_became_active":"2024-09-20T21:01:26.194725+0000","last_became_peered":"2024-09-20T21:01:26.194725+0000","last_unstale":"2024-09-20T21:01:53.322387+0000","last_undegraded":"2024-09-20T21:01:53.322387+0000","last_fullsized":"2024-09-20T21:01:53.322387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:06:30.103410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322176+0000","last_change":"2024-09-20T21:01:26.187349+0000","last_active":"2024-09-20T21:01:53.322176+0000","last_peered":"2024-09-20T21:01:53.322176+0000","last_clean":"2024-09-20T21:01:53.322176+0000","last_became_active":"2024-09-20T21:01:26.185876+0000","last_became_peered":"2024-09-20T21:01:26.185876+0000","last_unstale":"2024-09-20T21:01:53.322176+0000","last_undegraded":"2024-09-20T21:01:53.322176+0000","last_fullsized":"2024-09-20T21:01:53.322176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:48.846118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"33'4340","reported_seq":4372,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.952202+0000","last_change":"2024-09-20T21:01:26.189804+0000","last_active":"2024-09-20T21:01:54.952202+0000","last_peered":"2024-09-20T21:01:54.952202+0000","last_clean":"2024-09-20T21:01:54.952202+0000","last_became_active":"2024-09-20T21:01:26.187924+0000","last_became_peered":"2024-09-20T21:01:26.187924+0000","last_unstale":"2024-09-20T21:01:54.952202+0000","last_undegraded":"2024-09-20T21:01:54.952202+0000","last_fullsized":"2024-09-20T21:01:54.952202+0000","mapping_epoch":21,"log_start":"24'800","ondisk_log_start":"24'800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:35:44.867498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284426240,"num_objects":4340,"num_object_clones":0,"num_object_copies":8680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4340,"num_write_kb":277760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322161+0000","last_change":"2024-09-20T21:01:26.189711+0000","last_active":"2024-09-20T21:01:53.322161+0000","last_peered":"2024-09-20T21:01:53.322161+0000","last_clean":"2024-09-20T21:01:53.322161+0000","last_became_active":"2024-09-20T21:01:26.187708+0000","last_became_peered":"2024-09-20T21:01:26.187708+0000","last_unstale":"2024-09-20T21:01:53.322161+0000","last_undegraded":"2024-09-20T21:01:53.322161+0000","last_fullsized":"2024-09-20T21:01:53.322161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:31:35.980589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322430+0000","last_change":"2024-09-20T21:01:12.220592+0000","last_active":"2024-09-20T21:01:53.322430+0000","last_peered":"2024-09-20T21:01:53.322430+0000","last_clean":"2024-09-20T21:01:53.322430+0000","last_became_active":"2024-09-20T21:01:12.219682+0000","last_became_peered":"2024-09-20T21:01:12.219682+0000","last_unstale":"2024-09-20T21:01:53.322430+0000","last_undegraded":"2024-09-20T21:01:53.322430+0000","last_fullsized":"2024-09-20T21:01:53.322430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'4299","reported_seq":4331,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.953530+0000","last_change":"2024-09-20T21:01:26.196437+0000","last_active":"2024-09-20T21:01:54.953530+0000","last_peered":"2024-09-20T21:01:54.953530+0000","last_clean":"2024-09-20T21:01:54.953530+0000","last_became_active":"2024-09-20T21:01:26.195712+0000","last_became_peered":"2024-09-20T21:01:26.195712+0000","last_unstale":"2024-09-20T21:01:54.953530+0000","last_undegraded":"2024-09-20T21:01:54.953530+0000","last_fullsized":"2024-09-20T21:01:54.953530+0000","mapping_epoch":21,"log_start":"24'300","ondisk_log_start":"24'300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3999,"log_dups_size":0,"ondisk_log_size":3999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:56:20.379997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281739264,"num_objects":4299,"num_object_clones":0,"num_object_copies":8598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4299,"num_write_kb":275136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322687+0000","last_change":"2024-09-20T21:01:11.220548+0000","last_active":"2024-09-20T21:01:53.322687+0000","last_peered":"2024-09-20T21:01:53.322687+0000","last_clean":"2024-09-20T21:01:53.322687+0000","last_became_active":"2024-09-20T21:01:11.219847+0000","last_became_peered":"2024-09-20T21:01:11.219847+0000","last_unstale":"2024-09-20T21:01:53.322687+0000","last_undegraded":"2024-09-20T21:01:53.322687+0000","last_fullsized":"2024-09-20T21:01:53.322687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322114+0000","last_change":"2024-09-20T21:01:26.189300+0000","last_active":"2024-09-20T21:01:53.322114+0000","last_peered":"2024-09-20T21:01:53.322114+0000","last_clean":"2024-09-20T21:01:53.322114+0000","last_became_active":"2024-09-20T21:01:26.186381+0000","last_became_peered":"2024-09-20T21:01:26.186381+0000","last_unstale":"2024-09-20T21:01:53.322114+0000","last_undegraded":"2024-09-20T21:01:53.322114+0000","last_fullsized":"2024-09-20T21:01:53.322114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:15.197998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"33'4381","reported_seq":4412,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.950319+0000","last_change":"2024-09-20T21:01:26.185429+0000","last_active":"2024-09-20T21:01:54.950319+0000","last_peered":"2024-09-20T21:01:54.950319+0000","last_clean":"2024-09-20T21:01:54.950319+0000","last_became_active":"2024-09-20T21:01:26.184548+0000","last_became_peered":"2024-09-20T21:01:26.184548+0000","last_unstale":"2024-09-20T21:01:54.950319+0000","last_undegraded":"2024-09-20T21:01:54.950319+0000","last_fullsized":"2024-09-20T21:01:54.950319+0000","mapping_epoch":21,"log_start":"24'800","ondisk_log_start":"24'800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3581,"log_dups_size":0,"ondisk_log_size":3581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:23.837807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287113216,"num_objects":4381,"num_object_clones":0,"num_object_copies":8762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4381,"num_write_kb":280384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321695+0000","last_change":"2024-09-20T21:01:26.187643+0000","last_active":"2024-09-20T21:01:53.321695+0000","last_peered":"2024-09-20T21:01:53.321695+0000","last_clean":"2024-09-20T21:01:53.321695+0000","last_became_active":"2024-09-20T21:01:26.186342+0000","last_became_peered":"2024-09-20T21:01:26.186342+0000","last_unstale":"2024-09-20T21:01:53.321695+0000","last_undegraded":"2024-09-20T21:01:53.321695+0000","last_fullsized":"2024-09-20T21:01:53.321695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:40.496914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322629+0000","last_change":"2024-09-20T21:01:26.190975+0000","last_active":"2024-09-20T21:01:53.322629+0000","last_peered":"2024-09-20T21:01:53.322629+0000","last_clean":"2024-09-20T21:01:53.322629+0000","last_became_active":"2024-09-20T21:01:26.187528+0000","last_became_peered":"2024-09-20T21:01:26.187528+0000","last_unstale":"2024-09-20T21:01:53.322629+0000","last_undegraded":"2024-09-20T21:01:53.322629+0000","last_fullsized":"2024-09-20T21:01:53.322629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"33'4353","reported_seq":4385,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.958655+0000","last_change":"2024-09-20T21:01:26.191101+0000","last_active":"2024-09-20T21:01:54.958655+0000","last_peered":"2024-09-20T21:01:54.958655+0000","last_clean":"2024-09-20T21:01:54.958655+0000","last_became_active":"2024-09-20T21:01:26.190000+0000","last_became_peered":"2024-09-20T21:01:26.190000+0000","last_unstale":"2024-09-20T21:01:54.958655+0000","last_undegraded":"2024-09-20T21:01:54.958655+0000","last_fullsized":"2024-09-20T21:01:54.958655+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3953,"log_dups_size":0,"ondisk_log_size":3953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:53.347202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285278208,"num_objects":4353,"num_object_clones":0,"num_object_copies":8706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4353,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4353,"num_write_kb":278592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322461+0000","last_change":"2024-09-20T21:01:11.213371+0000","last_active":"2024-09-20T21:01:53.322461+0000","last_peered":"2024-09-20T21:01:53.322461+0000","last_clean":"2024-09-20T21:01:53.322461+0000","last_became_active":"2024-09-20T21:01:11.212385+0000","last_became_peered":"2024-09-20T21:01:11.212385+0000","last_unstale":"2024-09-20T21:01:53.322461+0000","last_undegraded":"2024-09-20T21:01:53.322461+0000","last_fullsized":"2024-09-20T21:01:53.322461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:56.734999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.320725+0000","last_change":"2024-09-20T21:01:26.190179+0000","last_active":"2024-09-20T21:01:53.320725+0000","last_peered":"2024-09-20T21:01:53.320725+0000","last_clean":"2024-09-20T21:01:53.320725+0000","last_became_active":"2024-09-20T21:01:26.187701+0000","last_became_peered":"2024-09-20T21:01:26.187701+0000","last_unstale":"2024-09-20T21:01:53.320725+0000","last_undegraded":"2024-09-20T21:01:53.320725+0000","last_fullsized":"2024-09-20T21:01:53.320725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:48.846118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"33'4450","reported_seq":4482,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.949649+0000","last_change":"2024-09-20T21:01:26.192961+0000","last_active":"2024-09-20T21:01:54.949649+0000","last_peered":"2024-09-20T21:01:54.949649+0000","last_clean":"2024-09-20T21:01:54.949649+0000","last_became_active":"2024-09-20T21:01:26.192159+0000","last_became_peered":"2024-09-20T21:01:26.192159+0000","last_unstale":"2024-09-20T21:01:54.949649+0000","last_undegraded":"2024-09-20T21:01:54.949649+0000","last_fullsized":"2024-09-20T21:01:54.949649+0000","mapping_epoch":21,"log_start":"24'500","ondisk_log_start":"24'500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3950,"log_dups_size":0,"ondisk_log_size":3950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:50.672763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291635200,"num_objects":4450,"num_object_clones":0,"num_object_copies":8900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4450,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4450,"num_write_kb":284800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322767+0000","last_change":"2024-09-20T21:01:11.220785+0000","last_active":"2024-09-20T21:01:53.322767+0000","last_peered":"2024-09-20T21:01:53.322767+0000","last_clean":"2024-09-20T21:01:53.322767+0000","last_became_active":"2024-09-20T21:01:11.220111+0000","last_became_peered":"2024-09-20T21:01:11.220111+0000","last_unstale":"2024-09-20T21:01:53.322767+0000","last_undegraded":"2024-09-20T21:01:53.322767+0000","last_fullsized":"2024-09-20T21:01:53.322767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.621763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321798+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:01:53.321798+0000","last_peered":"2024-09-20T21:01:53.321798+0000","last_clean":"2024-09-20T21:01:53.321798+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:01:53.321798+0000","last_undegraded":"2024-09-20T21:01:53.321798+0000","last_fullsized":"2024-09-20T21:01:53.321798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"33'4443","reported_seq":4475,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.927407+0000","last_change":"2024-09-20T21:01:26.190940+0000","last_active":"2024-09-20T21:01:54.927407+0000","last_peered":"2024-09-20T21:01:54.927407+0000","last_clean":"2024-09-20T21:01:54.927407+0000","last_became_active":"2024-09-20T21:01:26.189653+0000","last_became_peered":"2024-09-20T21:01:26.189653+0000","last_unstale":"2024-09-20T21:01:54.927407+0000","last_undegraded":"2024-09-20T21:01:54.927407+0000","last_fullsized":"2024-09-20T21:01:54.927407+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4043,"log_dups_size":0,"ondisk_log_size":4043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:08.532604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291176448,"num_objects":4443,"num_object_clones":0,"num_object_copies":8886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4443,"num_write_kb":284352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":238,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322947+0000","last_change":"2024-09-20T21:01:26.190970+0000","last_active":"2024-09-20T21:01:53.322947+0000","last_peered":"2024-09-20T21:01:53.322947+0000","last_clean":"2024-09-20T21:01:53.322947+0000","last_became_active":"2024-09-20T21:01:26.186126+0000","last_became_peered":"2024-09-20T21:01:26.186126+0000","last_unstale":"2024-09-20T21:01:53.322947+0000","last_undegraded":"2024-09-20T21:01:53.322947+0000","last_fullsized":"2024-09-20T21:01:53.322947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:46.927072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322797+0000","last_change":"2024-09-20T21:01:26.198209+0000","last_active":"2024-09-20T21:01:53.322797+0000","last_peered":"2024-09-20T21:01:53.322797+0000","last_clean":"2024-09-20T21:01:53.322797+0000","last_became_active":"2024-09-20T21:01:26.197583+0000","last_became_peered":"2024-09-20T21:01:26.197583+0000","last_unstale":"2024-09-20T21:01:53.322797+0000","last_undegraded":"2024-09-20T21:01:53.322797+0000","last_fullsized":"2024-09-20T21:01:53.322797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:56:01.208657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322271+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:01:53.322271+0000","last_peered":"2024-09-20T21:01:53.322271+0000","last_clean":"2024-09-20T21:01:53.322271+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:01:53.322271+0000","last_undegraded":"2024-09-20T21:01:53.322271+0000","last_fullsized":"2024-09-20T21:01:53.322271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322339+0000","last_change":"2024-09-20T21:01:26.192534+0000","last_active":"2024-09-20T21:01:53.322339+0000","last_peered":"2024-09-20T21:01:53.322339+0000","last_clean":"2024-09-20T21:01:53.322339+0000","last_became_active":"2024-09-20T21:01:26.190015+0000","last_became_peered":"2024-09-20T21:01:26.190015+0000","last_unstale":"2024-09-20T21:01:53.322339+0000","last_undegraded":"2024-09-20T21:01:53.322339+0000","last_fullsized":"2024-09-20T21:01:53.322339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:31:36.992486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"33'4412","reported_seq":4444,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.958646+0000","last_change":"2024-09-20T21:01:26.185969+0000","last_active":"2024-09-20T21:01:54.958646+0000","last_peered":"2024-09-20T21:01:54.958646+0000","last_clean":"2024-09-20T21:01:54.958646+0000","last_became_active":"2024-09-20T21:01:26.185337+0000","last_became_peered":"2024-09-20T21:01:26.185337+0000","last_unstale":"2024-09-20T21:01:54.958646+0000","last_undegraded":"2024-09-20T21:01:54.958646+0000","last_fullsized":"2024-09-20T21:01:54.958646+0000","mapping_epoch":21,"log_start":"24'800","ondisk_log_start":"24'800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3612,"log_dups_size":0,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.883963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289144832,"num_objects":4412,"num_object_clones":0,"num_object_copies":8824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4412,"num_write_kb":282368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322858+0000","last_change":"2024-09-20T21:01:26.192040+0000","last_active":"2024-09-20T21:01:53.322858+0000","last_peered":"2024-09-20T21:01:53.322858+0000","last_clean":"2024-09-20T21:01:53.322858+0000","last_became_active":"2024-09-20T21:01:26.189641+0000","last_became_peered":"2024-09-20T21:01:26.189641+0000","last_unstale":"2024-09-20T21:01:53.322858+0000","last_undegraded":"2024-09-20T21:01:53.322858+0000","last_fullsized":"2024-09-20T21:01:53.322858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:25:21.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321603+0000","last_change":"2024-09-20T21:01:11.220462+0000","last_active":"2024-09-20T21:01:53.321603+0000","last_peered":"2024-09-20T21:01:53.321603+0000","last_clean":"2024-09-20T21:01:53.321603+0000","last_became_active":"2024-09-20T21:01:11.219778+0000","last_became_peered":"2024-09-20T21:01:11.219778+0000","last_unstale":"2024-09-20T21:01:53.321603+0000","last_undegraded":"2024-09-20T21:01:53.321603+0000","last_fullsized":"2024-09-20T21:01:53.321603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:08.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321218+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:01:53.321218+0000","last_peered":"2024-09-20T21:01:53.321218+0000","last_clean":"2024-09-20T21:01:53.321218+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:01:53.321218+0000","last_undegraded":"2024-09-20T21:01:53.321218+0000","last_fullsized":"2024-09-20T21:01:53.321218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"33'4391","reported_seq":4423,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.956938+0000","last_change":"2024-09-20T21:01:26.193658+0000","last_active":"2024-09-20T21:01:54.956938+0000","last_peered":"2024-09-20T21:01:54.956938+0000","last_clean":"2024-09-20T21:01:54.956938+0000","last_became_active":"2024-09-20T21:01:26.193005+0000","last_became_peered":"2024-09-20T21:01:26.193005+0000","last_unstale":"2024-09-20T21:01:54.956938+0000","last_undegraded":"2024-09-20T21:01:54.956938+0000","last_fullsized":"2024-09-20T21:01:54.956938+0000","mapping_epoch":21,"log_start":"24'800","ondisk_log_start":"24'800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3591,"log_dups_size":0,"ondisk_log_size":3591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:46.866571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287768576,"num_objects":4391,"num_object_clones":0,"num_object_copies":8782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4391,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4391,"num_write_kb":281024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321744+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:01:53.321744+0000","last_peered":"2024-09-20T21:01:53.321744+0000","last_clean":"2024-09-20T21:01:53.321744+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:01:53.321744+0000","last_undegraded":"2024-09-20T21:01:53.321744+0000","last_fullsized":"2024-09-20T21:01:53.321744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322843+0000","last_change":"2024-09-20T21:01:11.217295+0000","last_active":"2024-09-20T21:01:53.322843+0000","last_peered":"2024-09-20T21:01:53.322843+0000","last_clean":"2024-09-20T21:01:53.322843+0000","last_became_active":"2024-09-20T21:01:11.216350+0000","last_became_peered":"2024-09-20T21:01:11.216350+0000","last_unstale":"2024-09-20T21:01:53.322843+0000","last_undegraded":"2024-09-20T21:01:53.322843+0000","last_fullsized":"2024-09-20T21:01:53.322843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:59.661622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321966+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:01:53.321966+0000","last_peered":"2024-09-20T21:01:53.321966+0000","last_clean":"2024-09-20T21:01:53.321966+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:01:53.321966+0000","last_undegraded":"2024-09-20T21:01:53.321966+0000","last_fullsized":"2024-09-20T21:01:53.321966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"33'4390","reported_seq":4422,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.962221+0000","last_change":"2024-09-20T21:01:26.195204+0000","last_active":"2024-09-20T21:01:54.962221+0000","last_peered":"2024-09-20T21:01:54.962221+0000","last_clean":"2024-09-20T21:01:54.962221+0000","last_became_active":"2024-09-20T21:01:26.193385+0000","last_became_peered":"2024-09-20T21:01:26.193385+0000","last_unstale":"2024-09-20T21:01:54.962221+0000","last_undegraded":"2024-09-20T21:01:54.962221+0000","last_fullsized":"2024-09-20T21:01:54.962221+0000","mapping_epoch":21,"log_start":"24'800","ondisk_log_start":"24'800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3590,"log_dups_size":0,"ondisk_log_size":3590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:50.379400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287703040,"num_objects":4390,"num_object_clones":0,"num_object_copies":8780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4390,"num_write_kb":280960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322370+0000","last_change":"2024-09-20T21:01:26.193870+0000","last_active":"2024-09-20T21:01:53.322370+0000","last_peered":"2024-09-20T21:01:53.322370+0000","last_clean":"2024-09-20T21:01:53.322370+0000","last_became_active":"2024-09-20T21:01:26.193552+0000","last_became_peered":"2024-09-20T21:01:26.193552+0000","last_unstale":"2024-09-20T21:01:53.322370+0000","last_undegraded":"2024-09-20T21:01:53.322370+0000","last_fullsized":"2024-09-20T21:01:53.322370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:32:52.139650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322505+0000","last_change":"2024-09-20T21:01:26.198203+0000","last_active":"2024-09-20T21:01:53.322505+0000","last_peered":"2024-09-20T21:01:53.322505+0000","last_clean":"2024-09-20T21:01:53.322505+0000","last_became_active":"2024-09-20T21:01:26.196361+0000","last_became_peered":"2024-09-20T21:01:26.196361+0000","last_unstale":"2024-09-20T21:01:53.322505+0000","last_undegraded":"2024-09-20T21:01:53.322505+0000","last_fullsized":"2024-09-20T21:01:53.322505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:35.683600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322273+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:01:53.322273+0000","last_peered":"2024-09-20T21:01:53.322273+0000","last_clean":"2024-09-20T21:01:53.322273+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:01:53.322273+0000","last_undegraded":"2024-09-20T21:01:53.322273+0000","last_fullsized":"2024-09-20T21:01:53.322273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'4412","reported_seq":4444,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.951510+0000","last_change":"2024-09-20T21:01:26.187690+0000","last_active":"2024-09-20T21:01:54.951510+0000","last_peered":"2024-09-20T21:01:54.951510+0000","last_clean":"2024-09-20T21:01:54.951510+0000","last_became_active":"2024-09-20T21:01:26.184491+0000","last_became_peered":"2024-09-20T21:01:26.184491+0000","last_unstale":"2024-09-20T21:01:54.951510+0000","last_undegraded":"2024-09-20T21:01:54.951510+0000","last_fullsized":"2024-09-20T21:01:54.951510+0000","mapping_epoch":21,"log_start":"24'800","ondisk_log_start":"24'800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3612,"log_dups_size":0,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:53:38.207514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289144832,"num_objects":4412,"num_object_clones":0,"num_object_copies":8824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4412,"num_write_kb":282368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321623+0000","last_change":"2024-09-20T21:01:26.195383+0000","last_active":"2024-09-20T21:01:53.321623+0000","last_peered":"2024-09-20T21:01:53.321623+0000","last_clean":"2024-09-20T21:01:53.321623+0000","last_became_active":"2024-09-20T21:01:26.193485+0000","last_became_peered":"2024-09-20T21:01:26.193485+0000","last_unstale":"2024-09-20T21:01:53.321623+0000","last_undegraded":"2024-09-20T21:01:53.321623+0000","last_fullsized":"2024-09-20T21:01:53.321623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:39.527762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322812+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:01:53.322812+0000","last_peered":"2024-09-20T21:01:53.322812+0000","last_clean":"2024-09-20T21:01:53.322812+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:01:53.322812+0000","last_undegraded":"2024-09-20T21:01:53.322812+0000","last_fullsized":"2024-09-20T21:01:53.322812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.320864+0000","last_change":"2024-09-20T21:01:12.227746+0000","last_active":"2024-09-20T21:01:53.320864+0000","last_peered":"2024-09-20T21:01:53.320864+0000","last_clean":"2024-09-20T21:01:53.320864+0000","last_became_active":"2024-09-20T21:01:12.226860+0000","last_became_peered":"2024-09-20T21:01:12.226860+0000","last_unstale":"2024-09-20T21:01:53.320864+0000","last_undegraded":"2024-09-20T21:01:53.320864+0000","last_fullsized":"2024-09-20T21:01:53.320864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:02.144980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"33'4378","reported_seq":4410,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.953625+0000","last_change":"2024-09-20T21:01:26.185208+0000","last_active":"2024-09-20T21:01:54.953625+0000","last_peered":"2024-09-20T21:01:54.953625+0000","last_clean":"2024-09-20T21:01:54.953625+0000","last_became_active":"2024-09-20T21:01:26.184547+0000","last_became_peered":"2024-09-20T21:01:26.184547+0000","last_unstale":"2024-09-20T21:01:54.953625+0000","last_undegraded":"2024-09-20T21:01:54.953625+0000","last_fullsized":"2024-09-20T21:01:54.953625+0000","mapping_epoch":21,"log_start":"24'800","ondisk_log_start":"24'800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:11.520890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286916608,"num_objects":4378,"num_object_clones":0,"num_object_copies":8756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4378,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4378,"num_write_kb":280192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322361+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:01:53.322361+0000","last_peered":"2024-09-20T21:01:53.322361+0000","last_clean":"2024-09-20T21:01:53.322361+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:01:53.322361+0000","last_undegraded":"2024-09-20T21:01:53.322361+0000","last_fullsized":"2024-09-20T21:01:53.322361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322798+0000","last_change":"2024-09-20T21:01:09.385616+0000","last_active":"2024-09-20T21:01:53.322798+0000","last_peered":"2024-09-20T21:01:53.322798+0000","last_clean":"2024-09-20T21:01:53.322798+0000","last_became_active":"2024-09-20T21:01:07.000811+0000","last_became_peered":"2024-09-20T21:01:07.000811+0000","last_unstale":"2024-09-20T21:01:53.322798+0000","last_undegraded":"2024-09-20T21:01:53.322798+0000","last_fullsized":"2024-09-20T21:01:53.322798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:03.917240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077098100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321015+0000","last_change":"2024-09-20T21:01:12.227533+0000","last_active":"2024-09-20T21:01:53.321015+0000","last_peered":"2024-09-20T21:01:53.321015+0000","last_clean":"2024-09-20T21:01:53.321015+0000","last_became_active":"2024-09-20T21:01:12.226676+0000","last_became_peered":"2024-09-20T21:01:12.226676+0000","last_unstale":"2024-09-20T21:01:53.321015+0000","last_undegraded":"2024-09-20T21:01:53.321015+0000","last_fullsized":"2024-09-20T21:01:53.321015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"33'4508","reported_seq":4540,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.941598+0000","last_change":"2024-09-20T21:01:26.187915+0000","last_active":"2024-09-20T21:01:54.941598+0000","last_peered":"2024-09-20T21:01:54.941598+0000","last_clean":"2024-09-20T21:01:54.941598+0000","last_became_active":"2024-09-20T21:01:26.185921+0000","last_became_peered":"2024-09-20T21:01:26.185921+0000","last_unstale":"2024-09-20T21:01:54.941598+0000","last_undegraded":"2024-09-20T21:01:54.941598+0000","last_fullsized":"2024-09-20T21:01:54.941598+0000","mapping_epoch":21,"log_start":"25'900","ondisk_log_start":"25'900","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:53.347202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295436288,"num_objects":4508,"num_object_clones":0,"num_object_copies":9016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4508,"num_write_kb":288512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.323936+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:01:53.323936+0000","last_peered":"2024-09-20T21:01:53.323936+0000","last_clean":"2024-09-20T21:01:53.323936+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:01:53.323936+0000","last_undegraded":"2024-09-20T21:01:53.323936+0000","last_fullsized":"2024-09-20T21:01:53.323936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.324539+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:01:53.324539+0000","last_peered":"2024-09-20T21:01:53.324539+0000","last_clean":"2024-09-20T21:01:53.324539+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:01:53.324539+0000","last_undegraded":"2024-09-20T21:01:53.324539+0000","last_fullsized":"2024-09-20T21:01:53.324539+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321662+0000","last_change":"2024-09-20T21:01:12.227354+0000","last_active":"2024-09-20T21:01:53.321662+0000","last_peered":"2024-09-20T21:01:53.321662+0000","last_clean":"2024-09-20T21:01:53.321662+0000","last_became_active":"2024-09-20T21:01:12.226078+0000","last_became_peered":"2024-09-20T21:01:12.226078+0000","last_unstale":"2024-09-20T21:01:53.321662+0000","last_undegraded":"2024-09-20T21:01:53.321662+0000","last_fullsized":"2024-09-20T21:01:53.321662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"33'4380","reported_seq":4412,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:54.959602+0000","last_change":"2024-09-20T21:01:26.199069+0000","last_active":"2024-09-20T21:01:54.959602+0000","last_peered":"2024-09-20T21:01:54.959602+0000","last_clean":"2024-09-20T21:01:54.959602+0000","last_became_active":"2024-09-20T21:01:26.198393+0000","last_became_peered":"2024-09-20T21:01:26.198393+0000","last_unstale":"2024-09-20T21:01:54.959602+0000","last_undegraded":"2024-09-20T21:01:54.959602+0000","last_fullsized":"2024-09-20T21:01:54.959602+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:31.789539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287047680,"num_objects":4380,"num_object_clones":0,"num_object_copies":8760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4380,"num_write_kb":280320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.324478+0000","last_change":"2024-09-20T21:01:11.220479+0000","last_active":"2024-09-20T21:01:53.324478+0000","last_peered":"2024-09-20T21:01:53.324478+0000","last_clean":"2024-09-20T21:01:53.324478+0000","last_became_active":"2024-09-20T21:01:11.219658+0000","last_became_peered":"2024-09-20T21:01:11.219658+0000","last_unstale":"2024-09-20T21:01:53.324478+0000","last_undegraded":"2024-09-20T21:01:53.324478+0000","last_fullsized":"2024-09-20T21:01:53.324478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321571+0000","last_change":"2024-09-20T21:01:26.187355+0000","last_active":"2024-09-20T21:01:53.321571+0000","last_peered":"2024-09-20T21:01:53.321571+0000","last_clean":"2024-09-20T21:01:53.321571+0000","last_became_active":"2024-09-20T21:01:26.184589+0000","last_became_peered":"2024-09-20T21:01:26.184589+0000","last_unstale":"2024-09-20T21:01:53.321571+0000","last_undegraded":"2024-09-20T21:01:53.321571+0000","last_fullsized":"2024-09-20T21:01:53.321571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:50.835930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322344+0000","last_change":"2024-09-20T21:01:12.228307+0000","last_active":"2024-09-20T21:01:53.322344+0000","last_peered":"2024-09-20T21:01:53.322344+0000","last_clean":"2024-09-20T21:01:53.322344+0000","last_became_active":"2024-09-20T21:01:12.226322+0000","last_became_peered":"2024-09-20T21:01:12.226322+0000","last_unstale":"2024-09-20T21:01:53.322344+0000","last_undegraded":"2024-09-20T21:01:53.322344+0000","last_fullsized":"2024-09-20T21:01:53.322344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:52.194070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.320804+0000","last_change":"2024-09-20T21:01:26.184712+0000","last_active":"2024-09-20T21:01:53.320804+0000","last_peered":"2024-09-20T21:01:53.320804+0000","last_clean":"2024-09-20T21:01:53.320804+0000","last_became_active":"2024-09-20T21:01:26.183597+0000","last_became_peered":"2024-09-20T21:01:26.183597+0000","last_unstale":"2024-09-20T21:01:53.320804+0000","last_undegraded":"2024-09-20T21:01:53.320804+0000","last_fullsized":"2024-09-20T21:01:53.320804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.657192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321438+0000","last_change":"2024-09-20T21:01:26.189446+0000","last_active":"2024-09-20T21:01:53.321438+0000","last_peered":"2024-09-20T21:01:53.321438+0000","last_clean":"2024-09-20T21:01:53.321438+0000","last_became_active":"2024-09-20T21:01:26.187287+0000","last_became_peered":"2024-09-20T21:01:26.187287+0000","last_unstale":"2024-09-20T21:01:53.321438+0000","last_undegraded":"2024-09-20T21:01:53.321438+0000","last_fullsized":"2024-09-20T21:01:53.321438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:03.704249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321862+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:01:53.321862+0000","last_peered":"2024-09-20T21:01:53.321862+0000","last_clean":"2024-09-20T21:01:53.321862+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:01:53.321862+0000","last_undegraded":"2024-09-20T21:01:53.321862+0000","last_fullsized":"2024-09-20T21:01:53.321862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322691+0000","last_change":"2024-09-20T21:01:11.220027+0000","last_active":"2024-09-20T21:01:53.322691+0000","last_peered":"2024-09-20T21:01:53.322691+0000","last_clean":"2024-09-20T21:01:53.322691+0000","last_became_active":"2024-09-20T21:01:11.218551+0000","last_became_peered":"2024-09-20T21:01:11.218551+0000","last_unstale":"2024-09-20T21:01:53.322691+0000","last_undegraded":"2024-09-20T21:01:53.322691+0000","last_fullsized":"2024-09-20T21:01:53.322691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:47:59.918561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.324380+0000","last_change":"2024-09-20T21:01:26.193337+0000","last_active":"2024-09-20T21:01:53.324380+0000","last_peered":"2024-09-20T21:01:53.324380+0000","last_clean":"2024-09-20T21:01:53.324380+0000","last_became_active":"2024-09-20T21:01:26.192862+0000","last_became_peered":"2024-09-20T21:01:26.192862+0000","last_unstale":"2024-09-20T21:01:53.324380+0000","last_undegraded":"2024-09-20T21:01:53.324380+0000","last_fullsized":"2024-09-20T21:01:53.324380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:11.609879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321337+0000","last_change":"2024-09-20T21:01:12.211553+0000","last_active":"2024-09-20T21:01:53.321337+0000","last_peered":"2024-09-20T21:01:53.321337+0000","last_clean":"2024-09-20T21:01:53.321337+0000","last_became_active":"2024-09-20T21:01:12.210101+0000","last_became_peered":"2024-09-20T21:01:12.210101+0000","last_unstale":"2024-09-20T21:01:53.321337+0000","last_undegraded":"2024-09-20T21:01:53.321337+0000","last_fullsized":"2024-09-20T21:01:53.321337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.323851+0000","last_change":"2024-09-20T21:01:11.221867+0000","last_active":"2024-09-20T21:01:53.323851+0000","last_peered":"2024-09-20T21:01:53.323851+0000","last_clean":"2024-09-20T21:01:53.323851+0000","last_became_active":"2024-09-20T21:01:11.220980+0000","last_became_peered":"2024-09-20T21:01:11.220980+0000","last_unstale":"2024-09-20T21:01:53.323851+0000","last_undegraded":"2024-09-20T21:01:53.323851+0000","last_fullsized":"2024-09-20T21:01:53.323851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321492+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:01:53.321492+0000","last_peered":"2024-09-20T21:01:53.321492+0000","last_clean":"2024-09-20T21:01:53.321492+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:01:53.321492+0000","last_undegraded":"2024-09-20T21:01:53.321492+0000","last_fullsized":"2024-09-20T21:01:53.321492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321480+0000","last_change":"2024-09-20T21:01:12.236819+0000","last_active":"2024-09-20T21:01:53.321480+0000","last_peered":"2024-09-20T21:01:53.321480+0000","last_clean":"2024-09-20T21:01:53.321480+0000","last_became_active":"2024-09-20T21:01:12.233922+0000","last_became_peered":"2024-09-20T21:01:12.233922+0000","last_unstale":"2024-09-20T21:01:53.321480+0000","last_undegraded":"2024-09-20T21:01:53.321480+0000","last_fullsized":"2024-09-20T21:01:53.321480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321778+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:01:53.321778+0000","last_peered":"2024-09-20T21:01:53.321778+0000","last_clean":"2024-09-20T21:01:53.321778+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:01:53.321778+0000","last_undegraded":"2024-09-20T21:01:53.321778+0000","last_fullsized":"2024-09-20T21:01:53.321778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322159+0000","last_change":"2024-09-20T21:01:12.227395+0000","last_active":"2024-09-20T21:01:53.322159+0000","last_peered":"2024-09-20T21:01:53.322159+0000","last_clean":"2024-09-20T21:01:53.322159+0000","last_became_active":"2024-09-20T21:01:12.226122+0000","last_became_peered":"2024-09-20T21:01:12.226122+0000","last_unstale":"2024-09-20T21:01:53.322159+0000","last_undegraded":"2024-09-20T21:01:53.322159+0000","last_fullsized":"2024-09-20T21:01:53.322159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321503+0000","last_change":"2024-09-20T21:01:11.220367+0000","last_active":"2024-09-20T21:01:53.321503+0000","last_peered":"2024-09-20T21:01:53.321503+0000","last_clean":"2024-09-20T21:01:53.321503+0000","last_became_active":"2024-09-20T21:01:11.219090+0000","last_became_peered":"2024-09-20T21:01:11.219090+0000","last_unstale":"2024-09-20T21:01:53.321503+0000","last_undegraded":"2024-09-20T21:01:53.321503+0000","last_fullsized":"2024-09-20T21:01:53.321503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322502+0000","last_change":"2024-09-20T21:01:12.238895+0000","last_active":"2024-09-20T21:01:53.322502+0000","last_peered":"2024-09-20T21:01:53.322502+0000","last_clean":"2024-09-20T21:01:53.322502+0000","last_became_active":"2024-09-20T21:01:12.235481+0000","last_became_peered":"2024-09-20T21:01:12.235481+0000","last_unstale":"2024-09-20T21:01:53.322502+0000","last_undegraded":"2024-09-20T21:01:53.322502+0000","last_fullsized":"2024-09-20T21:01:53.322502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321040+0000","last_change":"2024-09-20T21:01:11.217493+0000","last_active":"2024-09-20T21:01:53.321040+0000","last_peered":"2024-09-20T21:01:53.321040+0000","last_clean":"2024-09-20T21:01:53.321040+0000","last_became_active":"2024-09-20T21:01:11.216073+0000","last_became_peered":"2024-09-20T21:01:11.216073+0000","last_unstale":"2024-09-20T21:01:53.321040+0000","last_undegraded":"2024-09-20T21:01:53.321040+0000","last_fullsized":"2024-09-20T21:01:53.321040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:23:30.512126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321665+0000","last_change":"2024-09-20T21:01:12.232371+0000","last_active":"2024-09-20T21:01:53.321665+0000","last_peered":"2024-09-20T21:01:53.321665+0000","last_clean":"2024-09-20T21:01:53.321665+0000","last_became_active":"2024-09-20T21:01:12.231450+0000","last_became_peered":"2024-09-20T21:01:12.231450+0000","last_unstale":"2024-09-20T21:01:53.321665+0000","last_undegraded":"2024-09-20T21:01:53.321665+0000","last_fullsized":"2024-09-20T21:01:53.321665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321225+0000","last_change":"2024-09-20T21:01:11.218440+0000","last_active":"2024-09-20T21:01:53.321225+0000","last_peered":"2024-09-20T21:01:53.321225+0000","last_clean":"2024-09-20T21:01:53.321225+0000","last_became_active":"2024-09-20T21:01:11.217722+0000","last_became_peered":"2024-09-20T21:01:11.217722+0000","last_unstale":"2024-09-20T21:01:53.321225+0000","last_undegraded":"2024-09-20T21:01:53.321225+0000","last_fullsized":"2024-09-20T21:01:53.321225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:11:02.101254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321965+0000","last_change":"2024-09-20T21:01:26.195014+0000","last_active":"2024-09-20T21:01:53.321965+0000","last_peered":"2024-09-20T21:01:53.321965+0000","last_clean":"2024-09-20T21:01:53.321965+0000","last_became_active":"2024-09-20T21:01:26.192848+0000","last_became_peered":"2024-09-20T21:01:26.192848+0000","last_unstale":"2024-09-20T21:01:53.321965+0000","last_undegraded":"2024-09-20T21:01:53.321965+0000","last_fullsized":"2024-09-20T21:01:53.321965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:28.674101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322217+0000","last_change":"2024-09-20T21:01:26.197383+0000","last_active":"2024-09-20T21:01:53.322217+0000","last_peered":"2024-09-20T21:01:53.322217+0000","last_clean":"2024-09-20T21:01:53.322217+0000","last_became_active":"2024-09-20T21:01:26.196662+0000","last_became_peered":"2024-09-20T21:01:26.196662+0000","last_unstale":"2024-09-20T21:01:53.322217+0000","last_undegraded":"2024-09-20T21:01:53.322217+0000","last_fullsized":"2024-09-20T21:01:53.322217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:35.350487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321955+0000","last_change":"2024-09-20T21:01:26.187436+0000","last_active":"2024-09-20T21:01:53.321955+0000","last_peered":"2024-09-20T21:01:53.321955+0000","last_clean":"2024-09-20T21:01:53.321955+0000","last_became_active":"2024-09-20T21:01:26.186319+0000","last_became_peered":"2024-09-20T21:01:26.186319+0000","last_unstale":"2024-09-20T21:01:53.321955+0000","last_undegraded":"2024-09-20T21:01:53.321955+0000","last_fullsized":"2024-09-20T21:01:53.321955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:04.716145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322589+0000","last_change":"2024-09-20T21:01:11.220332+0000","last_active":"2024-09-20T21:01:53.322589+0000","last_peered":"2024-09-20T21:01:53.322589+0000","last_clean":"2024-09-20T21:01:53.322589+0000","last_became_active":"2024-09-20T21:01:11.219022+0000","last_became_peered":"2024-09-20T21:01:11.219022+0000","last_unstale":"2024-09-20T21:01:53.322589+0000","last_undegraded":"2024-09-20T21:01:53.322589+0000","last_fullsized":"2024-09-20T21:01:53.322589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.928114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.322497+0000","last_change":"2024-09-20T21:01:12.238819+0000","last_active":"2024-09-20T21:01:53.322497+0000","last_peered":"2024-09-20T21:01:53.322497+0000","last_clean":"2024-09-20T21:01:53.322497+0000","last_became_active":"2024-09-20T21:01:12.237939+0000","last_became_peered":"2024-09-20T21:01:12.237939+0000","last_unstale":"2024-09-20T21:01:53.322497+0000","last_undegraded":"2024-09-20T21:01:53.322497+0000","last_fullsized":"2024-09-20T21:01:53.322497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.324350+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:01:53.324350+0000","last_peered":"2024-09-20T21:01:53.324350+0000","last_clean":"2024-09-20T21:01:53.324350+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:01:53.324350+0000","last_undegraded":"2024-09-20T21:01:53.324350+0000","last_fullsized":"2024-09-20T21:01:53.324350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.321483+0000","last_change":"2024-09-20T21:01:26.190436+0000","last_active":"2024-09-20T21:01:53.321483+0000","last_peered":"2024-09-20T21:01:53.321483+0000","last_clean":"2024-09-20T21:01:53.321483+0000","last_became_active":"2024-09-20T21:01:26.186848+0000","last_became_peered":"2024-09-20T21:01:26.186848+0000","last_unstale":"2024-09-20T21:01:53.321483+0000","last_undegraded":"2024-09-20T21:01:53.321483+0000","last_fullsized":"2024-09-20T21:01:53.321483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:03:53.389519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T21:01:53.323728+0000","last_change":"2024-09-20T21:01:11.222738+0000","last_active":"2024-09-20T21:01:53.323728+0000","last_peered":"2024-09-20T21:01:53.323728+0000","last_clean":"2024-09-20T21:01:53.323728+0000","last_became_active":"2024-09-20T21:01:11.221990+0000","last_became_peered":"2024-09-20T21:01:11.221990+0000","last_unstale":"2024-09-20T21:01:53.323728+0000","last_undegraded":"2024-09-20T21:01:53.323728+0000","last_fullsized":"2024-09-20T21:01:53.323728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4616880128,"num_objects":70448,"num_object_clones":0,"num_object_copies":140896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70448,"num_write_kb":4508672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577110016,"data_stored":9233760256,"data_compressed":44219124,"data_compressed_allocated":577110016,"data_compressed_original":9233760256,"omap_allocated":0,"internal_metadata":0},"log_size":60648,"ondisk_log_size":60648,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231076,"kb_used_data":155468,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94140764,"statfs":{"total":96636764160,"available":96400142336,"internally_reserved":0,"allocated":159199232,"data_stored":2541219212,"data_compressed":12177106,"data_compressed_allocated":158822400,"data_compressed_original":2541076480,"omap_allocated":1596,"internal_metadata":77396420},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,5,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738382,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247572,"kb_used_data":171960,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94124268,"statfs":{"total":96636764160,"available":96383250432,"internally_reserved":0,"allocated":176087040,"data_stored":2811228167,"data_compressed":13470156,"data_compressed_allocated":175697920,"data_compressed_original":2811084800,"omap_allocated":1596,"internal_metadata":77396420},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307260,"kb_used_data":226084,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94064580,"statfs":{"total":96636764160,"available":96322129920,"internally_reserved":0,"allocated":231510016,"data_stored":3698779877,"data_compressed":17712204,"data_compressed_allocated":231165952,"data_compressed_original":3698655232,"omap_allocated":1596,"internal_metadata":83098052},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,4,1,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":235106304,"data_stored":3761700864,"data_compressed":18014272,"data_compressed_allocated":235106304,"data_compressed_original":3761700864,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":179888128,"data_stored":2878210048,"data_compressed":13783334,"data_compressed_allocated":179888128,"data_compressed_original":2878210048,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162115584,"data_stored":2593849344,"data_compressed":12421518,"data_compressed_allocated":162115584,"data_compressed_original":2593849344,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:01:59.235 INFO:tasks.thrashosds.thrasher:Setting 5.f to [2, 0, 1] 2024-09-20T21:01:59.236 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '5.f', '2', '0', '1'] 2024-09-20T21:01:59.236 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 5.f 2 0 1 2024-09-20T21:01:59.236 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:01:59.242 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 32 16 79396 79380 155.023 132.625 0.00551126 0.00644614 2024-09-20T21:01:59.330 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:59.328+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:59.391 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:59.391 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:59.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.391 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:79689 5.5 5:a54ad31b:::benchmark_data_smithi112_23632_object79688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:59.391 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.385816+0000", 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0043128639999999996, 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0043436719999999998, 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 79689 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385816+0000", 2024-09-20T21:01:59.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385816+0000", 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385816+0000", 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3499999999999995e-07 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385853+0000", 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6918000000000001e-05 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385864+0000", 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0199e-05 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385871+0000", 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8690000000000004e-06 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385934+0000", 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2717000000000003e-05 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386073+0000", 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013903400000000001 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386220+0000", 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014677399999999999 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:79690 5.c 5:3539061a:::benchmark_data_smithi112_23632_object79689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.385976+0000", 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.004152279, 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0042612800000000001, 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 79690 2024-09-20T21:01:59.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385976+0000", 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385976+0000", 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385977+0000", 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.06e-07 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386131+0000", 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015452099999999999 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386140+0000", 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6580000000000008e-06 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386146+0000", 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.66e-06 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386190+0000", 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3912999999999998e-05 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386305+0000", 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011499500000000001 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386430+0000", 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012565800000000001 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:79691 5.e e35/21 5:72136780:::benchmark_data_smithi112_23632_object79690:head v 35'5003, mlcod=35'5000)", 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.386665+0000", 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0034632550000000002, 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0036397069999999998, 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.400 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386665+0000", 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386665+0000", 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386666+0000", 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.37e-07 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386712+0000", 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6072000000000002e-05 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386725+0000", 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2745000000000001e-05 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386731+0000", 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9889999999999997e-06 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386809+0000", 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8170000000000005e-05 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.386826+0000", 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6854000000000002e-05 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.403 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:79687 5.0 e35/21 5:0cf8d72e:::benchmark_data_smithi112_23632_object79686:head v 35'4930, mlcod=35'4926)", 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.387245+0000", 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002883128, 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031126819999999999, 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.387245+0000", 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.387245+0000", 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.387246+0000", 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4000000000000001e-07 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.387300+0000", 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3774999999999999e-05 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.387308+0000", 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3180000000000007e-06 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.387314+0000", 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7509999999999997e-06 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389750+0000", 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0024364159999999998 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389772+0000", 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1440000000000001e-05 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:79693 5.e e35/21 5:74414e4a:::benchmark_data_smithi112_23632_object79692:head v 35'5004, mlcod=35'5000)", 2024-09-20T21:01:59.407 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.389103+0000", 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001025764, 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001310526, 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389103+0000", 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389103+0000", 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389104+0000", 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000002e-07 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389206+0000", 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101808 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389213+0000", 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4590000000000001e-06 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389217+0000", 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.498e-06 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389254+0000", 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6854000000000003e-05 2024-09-20T21:01:59.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389266+0000", 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1436e-05 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:79694 5.a 5:5f825176:::benchmark_data_smithi112_23632_object79693:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.389136+0000", 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00099264800000000005, 2024-09-20T21:01:59.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001334439, 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 79694 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389136+0000", 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389136+0000", 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389137+0000", 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.17e-06 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389234+0000", 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6665999999999999e-05 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389245+0000", 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1362999999999999e-05 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389256+0000", 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0747999999999999e-05 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389319+0000", 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3192000000000001e-05 2024-09-20T21:01:59.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389428+0000", 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010860400000000001 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389533+0000", 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105789 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.415 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:79695 5.8 e35/21 5:15201830:::benchmark_data_smithi112_23632_object79694:head v 35'4987, mlcod=35'4984)", 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.389964+0000", 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00016435500000000001, 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00057158999999999997, 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389964+0000", 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389964+0000", 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389965+0000", 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5499999999999998e-07 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390060+0000", 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4796000000000005e-05 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390070+0000", 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0643e-05 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390078+0000", 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2230000000000001e-06 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390122+0000", 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4573999999999997e-05 2024-09-20T21:01:59.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390144+0000", 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1993000000000001e-05 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:79696 5.c 5:3c8463ed:::benchmark_data_smithi112_23632_object79695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.390399+0000", 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9997296, 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019791899999999999, 2024-09-20T21:01:59.419 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 79696 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390399+0000", 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390399+0000", 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390400+0000", 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8000000000000004e-07 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390461+0000", 2024-09-20T21:01:59.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1768999999999998e-05 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390475+0000", 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3253e-05 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390481+0000", 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6270000000000002e-06 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.390535+0000", 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3934000000000002e-05 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:79674 5.0 e35/21 5:0aee284f:::benchmark_data_smithi112_23632_object79673:head v 35'4928, mlcod=35'4926)", 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.381012+0000", 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0091161409999999995, 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096465960000000003, 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.423 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.381012+0000", 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.381012+0000", 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.381013+0000", 2024-09-20T21:01:59.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0999999999999998e-07 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.381062+0000", 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8343000000000001e-05 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.381071+0000", 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7710000000000001e-06 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.381091+0000", 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9306000000000001e-05 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383465+0000", 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023743390000000001 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383484+0000", 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8904000000000001e-05 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.426 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:79682 5.8 e35/21 5:158ba919:::benchmark_data_smithi112_23632_object79681:head v 35'4986, mlcod=35'4983)", 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.383509+0000", 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0066198489999999997, 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072041659999999997, 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383509+0000", 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383509+0000", 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383509+0000", 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.22e-07 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383534+0000", 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4462000000000001e-05 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383540+0000", 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3799999999999999e-06 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383544+0000", 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.296e-06 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385447+0000", 2024-09-20T21:01:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001902291 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385465+0000", 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8342000000000002e-05 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:79679 5.e e35/21 5:77ed4612:::benchmark_data_smithi112_23632_object79678:head v 35'5002, mlcod=35'4999)", 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.383555+0000", 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0065740269999999996, 2024-09-20T21:01:59.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072151899999999998, 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383555+0000", 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383555+0000", 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383555+0000", 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4900000000000002e-07 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383578+0000", 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3302000000000002e-05 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383584+0000", 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8279999999999999e-06 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383588+0000", 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4070000000000003e-06 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383630+0000", 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1819000000000001e-05 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.383646+0000", 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6239000000000002e-05 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.433 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:79683 5.a 5:59eb03da:::benchmark_data_smithi112_23632_object79682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.384364+0000", 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0057642270000000002, 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064707790000000003, 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 79683 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.384364+0000", 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.384364+0000", 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.384365+0000", 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.066e-06 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.384393+0000", 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7472999999999999e-05 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.384401+0000", 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.384407+0000", 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4430000000000002e-06 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385320+0000", 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00091287200000000001 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.387476+0000", 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021562209999999998 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.387581+0000", 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104696 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:79685 5.0 e35/21 5:019290cd:::benchmark_data_smithi112_23632_object79684:head v 35'4929, mlcod=35'4926)", 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.385063+0000", 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.005066007, 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058479880000000001, 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.438 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385063+0000", 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385063+0000", 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385063+0000", 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1999999999999999e-07 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385121+0000", 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7380999999999998e-05 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385129+0000", 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2619999999999998e-06 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385133+0000", 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4880000000000001e-06 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.387531+0000", 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023976919999999999 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.387551+0000", 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9930999999999999e-05 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:79684 5.2 5:49d09847:::benchmark_data_smithi112_23632_object79683:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.385298+0000", 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0048303, 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056757719999999999, 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 79684 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.442 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385298+0000", 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385298+0000", 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385299+0000", 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.61e-07 2024-09-20T21:01:59.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385331+0000", 2024-09-20T21:01:59.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1859000000000001e-05 2024-09-20T21:01:59.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385339+0000", 2024-09-20T21:01:59.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9640000000000003e-06 2024-09-20T21:01:59.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385344+0000", 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7029999999999997e-06 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385388+0000", 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4158e-05 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385515+0000", 2024-09-20T21:01:59.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012712499999999999 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385655+0000", 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014014100000000001 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389208+0000", 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035528170000000002 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:79686 5.7 5:e7d5fa28:::benchmark_data_smithi112_23632_object79685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:59.385355+0000", 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0047740339999999999, 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.005700381, 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 79686 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385355+0000", 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385355+0000", 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385355+0000", 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385385+0000", 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9434e-05 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385391+0000", 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7410000000000003e-06 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385397+0000", 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4890000000000003e-06 2024-09-20T21:01:59.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385451+0000", 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4342000000000002e-05 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385565+0000", 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011419 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.385681+0000", 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116073 2024-09-20T21:01:59.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:59.389380+0000", 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0036982920000000002 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 15 2024-09-20T21:01:59.452 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:59.454 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:01:59.451+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:01:59.454 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:01:59.554 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:59.549+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:59.577 INFO:teuthology.orchestra.run.smithi112.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-20T21:01:59.584 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T21:01:59.585 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-20T21:01:59.607 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:59.608 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:01:59.608 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:01:59.608 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:01:59.608 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:59.629 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:01:59.655 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:01:59.652+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:01:59.756 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:59.753+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:01:59.825 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:01:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:01:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 47.629658847000002, 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:01:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:01:59.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 47.629524648, 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:01:59.832 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:01:59.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:59.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:01:59.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:01:59.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:01:59.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 47.629419642000002, 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:01:59.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:59.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.846 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 47.629300117, 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:01:59.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.852 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 47.629230110000002, 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:59.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:01:59.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:01:59.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:01:59.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.859 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 47.629155058000002, 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:01:59.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.865 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 47.629068031999999, 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:01:59.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:01:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.870 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 47.628999258999997, 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:59.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:01:59.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 47.628912999999997, 2024-09-20T21:01:59.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:01:59.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:01:59.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.881 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62101 5.8 e31/21 5:186de704:::benchmark_data_smithi112_23632_object62100:head v 31'3911, mlcod=31'3909)", 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8630920440000001, 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02729376, 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960799+0000", 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:01:59.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960852+0000", 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3016000000000002e-05 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960860+0000", 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7370000000000006e-06 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960864+0000", 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3209999999999998e-06 2024-09-20T21:01:59.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960904+0000", 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9703000000000003e-05 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960917+0000", 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2794e-05 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988055+0000", 2024-09-20T21:01:59.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027138394 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988092+0000", 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7104999999999998e-05 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62103 5.c 5:3565fe84:::benchmark_data_smithi112_23632_object62102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:59.886 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8625730360000006, 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026906978000000002, 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62103 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961319+0000", 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.128e-06 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961404+0000", 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5373999999999999e-05 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961419+0000", 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4939e-05 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961424+0000", 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4940000000000003e-06 2024-09-20T21:01:59.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961486+0000", 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1692000000000005e-05 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961602+0000", 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011565600000000001 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961724+0000", 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012265900000000001 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.967186+0000", 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054620220000000004 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988148+0000", 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020962027000000001 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988190+0000", 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1585000000000002e-05 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988224+0000", 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4402e-05 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62102 5.0 e31/21 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head v 31'3819, mlcod=31'3816)", 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8621922350000002, 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026424553999999999, 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961699+0000", 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961726+0000", 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6999e-05 2024-09-20T21:01:59.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961735+0000", 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8359999999999998e-06 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961739+0000", 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7790000000000003e-06 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961785+0000", 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5707000000000001e-05 2024-09-20T21:01:59.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961803+0000", 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7609e-05 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988095+0000", 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026292257999999999 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988123+0000", 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810999999999999e-05 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.896 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62110 5.c 5:31284d1b:::benchmark_data_smithi112_23632_object62109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8612387889999997, 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025650796, 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62110 2024-09-20T21:01:59.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962653+0000", 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1100000000000005e-07 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962762+0000", 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109282 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962771+0000", 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4080000000000004e-06 2024-09-20T21:01:59.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962777+0000", 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.857e-06 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964273+0000", 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001495959 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964527+0000", 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025392500000000001 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964653+0000", 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126033 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988138+0000", 2024-09-20T21:01:59.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023485176 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988231+0000", 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2940000000000001e-05 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988272+0000", 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0713999999999997e-05 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988303+0000", 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0691000000000001e-05 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62105 5.8 e31/21 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head v 31'3912, mlcod=31'3909)", 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8602670129999996, 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024588011999999999, 2024-09-20T21:01:59.903 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7999999999999995e-07 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963684+0000", 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0146000000000003e-05 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963695+0000", 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0939e-05 2024-09-20T21:01:59.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963701+0000", 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.241e-06 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964203+0000", 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050127400000000001 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964220+0000", 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7410000000000001e-05 2024-09-20T21:01:59.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988152+0000", 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023932235999999999 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988212+0000", 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9185999999999999e-05 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62106 5.0 e31/21 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head v 31'3820, mlcod=31'3816)", 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8601560320000008, 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024416087999999999, 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963735+0000", 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6000000000000004e-07 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963800+0000", 2024-09-20T21:01:59.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4455000000000005e-05 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963808+0000", 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9530000000000005e-06 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963814+0000", 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0009999999999998e-06 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964329+0000", 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00051435800000000002 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964339+0000", 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0438999999999999e-05 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988125+0000", 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023785555999999999 2024-09-20T21:01:59.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988151+0000", 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5766e-05 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62111 5.2 5:44febcde:::benchmark_data_smithi112_23632_object62110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:01:59.912 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8599782220000005, 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024229619000000001, 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62111 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963913+0000", 2024-09-20T21:01:59.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1200000000000002e-07 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964060+0000", 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147355 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964069+0000", 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1120000000000002e-06 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964074+0000", 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8199999999999996e-06 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964334+0000", 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025997599999999998 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964443+0000", 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108497 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964549+0000", 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105781 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.976088+0000", 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011539822 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988059+0000", 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011970550999999999 2024-09-20T21:01:59.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988107+0000", 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8473999999999997e-05 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988142+0000", 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4518999999999999e-05 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:62098 5.3 e31/21 ondisk, result = 0)", 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8592856219999998, 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023464459999999999, 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8000000000000001e-07 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964608+0000", 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9620000000000002e-06 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964618+0000", 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8870000000000004e-06 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964629+0000", 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0679000000000001e-05 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965787+0000", 2024-09-20T21:01:59.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011576959999999999 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965795+0000", 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0779999999999996e-06 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988069+0000", 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022274777999999999 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.922 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62114 5.e e31/21 5:7d451501:::benchmark_data_smithi112_23632_object62113:head v 31'3936, mlcod=31'3934)", 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8580086179999995, 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025697174999999999, 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965883+0000", 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6499999999999999e-07 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965942+0000", 2024-09-20T21:01:59.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9815999999999998e-05 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965950+0000", 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8590000000000005e-06 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965956+0000", 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9460000000000003e-06 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965999+0000", 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3214999999999999e-05 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966030+0000", 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.01e-05 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991550+0000", 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025520185000000001 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991579+0000", 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9388999999999999e-05 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62116 5.4 e31/21 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head v 31'3927, mlcod=31'3925)", 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8576586890000009, 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024173271, 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.927 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.44e-07 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966300+0000", 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7484999999999995e-05 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966309+0000", 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5730000000000008e-06 2024-09-20T21:01:59.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966315+0000", 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9630000000000003e-06 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966374+0000", 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.94e-05 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966390+0000", 2024-09-20T21:01:59.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6412000000000001e-05 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.990372+0000", 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023981372000000001 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.990405+0000", 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3422e-05 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.931 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62115 5.e e31/21 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head v 31'3937, mlcod=31'3934)", 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.8558739519999996, 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023580685000000001, 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:01:59.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7800000000000001e-07 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968091+0000", 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3468999999999997e-05 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968100+0000", 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.645e-06 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968107+0000", 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.725e-06 2024-09-20T21:01:59.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.970256+0000", 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021493810000000001 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.970272+0000", 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5489e-05 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991582+0000", 2024-09-20T21:01:59.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021310490000000001 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991597+0000", 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4808e-05 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:01:59.936 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:01:59.938 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:01:59.938 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:01:59.933+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:00.038 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:00.035+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:81150 5.1 e35/21 5:80bc7552:::benchmark_data_smithi112_23632_object81149:head v 35'5164, mlcod=35'5162)", 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:00.095272+0000", 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.001132561, 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001157277, 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:00.097 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095272+0000", 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095272+0000", 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:00.098 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095273+0000", 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6399999999999998e-07 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095305+0000", 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.2156999999999997e-05 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095309+0000", 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7559999999999999e-06 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.099 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095313+0000", 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.1970000000000001e-06 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095351+0000", 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.8654e-05 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095365+0000", 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3492000000000001e-05 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:00.100 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:81152 5.9 e35/21)", 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:00.096211+0000", 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00019389799999999999, 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028639399999999998, 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096211+0000", 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.101 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096211+0000", 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096212+0000", 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.207e-06 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.102 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.103 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:00.103 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096251+0000", 2024-09-20T21:02:00.103 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.8905000000000001e-05 2024-09-20T21:02:00.103 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.103 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.103 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:00.103 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096270+0000", 2024-09-20T21:02:00.103 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9026999999999999e-05 2024-09-20T21:02:00.103 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.103 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096278+0000", 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.1089999999999998e-06 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:81151 5.7 e35/21 5:e6773e66:::benchmark_data_smithi112_23632_object81150:head v 35'5058, mlcod=35'5056)", 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:00.096331+0000", 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 7.3446000000000001e-05, 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000221344, 2024-09-20T21:02:00.104 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096331+0000", 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096331+0000", 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.105 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096332+0000", 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7199999999999998e-07 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096396+0000", 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3731000000000004e-05 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096405+0000", 2024-09-20T21:02:00.106 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.594e-06 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096412+0000", 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.037e-06 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096465+0000", 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.3822000000000001e-05 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.107 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096487+0000", 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1316999999999999e-05 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:81145 5.c e35/21 5:32af04a2:::benchmark_data_smithi112_23632_object81144:head v 35'5014, mlcod=35'5010)", 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:00.096430+0000", 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 4294967295.9999752, 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000189839, 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:00.108 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096430+0000", 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096430+0000", 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096430+0000", 2024-09-20T21:02:00.109 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.2300000000000002e-07 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096465+0000", 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.4999000000000002e-05 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096472+0000", 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.2660000000000004e-06 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.110 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096477+0000", 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.882e-06 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096592+0000", 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011490200000000001 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096610+0000", 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7856e-05 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.111 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:81139 5.2 e35/21 5:4cf7735c:::benchmark_data_smithi112_23632_object81138:head v 35'5068, mlcod=35'5065)", 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:00.092661+0000", 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.003744299, 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004033521, 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:00.112 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.092661+0000", 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.092661+0000", 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.092661+0000", 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.34e-07 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.113 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.092706+0000", 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.4586000000000003e-05 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.092715+0000", 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4949999999999997e-06 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.114 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.092721+0000", 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.2899999999999999e-06 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.092780+0000", 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.9094e-05 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.092804+0000", 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3390000000000001e-05 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:81143 5.2 e35/21 5:42a5e3f2:::benchmark_data_smithi112_23632_object81142:head v 35'5069, mlcod=35'5065)", 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:00.093049+0000", 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0033562399999999999, 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037095779999999998, 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.093049+0000", 2024-09-20T21:02:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.093049+0000", 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.093049+0000", 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.5699999999999998e-07 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.093113+0000", 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.4188000000000003e-05 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.093124+0000", 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.06e-05 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.093130+0000", 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.7450000000000001e-06 2024-09-20T21:02:00.118 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094837+0000", 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001707058 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094857+0000", 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0591e-05 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.119 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:81144 5.c e35/21 5:3e512055:::benchmark_data_smithi112_23632_object81143:head v 35'5013, mlcod=35'5010)", 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:00.094333+0000", 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.002071809, 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024881249999999999, 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094333+0000", 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.120 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094333+0000", 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094342+0000", 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.7609999999999996e-06 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094368+0000", 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6149e-05 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.121 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094377+0000", 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4919999999999999e-06 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094385+0000", 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1810000000000004e-06 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094803+0000", 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00041826800000000001 2024-09-20T21:02:00.122 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094815+0000", 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2295e-05 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:81147 5.2 e35/21 5:4e969f9d:::benchmark_data_smithi112_23632_object81146:head v 35'5070, mlcod=35'5065)", 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:00.094973+0000", 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.001432029, 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0019119930000000001, 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:00.123 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:00.124 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:00.124 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:00.124 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.124 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:00.124 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094973+0000", 2024-09-20T21:02:00.124 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.124 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.124 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.124 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094973+0000", 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.094973+0000", 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.0200000000000002e-07 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095026+0000", 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.2784000000000001e-05 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095039+0000", 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3135e-05 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095046+0000", 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8940000000000004e-06 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096529+0000", 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0014832549999999999 2024-09-20T21:02:00.126 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.096546+0000", 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6871000000000002e-05 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:81148 5.5 e35/21 5:a7658460:::benchmark_data_smithi112_23632_object81147:head v 35'5072, mlcod=35'5070)", 2024-09-20T21:02:00.127 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:00.095186+0000", 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.001218993, 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001767825, 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095186+0000", 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:00.128 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095186+0000", 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095186+0000", 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.4099999999999999e-07 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095246+0000", 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.9848e-05 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.129 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095254+0000", 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.2090000000000005e-06 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095259+0000", 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.2740000000000001e-06 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095298+0000", 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.9373999999999999e-05 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:00.130 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:00.131 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:00.131 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:00.095314+0000", 2024-09-20T21:02:00.131 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6466000000000001e-05 2024-09-20T21:02:00.131 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.131 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:00.131 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.131 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:00.131 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:02:00.131 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 9 2024-09-20T21:02:00.131 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:00.132 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:00.177 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:00.176+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:00.237 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:00.240 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:00.237+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:00.242 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 33 16 81461 81445 154.236 129.062 0.00757474 0.00647914 2024-09-20T21:02:00.277 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:00.278 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:02:00.278 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:02:00.278 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:02:00.278 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:00.297 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:00.341 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:00.339+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:00.389 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:02:00.403 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:00.403 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:00.421 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:00.421 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:00.438 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:00.438 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:00.441 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:00.437+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:00.489 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:00.489 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:00.509 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:00.552 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:00.551+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:00.642 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:00.640+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:00.665 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:00.666 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:00.684 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:00.743 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:00.737+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:00.844 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:00.839+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:00.874 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:00.874 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:00.896 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:00.945 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:00.943+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:01.046 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:01.044+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:01.103 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:01.103 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:01.126 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:01.146 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:01.143+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:01.243 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 34 16 83536 83520 153.513 129.688 0.0121083 0.00650941 2024-09-20T21:02:01.247 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:01.243+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:01.282 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:01.283 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:01.304 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:01.348 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:01.345+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:01.380 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:02:01.448 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:01.445+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:01.460 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:01.460 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:01.482 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:01.567 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:01.565+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:01.651 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:01.648+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:01.680 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:01.680 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:01.702 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:02:01.751 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:01.747+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:01.848 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:01.848 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:01.852 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:01.849+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:01.868 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:01.953 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:01.952+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:02.020 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:02.020 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:02.041 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:02.082 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:02.080+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:02.154 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:02.151+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:02.228 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:02.228 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:02.243 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 35 16 85599 85583 152.811 128.938 0.00840375 0.00653982 2024-09-20T21:02:02.249 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:02.255 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:02.253+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:02.356 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:02.355+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:02.407 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:02.407 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:02.430 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:02.457 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:02.473 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:02.471+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:02.558 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:02.553+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:02.616 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:02.616 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:02.630 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:02.630 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:02.635 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:02.635 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:02.650 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:02.655 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:02.655 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:02.659 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:02.656+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:02.760 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:02.756+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:02.807 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:02.807 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:02.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:02.807 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:02.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.807 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 50.610490579999997, 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:02.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.813 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 50.610400544000001, 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.814 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:02.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:02.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 50.610314191000001, 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:02.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.822 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.823 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 50.610245382000002, 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.826 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.827 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.828 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:02.829 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:02.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 50.610212521999998, 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.833 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.834 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.835 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 50.610170504999999, 2024-09-20T21:02:02.838 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.839 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:02.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:02.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 50.610045399000001, 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:02.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:02.850 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 50.609953050000001, 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:02.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:02.855 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 50.609868677999998, 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:02.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.860 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16441 5.4 5:231ae493:::benchmark_data_smithi112_23632_object16440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.582958507000001, 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018694967999999999, 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16441 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223603+0000", 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223604+0000", 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0020000000000001e-06 2024-09-20T21:02:02.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223754+0000", 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014907899999999999 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223769+0000", 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5207e-05 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223787+0000", 2024-09-20T21:02:02.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8685000000000002e-05 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223852+0000", 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5012999999999996e-05 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017955400000000001 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224223+0000", 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000191428 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225787+0000", 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001563617 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242143+0000", 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01635615 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242235+0000", 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2250000000000006e-05 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242298+0000", 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2983000000000003e-05 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:16446 5.0 5:01f8c0ba:::benchmark_data_smithi112_23632_object16445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-20T21:02:02.866 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.582582375000001, 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018538079999999998, 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 16446 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.223980+0000", 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5799999999999999e-07 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224021+0000", 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1053000000000001e-05 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224032+0000", 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.111e-05 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.224040+0000", 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5480000000000004e-06 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225554+0000", 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001513749 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.225818+0000", 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026389300000000002 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.226084+0000", 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026617999999999998 2024-09-20T21:02:02.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.227457+0000", 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013727030000000001 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242319+0000", 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014862492 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242426+0000", 2024-09-20T21:02:02.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107291 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:32.242518+0000", 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1403000000000006e-05 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:53511 5.4 5:2d6e90d5:::benchmark_data_smithi112_23632_object53510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.842822794, 2024-09-20T21:02:02.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018936089999999999, 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 53511 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963739+0000", 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963740+0000", 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0800000000000004e-07 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963784+0000", 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3857999999999999e-05 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963796+0000", 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2e-05 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.963803+0000", 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2259999999999999e-06 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.964837+0000", 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010340379999999999 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.964924+0000", 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6669000000000007e-05 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.965060+0000", 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136594 2024-09-20T21:02:02.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.969393+0000", 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0043331259999999996 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982603+0000", 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.013210095999999999 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982638+0000", 2024-09-20T21:02:02.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4981999999999998e-05 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:46.982675+0000", 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6893000000000001e-05 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:02.878 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 11.844409221999999, 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:02.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:02.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 11.843857216, 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:02.884 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:02.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.889 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 11.843229635, 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.890 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:02.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:02.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:02.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:02.895 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 11.843118626000001, 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:02.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:02.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:02.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:02.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 11.839452114, 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.901 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:02.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:02.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:02.906 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 11.83913778, 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:02.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 11.838955662, 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.912 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:02.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:02.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:02.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:78251 5.4 5:2834294e:::benchmark_data_smithi112_23632_object78250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:58.712374+0000", 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.0941883429999999, 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019217326999999999, 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:02.918 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 78251 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712374+0000", 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712374+0000", 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:02.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712374+0000", 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4700000000000001e-07 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712439+0000", 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4790999999999997e-05 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712447+0000", 2024-09-20T21:02:02.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0069999999999997e-06 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.712452+0000", 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1959999999999999e-06 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.716939+0000", 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0044865620000000004 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.717044+0000", 2024-09-20T21:02:02.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000104867 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.717169+0000", 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012548 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.722430+0000", 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0052605880000000001 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.731515+0000", 2024-09-20T21:02:02.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0090854549999999992 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.731549+0000", 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3485999999999998e-05 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:58.731591+0000", 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2348000000000002e-05 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.923 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:02.924 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:02.924 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:02.925 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:02.923+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:02.925 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:03.025 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:03.024+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:03.086 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:87328 5.c 5:3cbc5d96:::benchmark_data_smithi112_23632_object87327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-20T21:02:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:03.078536+0000", 2024-09-20T21:02:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0072275630000000002, 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072563460000000003, 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 87328 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.078536+0000", 2024-09-20T21:02:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.078536+0000", 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.078537+0000", 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9400000000000005e-07 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.078573+0000", 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6483000000000003e-05 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.078581+0000", 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.055e-06 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.078588+0000", 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2239999999999998e-06 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.079600+0000", 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010116859999999999 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.079748+0000", 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014793200000000001 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.079917+0000", 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016862999999999999 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082123+0000", 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00220659 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:87331 5.4 e36/21 5:2063e458:::benchmark_data_smithi112_23632_object87330:head v 36'5525, mlcod=36'5523)", 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:03.081875+0000", 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003888519, 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039688900000000001, 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.081875+0000", 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.081875+0000", 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.081876+0000", 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.081920+0000", 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4116999999999998e-05 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.081930+0000", 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0016e-05 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.081936+0000", 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3860000000000004e-06 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082028+0000", 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2054999999999999e-05 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082047+0000", 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8685000000000002e-05 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:87337 5.2 5:4a432071:::benchmark_data_smithi112_23632_object87336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:03.082514+0000", 2024-09-20T21:02:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0032497239999999998, 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003369543, 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 87337 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082514+0000", 2024-09-20T21:02:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082514+0000", 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082515+0000", 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8999999999999995e-07 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082607+0000", 2024-09-20T21:02:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2155000000000001e-05 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082618+0000", 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1508000000000001e-05 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082625+0000", 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3040000000000001e-06 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082667+0000", 2024-09-20T21:02:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2549000000000002e-05 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082783+0000", 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011569399999999999 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082906+0000", 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012285900000000001 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085246+0000", 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023402710000000001 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085872+0000", 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00062637399999999996 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:87338 5.1 5:897207a7:::benchmark_data_smithi112_23632_object87337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:03.082816+0000", 2024-09-20T21:02:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002947206, 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031150629999999999, 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 87338 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082816+0000", 2024-09-20T21:02:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082816+0000", 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082817+0000", 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1900000000000002e-07 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082920+0000", 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102673 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082928+0000", 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0590000000000003e-06 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082933+0000", 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6019999999999999e-06 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.082986+0000", 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2593999999999998e-05 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.083100+0000", 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113897 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.083234+0000", 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013425000000000001 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085739+0000", 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025046420000000001 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:87339 5.0 e36/21 5:02481478:::benchmark_data_smithi112_23632_object87338:head v 36'5383, mlcod=36'5381)", 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:03.083437+0000", 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0023263530000000002, 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025350260000000001, 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.083437+0000", 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.083437+0000", 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.083438+0000", 2024-09-20T21:02:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999999e-07 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.083519+0000", 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1318999999999998e-05 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.083535+0000", 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5764e-05 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.083543+0000", 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4900000000000003e-06 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.083601+0000", 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8560000000000002e-05 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.083618+0000", 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6719999999999999e-05 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:87336 5.4 e36/21 5:2e8b9190:::benchmark_data_smithi112_23632_object87335:head v 36'5526, mlcod=36'5523)", 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:03.084320+0000", 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0014438680000000001, 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001691978, 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.084320+0000", 2024-09-20T21:02:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.084320+0000", 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.084320+0000", 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9699999999999995e-07 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.084375+0000", 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4545e-05 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.084386+0000", 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1026000000000001e-05 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.084392+0000", 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8629999999999996e-06 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.084443+0000", 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1557000000000001e-05 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.084476+0000", 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2555999999999998e-05 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:87328 5.c e36/21)", 2024-09-20T21:02:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:03.085394+0000", 2024-09-20T21:02:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00036934199999999999, 2024-09-20T21:02:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064675900000000001, 2024-09-20T21:02:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085394+0000", 2024-09-20T21:02:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085394+0000", 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085395+0000", 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7299999999999996e-07 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085397+0000", 2024-09-20T21:02:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7180000000000001e-06 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085419+0000", 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1231999999999999e-05 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085427+0000", 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9149999999999996e-06 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:87340 5.6 5:6cca06c5:::benchmark_data_smithi112_23632_object87339:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:03.085865+0000", 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9998989, 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022439199999999999, 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 87340 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085865+0000", 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085865+0000", 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085866+0000", 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0419999999999999e-06 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085953+0000", 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7672999999999999e-05 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085964+0000", 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0309000000000001e-05 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085970+0000", 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.844e-06 2024-09-20T21:02:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.086018+0000", 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7302999999999998e-05 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:87342 5.3 5:cf69d430:::benchmark_data_smithi112_23632_object87341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:03.085993+0000", 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9997706, 2024-09-20T21:02:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000131435, 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 87342 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085993+0000", 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085993+0000", 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.085993+0000", 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4799999999999998e-07 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.086025+0000", 2024-09-20T21:02:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1381999999999999e-05 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.086033+0000", 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7810000000000005e-06 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.086040+0000", 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8669999999999994e-06 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:03.086095+0000", 2024-09-20T21:02:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4249000000000002e-05 2024-09-20T21:02:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 9 2024-09-20T21:02:03.123 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:03.124 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:03.126 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:03.123+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:03.227 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:03.223+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:03.243 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 36 16 87668 87652 152.158 129.312 0.0113689 0.00656755 2024-09-20T21:02:03.280 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:03.281 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:03.281 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:03.281 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:03.281 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:03.302 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:03.348 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:03.345+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:03.401 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T21:02:03.428 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:03.424+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:03.461 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 51.265157152, 2024-09-20T21:02:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 51.265022952999999, 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:03.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:03.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 51.264917947000001, 2024-09-20T21:02:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 51.264798421999998, 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 51.264728415, 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 51.264653363000001, 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 51.264566336999998, 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 51.264497564000003, 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 51.264411305000003, 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62101 5.8 e31/21 5:186de704:::benchmark_data_smithi112_23632_object62100:head v 31'3911, mlcod=31'3909)", 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.498590349000001, 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02729376, 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960799+0000", 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960852+0000", 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3016000000000002e-05 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960860+0000", 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7370000000000006e-06 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960864+0000", 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3209999999999998e-06 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960904+0000", 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9703000000000003e-05 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960917+0000", 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2794e-05 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988055+0000", 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027138394 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988092+0000", 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7104999999999998e-05 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62103 5.c 5:3565fe84:::benchmark_data_smithi112_23632_object62102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.498071340999999, 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026906978000000002, 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62103 2024-09-20T21:02:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961319+0000", 2024-09-20T21:02:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.128e-06 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961404+0000", 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5373999999999999e-05 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961419+0000", 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4939e-05 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961424+0000", 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4940000000000003e-06 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961486+0000", 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1692000000000005e-05 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961602+0000", 2024-09-20T21:02:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011565600000000001 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961724+0000", 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012265900000000001 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.967186+0000", 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054620220000000004 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988148+0000", 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020962027000000001 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988190+0000", 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1585000000000002e-05 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988224+0000", 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4402e-05 2024-09-20T21:02:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62102 5.0 e31/21 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head v 31'3819, mlcod=31'3816)", 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.497690540000001, 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026424553999999999, 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961699+0000", 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961726+0000", 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6999e-05 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961735+0000", 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8359999999999998e-06 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961739+0000", 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7790000000000003e-06 2024-09-20T21:02:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961785+0000", 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5707000000000001e-05 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961803+0000", 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7609e-05 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988095+0000", 2024-09-20T21:02:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026292257999999999 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988123+0000", 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810999999999999e-05 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62110 5.c 5:31284d1b:::benchmark_data_smithi112_23632_object62109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:02:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.496737094, 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025650796, 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62110 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:02:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962653+0000", 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1100000000000005e-07 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962762+0000", 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109282 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962771+0000", 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4080000000000004e-06 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962777+0000", 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.857e-06 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964273+0000", 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001495959 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964527+0000", 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025392500000000001 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964653+0000", 2024-09-20T21:02:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126033 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988138+0000", 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023485176 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988231+0000", 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2940000000000001e-05 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988272+0000", 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0713999999999997e-05 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988303+0000", 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0691000000000001e-05 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62105 5.8 e31/21 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head v 31'3912, mlcod=31'3909)", 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.495765318, 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024588011999999999, 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7999999999999995e-07 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963684+0000", 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0146000000000003e-05 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963695+0000", 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0939e-05 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963701+0000", 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.241e-06 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964203+0000", 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050127400000000001 2024-09-20T21:02:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964220+0000", 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7410000000000001e-05 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988152+0000", 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023932235999999999 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988212+0000", 2024-09-20T21:02:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9185999999999999e-05 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62106 5.0 e31/21 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head v 31'3820, mlcod=31'3816)", 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.495654337, 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024416087999999999, 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963735+0000", 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6000000000000004e-07 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963800+0000", 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4455000000000005e-05 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963808+0000", 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9530000000000005e-06 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963814+0000", 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0009999999999998e-06 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964329+0000", 2024-09-20T21:02:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00051435800000000002 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964339+0000", 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0438999999999999e-05 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988125+0000", 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023785555999999999 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988151+0000", 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5766e-05 2024-09-20T21:02:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62111 5.2 5:44febcde:::benchmark_data_smithi112_23632_object62110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.495476526999999, 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024229619000000001, 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62111 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963913+0000", 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1200000000000002e-07 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964060+0000", 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147355 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964069+0000", 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1120000000000002e-06 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964074+0000", 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8199999999999996e-06 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964334+0000", 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025997599999999998 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964443+0000", 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108497 2024-09-20T21:02:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964549+0000", 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105781 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.976088+0000", 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011539822 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988059+0000", 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011970550999999999 2024-09-20T21:02:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988107+0000", 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8473999999999997e-05 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988142+0000", 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4518999999999999e-05 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:62098 5.3 e31/21 ondisk, result = 0)", 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.494783927, 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023464459999999999, 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8000000000000001e-07 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964608+0000", 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9620000000000002e-06 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964618+0000", 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8870000000000004e-06 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964629+0000", 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0679000000000001e-05 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965787+0000", 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011576959999999999 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965795+0000", 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0779999999999996e-06 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988069+0000", 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022274777999999999 2024-09-20T21:02:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62114 5.e e31/21 5:7d451501:::benchmark_data_smithi112_23632_object62113:head v 31'3936, mlcod=31'3934)", 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.493506923, 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025697174999999999, 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965883+0000", 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6499999999999999e-07 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965942+0000", 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9815999999999998e-05 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965950+0000", 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8590000000000005e-06 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965956+0000", 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9460000000000003e-06 2024-09-20T21:02:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965999+0000", 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3214999999999999e-05 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966030+0000", 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.01e-05 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991550+0000", 2024-09-20T21:02:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025520185000000001 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991579+0000", 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9388999999999999e-05 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62116 5.4 e31/21 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head v 31'3927, mlcod=31'3925)", 2024-09-20T21:02:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.493156994, 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024173271, 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.44e-07 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966300+0000", 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7484999999999995e-05 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966309+0000", 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5730000000000008e-06 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966315+0000", 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9630000000000003e-06 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966374+0000", 2024-09-20T21:02:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.94e-05 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966390+0000", 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6412000000000001e-05 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.990372+0000", 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023981372000000001 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.990405+0000", 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3422e-05 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62115 5.e e31/21 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head v 31'3937, mlcod=31'3934)", 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.491372257, 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023580685000000001, 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:02:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7800000000000001e-07 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968091+0000", 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3468999999999997e-05 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968100+0000", 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.645e-06 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968107+0000", 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.725e-06 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.970256+0000", 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021493810000000001 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.970272+0000", 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5489e-05 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991582+0000", 2024-09-20T21:02:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021310490000000001 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991597+0000", 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4808e-05 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:03.568 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:03.570 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:02:03.570 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:03.568+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:03.670 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:03.668+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:03.713 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:03.713 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:02:03.713 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.713 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:88617 5.d e36/21 5:b3451a02:::benchmark_data_smithi112_23632_object88616:head v 36'5458, mlcod=36'5455)", 2024-09-20T21:02:03.713 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:03.710895+0000", 2024-09-20T21:02:03.713 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0017335829999999999, 2024-09-20T21:02:03.713 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001756329, 2024-09-20T21:02:03.713 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:03.713 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:03.713 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710895+0000", 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710895+0000", 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.714 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710896+0000", 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9899999999999999e-07 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710954+0000", 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.7475000000000001e-05 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710963+0000", 2024-09-20T21:02:03.715 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.8050000000000001e-06 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710971+0000", 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7340000000000008e-06 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711723+0000", 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00075149899999999998 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:03.716 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711744+0000", 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1089000000000001e-05 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:88623 5.9 e36/21 5:917e3d89:::benchmark_data_smithi112_23632_object88622:head v 36'5572, mlcod=36'5570)", 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:03.711359+0000", 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00126958, 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0013577800000000001, 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:03.717 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711359+0000", 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711359+0000", 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:03.718 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711360+0000", 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6700000000000003e-07 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711422+0000", 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.2414000000000002e-05 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711432+0000", 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4660000000000005e-06 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.719 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711436+0000", 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.3540000000000002e-06 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711499+0000", 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3215999999999999e-05 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711516+0000", 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6450999999999999e-05 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.720 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:88624 5.5 e36/21 5:abe075a6:::benchmark_data_smithi112_23632_object88623:head v 36'5525, mlcod=36'5521)", 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:03.711833+0000", 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00079626000000000002, 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00094305400000000003, 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.721 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711833+0000", 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711833+0000", 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711834+0000", 2024-09-20T21:02:03.722 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.3799999999999996e-07 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711879+0000", 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.5754999999999998e-05 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711889+0000", 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.9860000000000006e-06 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711895+0000", 2024-09-20T21:02:03.724 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.195e-06 2024-09-20T21:02:03.724 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.724 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.725 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:03.725 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711939+0000", 2024-09-20T21:02:03.725 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.4019e-05 2024-09-20T21:02:03.725 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.725 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.725 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:03.726 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.711959+0000", 2024-09-20T21:02:03.726 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9307e-05 2024-09-20T21:02:03.726 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.726 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:03.726 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.726 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.726 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.726 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:88619 5.3 e36/21 5:ce1b530a:::benchmark_data_smithi112_23632_object88618:head v 36'5530, mlcod=36'5528)", 2024-09-20T21:02:03.726 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:03.712093+0000", 2024-09-20T21:02:03.726 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00053582300000000005, 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00074100700000000002, 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712093+0000", 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:03.727 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712093+0000", 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712094+0000", 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.3700000000000001e-07 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712166+0000", 2024-09-20T21:02:03.728 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.2680000000000002e-05 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712177+0000", 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0601999999999999e-05 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712182+0000", 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.3979999999999998e-06 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712251+0000", 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8507e-05 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712278+0000", 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.7234e-05 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.730 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:88626 5.f e36/21)", 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:03.712361+0000", 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.000267569, 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053324999999999998, 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712361+0000", 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.731 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712361+0000", 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712362+0000", 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.7999999999999995e-07 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712431+0000", 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.9041999999999994e-05 2024-09-20T21:02:03.732 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712440+0000", 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.3540000000000006e-06 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712446+0000", 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.3360000000000002e-06 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.733 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:88625 5.2 e36/21 5:478abc3f:::benchmark_data_smithi112_23632_object88624:head v 36'5530, mlcod=36'5528)", 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:03.712492+0000", 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.000137272, 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00045160399999999998, 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712492+0000", 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.734 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712492+0000", 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712492+0000", 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.3000000000000001e-07 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712522+0000", 2024-09-20T21:02:03.735 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9475000000000002e-05 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712529+0000", 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.6420000000000007e-06 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712534+0000", 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.9540000000000003e-06 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.736 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712582+0000", 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7719000000000002e-05 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.712598+0000", 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6548000000000001e-05 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.737 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:88612 5.d e36/21 5:b9326220:::benchmark_data_smithi112_23632_object88611:head v 36'5457, mlcod=36'5455)", 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:03.708968+0000", 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0036605359999999998, 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040359929999999999, 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:03.738 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.708968+0000", 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.708968+0000", 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.709006+0000", 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7215000000000002e-05 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.739 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.709054+0000", 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.8550000000000001e-05 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.709069+0000", 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4786e-05 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.709077+0000", 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.1009999999999992e-06 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.740 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.709453+0000", 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037602099999999998 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.709471+0000", 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8054e-05 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.741 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:88615 5.5 e36/21 5:a52fd3f5:::benchmark_data_smithi112_23632_object88614:head v 36'5524, mlcod=36'5520)", 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:03.709995+0000", 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0026343540000000002, 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003067658, 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.709995+0000", 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.742 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.709995+0000", 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.709995+0000", 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5000000000000002e-07 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710051+0000", 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.5284999999999997e-05 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.743 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710063+0000", 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2526e-05 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710070+0000", 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710171+0000", 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00010077900000000001 2024-09-20T21:02:03.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710190+0000", 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9048000000000001e-05 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:88618 5.1 e36/21 5:863c7706:::benchmark_data_smithi112_23632_object88617:head v 36'5643, mlcod=36'5640)", 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:03.710118+0000", 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0025108079999999998, 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030041030000000002, 2024-09-20T21:02:03.745 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710118+0000", 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710118+0000", 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.746 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710119+0000", 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.2300000000000002e-07 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710195+0000", 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5989999999999996e-05 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710201+0000", 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1920000000000002e-06 2024-09-20T21:02:03.747 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710205+0000", 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.3540000000000002e-06 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710250+0000", 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.4804e-05 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:03.710266+0000", 2024-09-20T21:02:03.748 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6526000000000001e-05 2024-09-20T21:02:03.749 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.749 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:03.749 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.749 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:03.749 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:02:03.749 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 9 2024-09-20T21:02:03.749 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:03.750 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:03.771 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:03.769+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:03.872 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:03.868+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:03.943 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:03.943 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:02:03.943 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:02:03.943 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:02:03.943 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:03.963 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:03.973 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:03.969+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:04.074 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:04.071+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:04.153 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:04.153 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:02:04.153 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:02:04.153 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:02:04.153 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.153 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:02:04.153 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 62.187940351000002, 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.154 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.155 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:02:04.156 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.158 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:02:04.159 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.160 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 61.182945576999998, 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:02:04.161 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:04.162 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:02:04.163 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.164 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:02:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:02:04.166 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.167 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.955006181000002, 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:02:04.168 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.169 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.169 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.169 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.169 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.169 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.169 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:04.169 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.169 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.169 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.169 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:02:04.170 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:02:04.171 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.172 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:02:04.173 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.174 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.954858962000003, 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.175 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:02:04.176 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.177 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.178 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:02:04.179 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:02:04.180 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:04.181 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.95473303, 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.182 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:02:04.183 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:02:04.184 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:02:04.185 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.186 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.187 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.954648433999999, 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.188 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.189 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:02:04.190 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:02:04.191 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.192 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.193 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:02:04.194 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:02:04.194 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.194 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.194 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.194 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:02:04.194 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:02:04.194 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.194 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.194 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.194 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.954330833, 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.195 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:02:04.196 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.197 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.198 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.199 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:02:04.200 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.201 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.954229116999997, 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:04.202 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.205 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.206 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:02:04.207 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.954148521, 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.208 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:02:04.210 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.211 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:02:04.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.213 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.214 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.954071454999998, 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.215 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.216 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.217 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.218 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:02:04.219 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.220 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.953859987000001, 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.221 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.222 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:02:04.223 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.225 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.226 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.227 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.953784149999997, 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.228 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.229 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.230 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:02:04.230 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:02:04.230 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.230 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.230 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.230 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:02:04.230 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:02:04.230 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.230 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.230 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.231 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.232 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.233 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.953662088000002, 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.234 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:04.235 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.236 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.237 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:02:04.238 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:02:04.239 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:04.240 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.953593839, 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.241 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:02:04.242 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.243 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:04.244 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:02:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.246 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.953501052999997, 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:04.247 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:02:04.248 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.249 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:02:04.250 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:02:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:02:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:02:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:02:04.252 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:04.253 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.953439197000002, 2024-09-20T21:02:04.254 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:02:04.254 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.254 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.254 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.254 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.254 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.254 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.254 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:04.254 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.254 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.255 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.256 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.257 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:02:04.258 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:02:04.259 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.953356821, 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.260 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.261 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.262 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:02:04.263 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:02:04.264 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.265 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.266 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:02:04.266 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:02:04.266 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.266 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.266 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.266 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:02:04.266 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:02:04.266 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.266 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.266 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.953272261000002, 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.267 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:02:04.268 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.269 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.270 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.271 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:02:04.272 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:04.273 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.953208355000001, 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.274 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.275 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:02:04.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:04.278 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:02:04.278 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:02:04.278 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.278 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.278 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:04.278 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:02:04.278 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:02:04.278 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.278 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.278 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:02:04.279 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 51.953145612, 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:04.280 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:04.281 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.282 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.283 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:02:04.284 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.285 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.285 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.285 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:04.285 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:04.285 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:04.286 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 37 16 89764 89748 151.586 131 0.00617394 0.00659231 2024-09-20T21:02:04.286 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:04.283+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:04.287 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:04.387 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:04.383+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:04.397 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-20T21:02:04.446 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:04.446 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:04.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:90177 5.d 5:bb725f90:::benchmark_data_smithi112_23632_object90176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.439766+0000", 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0075420909999999999, 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0075704400000000003, 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 90177 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.439766+0000", 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.439766+0000", 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.439767+0000", 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4799999999999998e-07 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.439795+0000", 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7934999999999999e-05 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.439803+0000", 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5099999999999998e-06 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.439810+0000", 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1929999999999998e-06 2024-09-20T21:02:04.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.444338+0000", 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0045279990000000004 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.444447+0000", 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000109708 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:04.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.444559+0000", 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011176299999999999 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.447249+0000", 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002690455 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:90180 5.0 5:00100b7c:::benchmark_data_smithi112_23632_object90179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.440109+0000", 2024-09-20T21:02:04.451 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0071990049999999996, 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0073762970000000004, 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 90180 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.440109+0000", 2024-09-20T21:02:04.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.440109+0000", 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.440110+0000", 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7700000000000004e-07 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.440145+0000", 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4761000000000001e-05 2024-09-20T21:02:04.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.440156+0000", 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1437000000000001e-05 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.440163+0000", 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6590000000000001e-06 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.440234+0000", 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1095999999999998e-05 2024-09-20T21:02:04.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.440373+0000", 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013931999999999999 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.440526+0000", 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015277499999999999 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:90181 5.0 5:00406cfe:::benchmark_data_smithi112_23632_object90180:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-20T21:02:04.455 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.441399+0000", 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0059093180000000002, 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061570169999999999, 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 90181 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.441399+0000", 2024-09-20T21:02:04.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.441399+0000", 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.441400+0000", 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.04e-06 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.441460+0000", 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9781000000000002e-05 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.441473+0000", 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.361e-05 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.441481+0000", 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9030000000000004e-06 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:04.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442590+0000", 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001108824 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442715+0000", 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012476100000000001 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442818+0000", 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102605 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.459 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:90184 5.0 5:09ce8fb9:::benchmark_data_smithi112_23632_object90183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.442670+0000", 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0046384310000000002, 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0049293599999999998, 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 90184 2024-09-20T21:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442670+0000", 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442670+0000", 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442671+0000", 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7499999999999998e-07 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442737+0000", 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6017000000000002e-05 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442758+0000", 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1162000000000002e-05 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442765+0000", 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3010000000000001e-06 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.444876+0000", 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0021102550000000001 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.445009+0000", 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000133755 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.445162+0000", 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015213299999999999 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:90185 5.0 5:052e33a5:::benchmark_data_smithi112_23632_object90184:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.443901+0000", 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0034072809999999999, 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0037377410000000002, 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.464 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 90185 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.443901+0000", 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.443901+0000", 2024-09-20T21:02:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.443902+0000", 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9100000000000003e-07 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.443968+0000", 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5957000000000006e-05 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.443977+0000", 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3260000000000002e-06 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.443983+0000", 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4469999999999997e-06 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.447038+0000", 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003055323 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.447149+0000", 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110954 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.447266+0000", 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000117308 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.468 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:90187 5.8 5.8a7d2d88 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.444800+0000", 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002508756, 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0028761849999999999, 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 90187 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.444800+0000", 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.444800+0000", 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.444801+0000", 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9600000000000008e-07 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.444861+0000", 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.037e-05 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.444872+0000", 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1235e-05 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.444879+0000", 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9580000000000001e-06 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.471 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:90160 5.d 5:b4b742f8:::benchmark_data_smithi112_23632_object90159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.433216+0000", 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.014092090999999999, 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014490717, 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 90160 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.472 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433216+0000", 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433216+0000", 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433217+0000", 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4000000000000001e-07 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433278+0000", 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1383000000000005e-05 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433295+0000", 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6248000000000001e-05 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433301+0000", 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7800000000000003e-06 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.439183+0000", 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0058814160000000004 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.439281+0000", 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8646000000000004e-05 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.439364+0000", 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2495000000000002e-05 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.446351+0000", 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0069868250000000003 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:90189 5.e 5:7270891b:::benchmark_data_smithi112_23632_object90188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.445745+0000", 2024-09-20T21:02:04.476 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0015631600000000001, 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020062589999999998, 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 90189 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.445745+0000", 2024-09-20T21:02:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.445745+0000", 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.445746+0000", 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.54e-07 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.445868+0000", 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000122547 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.445880+0000", 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1338999999999999e-05 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.445887+0000", 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7329999999999997e-06 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.445936+0000", 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9073999999999998e-05 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.446061+0000", 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000125642 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.446200+0000", 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013828399999999999 2024-09-20T21:02:04.480 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:90180 5.0 e37/21)", 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.446230+0000", 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0010786540000000001, 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0015665849999999999, 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.446230+0000", 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.446230+0000", 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.446230+0000", 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5799999999999999e-07 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.446233+0000", 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2009999999999999e-06 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.446242+0000", 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8510000000000005e-06 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.446249+0000", 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6560000000000003e-06 2024-09-20T21:02:04.483 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:90164 5.d 5:b27fefb0:::benchmark_data_smithi112_23632_object90163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.433717+0000", 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.013591840000000001, 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014108368, 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:04.484 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 90164 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433717+0000", 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433717+0000", 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433717+0000", 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6899999999999996e-07 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433779+0000", 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1884999999999994e-05 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433795+0000", 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5441999999999999e-05 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.433804+0000", 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7949999999999996e-06 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.441875+0000", 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.008071768 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442003+0000", 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012811300000000001 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.442162+0000", 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015863800000000001 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.446354+0000", 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0041914090000000001 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.488 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:90181 5.0 e37/21)", 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.447803+0000", 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.999505, 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1902000000000005e-05, 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.447803+0000", 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.447803+0000", 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.447804+0000", 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.06e-07 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.447808+0000", 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7290000000000002e-06 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.447823+0000", 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4944e-05 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.447832+0000", 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1840000000000005e-06 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 11 2024-09-20T21:02:04.491 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:04.493 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:04.493 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:04.489+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:04.586 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T21:02:04.586 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:02:04.586 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-20T21:02:04.586 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.327358 2024-09-20T21:02:04.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.3273578337172096 2024-09-20T21:02:04.593 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:04.591+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:04.674 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:04.686 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:04.686 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:04.686 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:04.686 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:04.686 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:04.694 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:04.691+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:04.703 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:04.795 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:04.791+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:04.842 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:04.842 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:04.862 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:04.862 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:04.883 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:04.883 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:04.896 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:04.892+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:04.905 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:04.905 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:04.927 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:04.997 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:04.992+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:05.088 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:05.089 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:05.098 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:05.095+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:05.110 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:05.200 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:05.193+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:05.244 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 38 16 91845 91829 151.019 130.062 0.00367965 0.0066174 2024-09-20T21:02:05.269 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:05.269 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:05.289 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:05.300 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:05.296+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:05.395 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.2 primary-affinity to 0.327358 (8214532) 2024-09-20T21:02:05.400 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:05.396+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:05.473 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:05.473 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:05.486 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:02:05.502 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:05.499+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:05.603 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:05.597+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:05.610 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:05.610 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:05.624 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:05.704 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:05.701+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:05.740 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:05.741 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:05.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:05.805 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:05.800+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:05.876 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:05.876 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:05.891 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:05.934 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:05.932+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:06.006 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:06.004+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:06.022 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:06.023 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:06.036 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:06.107 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:06.104+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:06.158 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:06.158 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:06.174 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:06.221 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:06.219+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:06.244 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 39 16 92229 92213 147.762 24 0.00643918 0.0066233 2024-09-20T21:02:06.296 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:06.296 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:06.309 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:06.308+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:06.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:06.411 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:06.408+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:06.426 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:02:06.453 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:06.453 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:06.470 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:06.511 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:06.508+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:06.612 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:06.607+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:06.617 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:06.617 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:06.635 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:06.713 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:06.709+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:06.772 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:06.772 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:06.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:02:06.813 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:06.811+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:06.901 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:06.914 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:06.911+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:06.949 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:06.949 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:06.973 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:07.015 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:07.013+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:07.057 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:07.057 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:07.075 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:07.075 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:07.092 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:07.093 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:07.116 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:07.113+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:07.122 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:07.122 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:02:07.122 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:02:07.123 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:02:07.123 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:07.143 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:07.218 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:07.211+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:07.244 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:2024-09-20T21:02:07.246129+0000 min lat: 0.00142862 max lat: 1.05002 avg lat: 0.0068361 2024-09-20T21:02:07.244 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-20T21:02:07.244 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 40 16 93582 93566 146.181 84.5625 0.00374588 0.0068361 2024-09-20T21:02:07.289 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:07.289 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:02:07.289 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:02:07.289 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 65.325233677, 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.290 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.293 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:02:07.294 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.295 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:02:07.296 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.320238903000003, 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.297 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:02:07.298 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:02:07.299 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:02:07.300 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:02:07.301 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.092299507, 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.302 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.303 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.304 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.305 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.306 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:07.307 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.092152288000001, 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:07.308 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.309 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.310 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.311 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:02:07.312 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.092026355999998, 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.313 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.314 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.315 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.316 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.091941759999997, 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.318 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:02:07.319 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:02:07.320 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:02:07.321 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.322 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:07.323 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.091624158999998, 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.324 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.325 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.326 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:02:07.327 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:02:07.328 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.091522443000002, 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.329 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.330 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.331 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.332 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.333 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:07.334 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.091441846999999, 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:02:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:02:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:02:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.339 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.091364781000003, 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.340 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.341 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.342 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.343 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.344 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.091153313, 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.346 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.347 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.348 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.349 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:07.350 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.091077476000002, 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:07.351 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.352 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.353 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.354 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:02:07.355 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.090955414, 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.356 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.357 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:02:07.358 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.359 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:02:07.360 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.090887164999998, 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.361 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.362 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.364 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:02:07.365 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.366 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.090794379000002, 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.368 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:02:07.369 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.370 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.371 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.090732523, 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.372 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.373 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.374 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.375 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:02:07.376 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.377 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.090650146999998, 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.379 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.380 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.381 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.090565587, 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.383 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.384 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.385 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.386 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:02:07.387 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.090501680999999, 2024-09-20T21:02:07.388 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:07.389 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.390 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.391 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.392 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.393 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 55.090438937999998, 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.394 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.395 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.396 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.397 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.398 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:07.398 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:07.398 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:07.399 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:07.393+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:07.399 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:07.414 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:02:07.499 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:07.497+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:07.555 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:07.555 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:94218 5.b 5:d1cafb14:::benchmark_data_smithi112_23632_object94217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.548972+0000", 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0070384180000000003, 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0070587979999999998, 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 94218 2024-09-20T21:02:07.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.548972+0000", 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.548972+0000", 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.548973+0000", 2024-09-20T21:02:07.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.085e-06 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.549021+0000", 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7951999999999998e-05 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.549032+0000", 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0781000000000001e-05 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.549037+0000", 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.485e-06 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.549077+0000", 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9888999999999997e-05 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.549165+0000", 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7454000000000007e-05 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.549248+0000", 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2661e-05 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.551148+0000", 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00190084 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:94222 5.b 5:d8dcd9fd:::benchmark_data_smithi112_23632_object94221:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.553035+0000", 2024-09-20T21:02:07.560 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0029759040000000001, 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0030624799999999998, 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 94222 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553035+0000", 2024-09-20T21:02:07.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553035+0000", 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553036+0000", 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1299999999999999e-07 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553127+0000", 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1278000000000003e-05 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553138+0000", 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1592e-05 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553144+0000", 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0739999999999998e-06 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.563 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553180+0000", 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5966000000000001e-05 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553269+0000", 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8802999999999997e-05 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553416+0000", 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014675300000000001 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.564 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:94221 5.9 e40/38 5:9bc1e0ae:::benchmark_data_smithi112_23632_object94220:head v 40'5918, mlcod=40'5916)", 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.553206+0000", 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0028044580000000001, 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002965077, 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553206+0000", 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553206+0000", 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553207+0000", 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7599999999999998e-07 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553251+0000", 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4734999999999998e-05 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553257+0000", 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1550000000000004e-06 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553262+0000", 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.51e-06 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553305+0000", 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2715e-05 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553327+0000", 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2215e-05 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:94225 5.e 5:79e1a2d5:::benchmark_data_smithi112_23632_object94224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.553546+0000", 2024-09-20T21:02:07.568 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0024647620000000001, 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026959620000000001, 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 94225 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.569 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553546+0000", 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553546+0000", 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553546+0000", 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7299999999999996e-07 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553597+0000", 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0420000000000002e-05 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553605+0000", 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7970000000000001e-06 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553609+0000", 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9670000000000003e-06 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553647+0000", 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.858e-05 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553735+0000", 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8294000000000005e-05 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553818+0000", 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2077999999999996e-05 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.572 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:94224 5.8 e40/38 5:1227aed3:::benchmark_data_smithi112_23632_object94223:head v 40'5906, mlcod=40'5904)", 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.553761+0000", 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0022497820000000001, 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0025713120000000001, 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553761+0000", 2024-09-20T21:02:07.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553761+0000", 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553762+0000", 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1060000000000001e-06 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553801+0000", 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9212000000000003e-05 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553818+0000", 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6719e-05 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553826+0000", 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1790000000000008e-06 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.575 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553891+0000", 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4484000000000001e-05 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.553908+0000", 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7295e-05 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:94226 5.4 e40/38 5:2a87cedd:::benchmark_data_smithi112_23632_object94225:head v 40'5961, mlcod=40'5959)", 2024-09-20T21:02:07.576 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.554059+0000", 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001951377, 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023413290000000001, 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554059+0000", 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554059+0000", 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554060+0000", 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1999999999999999e-07 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554098+0000", 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8460000000000001e-05 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554114+0000", 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5379999999999998e-05 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554123+0000", 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.003e-06 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554208+0000", 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5360999999999998e-05 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554228+0000", 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9843e-05 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:94227 5.f 5:f8a513d3:::benchmark_data_smithi112_23632_object94226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.554125+0000", 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0018852879999999999, 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023104699999999998, 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:07.580 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 94227 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554125+0000", 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554125+0000", 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554127+0000", 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2759999999999999e-06 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554186+0000", 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9265999999999998e-05 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554201+0000", 2024-09-20T21:02:07.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5444999999999999e-05 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554210+0000", 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8920000000000006e-06 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554263+0000", 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2385000000000001e-05 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554393+0000", 2024-09-20T21:02:07.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013038899999999999 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.554513+0000", 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000119809 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:94228 5.f 5.fe5511f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.556268+0000", 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.999743, 2024-09-20T21:02:07.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021642800000000001, 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 94228 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556268+0000", 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556268+0000", 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556268+0000", 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0500000000000002e-07 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556321+0000", 2024-09-20T21:02:07.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2442999999999999e-05 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556331+0000", 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0254999999999999e-05 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556337+0000", 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9499999999999998e-06 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:94229 5.d 5:b8639336:::benchmark_data_smithi112_23632_object94228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.556353+0000", 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9996576, 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000170793, 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "reached pg", 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 94229 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556353+0000", 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556353+0000", 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556354+0000", 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4700000000000001e-07 2024-09-20T21:02:07.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556410+0000", 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6263e-05 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556418+0000", 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7060000000000004e-06 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556422+0000", 2024-09-20T21:02:07.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1840000000000001e-06 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.556480+0000", 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8223000000000001e-05 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 9 2024-09-20T21:02:07.591 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:07.592 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:07.600 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:07.595+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:07.702 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:07.699+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:07.744 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:07.745 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:07.745 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:07.745 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:07.745 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:07.768 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:07.817 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:07.815+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:07.903 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:07.899+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:07.925 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:07.925 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:07.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:07.925 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:07.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.925 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.728073895000001, 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:07.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:07.931 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.727983858999998, 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:07.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:07.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.727897505999998, 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.938 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:07.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:07.941 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:07.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.944 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.727828697, 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.727795837000002, 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:07.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:07.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.727753819999997, 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:07.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:07.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:07.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.962 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.727628713999998, 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:07.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:07.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.968 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.727536364999999, 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:07.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:07.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.727451993000003, 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:07.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:07.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:07.978 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 16.961992537, 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:07.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 16.961440531000001, 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:07.984 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:07.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:07.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:07.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:07.989 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 16.960812950000001, 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:07.990 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:07.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:07.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 16.960701941, 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:07.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:07.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:07.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:08.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 16.957035429000001, 2024-09-20T21:02:08.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:08.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:08.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:08.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:08.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 16.956721094999999, 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:08.007 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:08.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:08.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:08.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.012 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 16.956538977000001, 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:08.013 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:08.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:08.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:08.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:08.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:08.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:08.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:86630 5.8 5:16c4b749:::benchmark_data_smithi112_23632_object86629:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:02.736483+0000", 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.1876627790000001, 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019885238999999999, 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.020 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 86630 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736483+0000", 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736483+0000", 2024-09-20T21:02:08.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736483+0000", 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3799999999999996e-07 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736553+0000", 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9961000000000003e-05 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736565+0000", 2024-09-20T21:02:08.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1201e-05 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736573+0000", 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9099999999999994e-06 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.741028+0000", 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0044548369999999997 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:08.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.741121+0000", 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2864999999999999e-05 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.741219+0000", 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8356000000000005e-05 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.747323+0000", 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00610314 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.756261+0000", 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0089385009999999997 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.756332+0000", 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0593000000000007e-05 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.756368+0000", 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6037000000000001e-05 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:08.025 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:90056 5.b 5:dabd3d58:::benchmark_data_smithi112_23632_object90055:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:04.378560+0000", 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 3.545585762, 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019733021999999999, 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:08.026 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 90056 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.378560+0000", 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.378560+0000", 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.378560+0000", 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4300000000000002e-07 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.378650+0000", 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9717999999999997e-05 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.378662+0000", 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1527e-05 2024-09-20T21:02:08.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.378668+0000", 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5139999999999998e-06 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.390086+0000", 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.011417923 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.390233+0000", 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000146947 2024-09-20T21:02:08.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.390386+0000", 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000152771 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.398172+0000", 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.007786622 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:08.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.398185+0000", 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3145e-05 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.398250+0000", 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4697999999999996e-05 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:04.398293+0000", 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2413999999999997e-05 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:94194 5.b 5:d81a2a30:::benchmark_data_smithi112_23632_object94193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.534342+0000", 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.38980299000000002, 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021522429999999999, 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 94194 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.032 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534342+0000", 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534342+0000", 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534343+0000", 2024-09-20T21:02:08.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7800000000000001e-07 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534384+0000", 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1106000000000003e-05 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534398+0000", 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3896999999999999e-05 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534408+0000", 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6490000000000003e-06 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.536794+0000", 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002386207 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.536910+0000", 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000115821 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.537008+0000", 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8286000000000001e-05 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.540607+0000", 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035984530000000002 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555771+0000", 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015164082000000001 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555823+0000", 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2544999999999999e-05 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555865+0000", 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1606000000000001e-05 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.037 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:94197 5.b 5:db61c181:::benchmark_data_smithi112_23632_object94196:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.535955+0000", 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.388190217, 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020025675999999999, 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 94197 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.535955+0000", 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.535955+0000", 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.535957+0000", 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.609e-06 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.536064+0000", 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106989 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.536085+0000", 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1019999999999999e-05 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.536098+0000", 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3395e-05 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.538889+0000", 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027906049999999998 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.539001+0000", 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011236899999999999 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.539083+0000", 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2330999999999995e-05 2024-09-20T21:02:08.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.541194+0000", 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002110532 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555901+0000", 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014707433000000001 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555941+0000", 2024-09-20T21:02:08.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9595999999999998e-05 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555981+0000", 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9796999999999999e-05 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:08.043 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:08.045 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:08.045 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:08.041+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:08.145 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:08.139+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:08.203 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:95525 5.c 5:364ab1b6:::benchmark_data_smithi112_23632_object95524:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:08.196274+0000", 2024-09-20T21:02:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0060147839999999996, 2024-09-20T21:02:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060411830000000003, 2024-09-20T21:02:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 95525 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196274+0000", 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196274+0000", 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196275+0000", 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0580000000000001e-06 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196339+0000", 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3986999999999996e-05 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196363+0000", 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4252000000000001e-05 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196371+0000", 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0830000000000004e-06 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196427+0000", 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5263000000000003e-05 2024-09-20T21:02:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196536+0000", 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010899399999999999 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196654+0000", 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118022 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201984+0000", 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053307939999999998 2024-09-20T21:02:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:95526 5.a 5:54140c22:::benchmark_data_smithi112_23632_object95525:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:08.196393+0000", 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0058958999999999999, 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060073089999999997, 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 95526 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196393+0000", 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196393+0000", 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196393+0000", 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7199999999999999e-07 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196432+0000", 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8452999999999999e-05 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196441+0000", 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6029999999999994e-06 2024-09-20T21:02:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196447+0000", 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.587e-06 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196494+0000", 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7376999999999997e-05 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196600+0000", 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105141 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.196724+0000", 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012410399999999999 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.199244+0000", 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025207480000000002 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:95523 5.e e40/21 5:7143265f:::benchmark_data_smithi112_23632_object95522:head v 40'5981, mlcod=40'5978)", 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:08.197961+0000", 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.004327577, 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0045140600000000003, 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.197961+0000", 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.197961+0000", 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.197962+0000", 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5300000000000003e-07 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198041+0000", 2024-09-20T21:02:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9067999999999996e-05 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198062+0000", 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1322999999999999e-05 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198071+0000", 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4849999999999992e-06 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198118+0000", 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6745000000000001e-05 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198138+0000", 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9998000000000001e-05 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:95527 5.0 e40/21 5:0182c265:::benchmark_data_smithi112_23632_object95526:head v 40'5932, mlcod=40'5929)", 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:08.198318+0000", 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0039706960000000001, 2024-09-20T21:02:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004214003, 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198318+0000", 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198318+0000", 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198319+0000", 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.54e-07 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198416+0000", 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7209999999999999e-05 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198426+0000", 2024-09-20T21:02:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0428000000000001e-05 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198433+0000", 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5180000000000001e-06 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198517+0000", 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4166999999999996e-05 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198537+0000", 2024-09-20T21:02:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9724999999999998e-05 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:95529 5.3 5:c2222451:::benchmark_data_smithi112_23632_object95528:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:08.198493+0000", 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0037958330000000002, 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0040973700000000004, 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 95529 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198493+0000", 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198493+0000", 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198494+0000", 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3230000000000001e-06 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198531+0000", 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6468999999999999e-05 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198541+0000", 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8660000000000001e-06 2024-09-20T21:02:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198548+0000", 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5870000000000004e-06 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198706+0000", 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015820100000000001 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198880+0000", 2024-09-20T21:02:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017372399999999999 2024-09-20T21:02:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.198973+0000", 2024-09-20T21:02:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.276e-05 2024-09-20T21:02:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:95532 5.b e40/21 5:df2bec4a:::benchmark_data_smithi112_23632_object95531:head v 40'6095, mlcod=40'6093)", 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:08.200803+0000", 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0014852789999999999, 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0018535240000000001, 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.200803+0000", 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.200803+0000", 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.200804+0000", 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3099999999999998e-07 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.200852+0000", 2024-09-20T21:02:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-05 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.200859+0000", 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3830000000000003e-06 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.200863+0000", 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4699999999999998e-06 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.200908+0000", 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5153e-05 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.200928+0000", 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0366000000000001e-05 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:95536 5.5 5:a5b7f7c8:::benchmark_data_smithi112_23632_object95535:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:08.201070+0000", 2024-09-20T21:02:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001219117, 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016453049999999999, 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 95536 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201070+0000", 2024-09-20T21:02:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201070+0000", 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201070+0000", 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3499999999999995e-07 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201159+0000", 2024-09-20T21:02:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.865e-05 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201167+0000", 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201172+0000", 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.391e-06 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201211+0000", 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9116000000000003e-05 2024-09-20T21:02:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201295+0000", 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4289000000000006e-05 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201375+0000", 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9975999999999995e-05 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:95533 5.0 e40/21 5:08492d2d:::benchmark_data_smithi112_23632_object95532:head v 40'5933, mlcod=40'5930)", 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:08.201334+0000", 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00095464599999999997, 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014492179999999999, 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201334+0000", 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201334+0000", 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201335+0000", 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8400000000000004e-07 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201412+0000", 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7656000000000003e-05 2024-09-20T21:02:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201422+0000", 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4210000000000001e-06 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201427+0000", 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4129999999999997e-06 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201478+0000", 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0930000000000002e-05 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201533+0000", 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4307e-05 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:95537 5.8 5:1b3b5f8f:::benchmark_data_smithi112_23632_object95536:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:08.201393+0000", 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00089564199999999999, 2024-09-20T21:02:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014483020000000001, 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 95537 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201393+0000", 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201393+0000", 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201394+0000", 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5600000000000004e-07 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201474+0000", 2024-09-20T21:02:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9635000000000006e-05 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201483+0000", 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2939999999999994e-06 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201490+0000", 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9990000000000002e-06 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201534+0000", 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3872999999999998e-05 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201661+0000", 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127293 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:08.201791+0000", 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013032199999999999 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 9 2024-09-20T21:02:08.242 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:08.243 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:08.244 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 41 16 95620 95604 145.722 127.375 0.00869029 0.00685809 2024-09-20T21:02:08.245 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:08.241+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:08.346 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:08.341+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:08.402 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:08.402 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:08.402 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:08.402 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:08.402 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:08.423 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:08.467 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:08.465+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:08.548 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:08.545+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:08.621 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.425712758000003, 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.425578559000002, 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.425473553000003, 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.425354028000001, 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.425284021000003, 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.425208969000003, 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.658 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.425121943000001, 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:08.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.663 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.425053169999998, 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:02:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.424966910999999, 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031208138, 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194978+0000", 2024-09-20T21:02:08.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194979+0000", 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194990+0000", 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0859999999999999e-05 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195009+0000", 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9394000000000001e-05 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195023+0000", 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.359e-05 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195150+0000", 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127415 2024-09-20T21:02:08.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195164+0000", 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4134000000000001e-05 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209528+0000", 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014363684 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209797+0000", 2024-09-20T21:02:08.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026875800000000002 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226186+0000", 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016389113 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62101 5.8 e31/21 5:186de704:::benchmark_data_smithi112_23632_object62100:head v 31'3911, mlcod=31'3909)", 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:02:08.673 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.659145955, 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02729376, 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960798+0000", 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960799+0000", 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960852+0000", 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3016000000000002e-05 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960860+0000", 2024-09-20T21:02:08.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7370000000000006e-06 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960864+0000", 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3209999999999998e-06 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960904+0000", 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9703000000000003e-05 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.960917+0000", 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2794e-05 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988055+0000", 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027138394 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988092+0000", 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7104999999999998e-05 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62103 5.c 5:3565fe84:::benchmark_data_smithi112_23632_object62102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.658626946999998, 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026906978000000002, 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.678 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62103 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961317+0000", 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961319+0000", 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.128e-06 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961404+0000", 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5373999999999999e-05 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961419+0000", 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4939e-05 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961424+0000", 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4940000000000003e-06 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961486+0000", 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1692000000000005e-05 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961602+0000", 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011565600000000001 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961724+0000", 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012265900000000001 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.967186+0000", 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054620220000000004 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988148+0000", 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020962027000000001 2024-09-20T21:02:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988190+0000", 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1585000000000002e-05 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988224+0000", 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4402e-05 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62102 5.0 e31/21 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head v 31'3819, mlcod=31'3816)", 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.658246146, 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026424553999999999, 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961698+0000", 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961699+0000", 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961726+0000", 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6999e-05 2024-09-20T21:02:08.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961735+0000", 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8359999999999998e-06 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961739+0000", 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7790000000000003e-06 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961785+0000", 2024-09-20T21:02:08.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5707000000000001e-05 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.961803+0000", 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7609e-05 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988095+0000", 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026292257999999999 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988123+0000", 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810999999999999e-05 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62110 5.c 5:31284d1b:::benchmark_data_smithi112_23632_object62109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.657292699999999, 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025650796, 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.688 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62110 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962652+0000", 2024-09-20T21:02:08.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962653+0000", 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1100000000000005e-07 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962762+0000", 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109282 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962771+0000", 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4080000000000004e-06 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.962777+0000", 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.857e-06 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964273+0000", 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001495959 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964527+0000", 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025392500000000001 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964653+0000", 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126033 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988138+0000", 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023485176 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988231+0000", 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2940000000000001e-05 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988272+0000", 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0713999999999997e-05 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988303+0000", 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0691000000000001e-05 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62105 5.8 e31/21 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head v 31'3912, mlcod=31'3909)", 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.656320923999999, 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024588011999999999, 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963624+0000", 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7999999999999995e-07 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963684+0000", 2024-09-20T21:02:08.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0146000000000003e-05 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963695+0000", 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0939e-05 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963701+0000", 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.241e-06 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964203+0000", 2024-09-20T21:02:08.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050127400000000001 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964220+0000", 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7410000000000001e-05 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988152+0000", 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023932235999999999 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988212+0000", 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9185999999999999e-05 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62106 5.0 e31/21 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head v 31'3820, mlcod=31'3816)", 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.656209943, 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024416087999999999, 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.698 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963734+0000", 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963735+0000", 2024-09-20T21:02:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6000000000000004e-07 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963800+0000", 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4455000000000005e-05 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963808+0000", 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9530000000000005e-06 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963814+0000", 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0009999999999998e-06 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964329+0000", 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00051435800000000002 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964339+0000", 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0438999999999999e-05 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988125+0000", 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023785555999999999 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988151+0000", 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5766e-05 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.702 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:62111 5.2 5:44febcde:::benchmark_data_smithi112_23632_object62110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.656032133, 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024229619000000001, 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 62111 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963912+0000", 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.963913+0000", 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1200000000000002e-07 2024-09-20T21:02:08.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964060+0000", 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147355 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964069+0000", 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1120000000000002e-06 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964074+0000", 2024-09-20T21:02:08.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8199999999999996e-06 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964334+0000", 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025997599999999998 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964443+0000", 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108497 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964549+0000", 2024-09-20T21:02:08.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105781 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.976088+0000", 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011539822 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988059+0000", 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011970550999999999 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988107+0000", 2024-09-20T21:02:08.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8473999999999997e-05 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988142+0000", 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4518999999999999e-05 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:62098 5.3 e31/21 ondisk, result = 0)", 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.655339532999999, 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023464459999999999, 2024-09-20T21:02:08.708 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964605+0000", 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8000000000000001e-07 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964608+0000", 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9620000000000002e-06 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964618+0000", 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8870000000000004e-06 2024-09-20T21:02:08.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.964629+0000", 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0679000000000001e-05 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965787+0000", 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011576959999999999 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965795+0000", 2024-09-20T21:02:08.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0779999999999996e-06 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.988069+0000", 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022274777999999999 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62114 5.e e31/21 5:7d451501:::benchmark_data_smithi112_23632_object62113:head v 31'3936, mlcod=31'3934)", 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.654062529000001, 2024-09-20T21:02:08.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025697174999999999, 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965882+0000", 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965883+0000", 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6499999999999999e-07 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965942+0000", 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9815999999999998e-05 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965950+0000", 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8590000000000005e-06 2024-09-20T21:02:08.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965956+0000", 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9460000000000003e-06 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.965999+0000", 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3214999999999999e-05 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966030+0000", 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.01e-05 2024-09-20T21:02:08.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991550+0000", 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025520185000000001 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991579+0000", 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9388999999999999e-05 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62116 5.4 e31/21 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head v 31'3927, mlcod=31'3925)", 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.653712599999999, 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024173271, 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966232+0000", 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.44e-07 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966300+0000", 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7484999999999995e-05 2024-09-20T21:02:08.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966309+0000", 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5730000000000008e-06 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966315+0000", 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9630000000000003e-06 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966374+0000", 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.94e-05 2024-09-20T21:02:08.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.966390+0000", 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6412000000000001e-05 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.990372+0000", 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023981372000000001 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.990405+0000", 2024-09-20T21:02:08.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3422e-05 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:62115 5.e e31/21 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head v 31'3937, mlcod=31'3934)", 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.651927863000001, 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023580685000000001, 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968017+0000", 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7800000000000001e-07 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968091+0000", 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3468999999999997e-05 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968100+0000", 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.645e-06 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.968107+0000", 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.725e-06 2024-09-20T21:02:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.970256+0000", 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021493810000000001 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.970272+0000", 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5489e-05 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991582+0000", 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021310490000000001 2024-09-20T21:02:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:08.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:08.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:08.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:50.991597+0000", 2024-09-20T21:02:08.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4808e-05 2024-09-20T21:02:08.725 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.725 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.725 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.725 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:08.725 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:08.725 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:08.727 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:02:08.727 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:08.721+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:08.827 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:08.822+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:08.883 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:08.883 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:96888 5.7 e40/21 5:ed0aa6ae:::benchmark_data_smithi112_23632_object96887:head v 40'6061, mlcod=40'6059)", 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:08.880250+0000", 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0031928939999999999, 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003211869, 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.880250+0000", 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.884 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.880250+0000", 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.880251+0000", 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.58e-07 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.880288+0000", 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7653e-05 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.880295+0000", 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.7870000000000004e-06 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.880301+0000", 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4009999999999996e-06 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.880351+0000", 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0102999999999998e-05 2024-09-20T21:02:08.886 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.880364+0000", 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3067999999999999e-05 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:96890 5.3 e40/21 5:c659a0b4:::benchmark_data_smithi112_23632_object96889:head v 40'6022, mlcod=40'6020)", 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:08.881959+0000", 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.001483732, 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001540572, 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:08.887 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.881959+0000", 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.881959+0000", 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:08.888 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.881960+0000", 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.7299999999999996e-07 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882025+0000", 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.5056999999999997e-05 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882034+0000", 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.7399999999999993e-06 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.889 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882039+0000", 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.853e-06 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882077+0000", 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.8102000000000002e-05 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882090+0000", 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2994e-05 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.890 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:96898 5.d e40/21 5:bdc18814:::benchmark_data_smithi112_23632_object96897:head v 40'5984, mlcod=40'5982)", 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:08.882116+0000", 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0013267489999999999, 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0014160279999999999, 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:08.891 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882116+0000", 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882116+0000", 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882117+0000", 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.8599999999999997e-07 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.892 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882218+0000", 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00010021 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882227+0000", 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.8730000000000002e-06 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882233+0000", 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1479999999999997e-06 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.893 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882283+0000", 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0549e-05 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882302+0000", 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8366e-05 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:96891 5.5 e40/21 5:a9c5e8a9:::benchmark_data_smithi112_23632_object96890:head v 40'6037, mlcod=40'6035)", 2024-09-20T21:02:08.894 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:08.882100+0000", 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0013433900000000001, 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0014874409999999999, 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882100+0000", 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882100+0000", 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882100+0000", 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.2499999999999995e-07 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882259+0000", 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015880500000000001 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.896 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882293+0000", 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.3590000000000002e-05 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882300+0000", 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.2150000000000004e-06 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882378+0000", 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7817000000000004e-05 2024-09-20T21:02:08.897 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882395+0000", 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7075000000000002e-05 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:96893 5.6 e40/21 5:68bf9117:::benchmark_data_smithi112_23632_object96892:head v 40'5999, mlcod=40'5997)", 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:08.882353+0000", 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0010904720000000001, 2024-09-20T21:02:08.898 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001291281, 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882353+0000", 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882353+0000", 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.899 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882353+0000", 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.3000000000000001e-07 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882392+0000", 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.8365000000000003e-05 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882399+0000", 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.8229999999999995e-06 2024-09-20T21:02:08.900 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882405+0000", 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.3290000000000001e-06 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882456+0000", 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1258000000000003e-05 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882469+0000", 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2812e-05 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.901 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:96897 5.7 e40/21 5:ea1229cb:::benchmark_data_smithi112_23632_object96896:head v 40'6062, mlcod=40'6059)", 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:08.882420+0000", 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.001023719, 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001289922, 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.902 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882420+0000", 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882420+0000", 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882420+0000", 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.6100000000000002e-07 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:08.903 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882448+0000", 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8017999999999998e-05 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882454+0000", 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6059999999999999e-06 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882460+0000", 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1590000000000001e-06 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882499+0000", 2024-09-20T21:02:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.8980000000000003e-05 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:08.882515+0000", 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6506000000000001e-05 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 6 2024-09-20T21:02:08.905 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:08.906 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:08.949 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:08.947+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:09.030 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:09.027+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:09.054 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:09.054 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:02:09.054 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:02:09.054 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:02:09.054 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:09.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:09.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:09.130 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:09.125+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:09.231 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:09.226+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:09.244 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 42 16 97654 97638 145.279 127.125 0.00675646 0.00687882 2024-09-20T21:02:09.265 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:09.265 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:02:09.265 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 67.300998281999995, 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:02:09.266 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.267 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:02:09.268 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:02:09.269 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.270 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:02:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 66.296003507999998, 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.273 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:02:09.274 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:02:09.275 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.276 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:02:09.277 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.068064112000002, 2024-09-20T21:02:09.278 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.279 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:02:09.280 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:02:09.281 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:02:09.282 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.284 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:09.284 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.067916893000003, 2024-09-20T21:02:09.284 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:02:09.284 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.284 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.284 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.284 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.284 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.284 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.284 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.285 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:02:09.286 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:02:09.287 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.288 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.067790961, 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:02:09.289 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.290 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.291 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.292 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.293 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.294 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.067706364999999, 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.295 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.296 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:02:09.297 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.298 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.299 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.067388764, 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.300 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:02:09.301 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.302 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.303 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.304 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.305 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.067287047999997, 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.306 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:02:09.307 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:02:09.308 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:02:09.309 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.310 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.067206452000001, 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.311 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:02:09.312 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:02:09.313 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.314 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.315 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.067129385999998, 2024-09-20T21:02:09.316 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.317 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:02:09.318 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:02:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.320 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.321 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.066917918000001, 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.322 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.323 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.325 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.326 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.066842080999997, 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.327 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.328 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.329 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:02:09.330 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.331 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.332 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.066720019000002, 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.333 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.334 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.335 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.336 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:02:09.337 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.06665177, 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.338 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.339 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:02:09.340 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:02:09.341 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.342 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.343 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.066558983999997, 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.344 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:02:09.345 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:02:09.346 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:02:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.348 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.066497128000002, 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.349 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:02:09.350 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.351 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.352 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.353 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.354 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.066414752, 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:09.355 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.356 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.357 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.358 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.359 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.066330192000002, 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.360 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:02:09.361 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:02:09.362 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:02:09.363 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:02:09.364 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.066266286000001, 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.365 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.366 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:02:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:02:09.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:09.369 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:09.370 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 57.066203543, 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:09.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:09.373 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:09.374 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:09.375 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:09.376 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:09.377 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:09.377 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:09.377 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:09.371+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:09.378 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:09.378 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:09.441 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:02:09.476 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:09.470+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:09.534 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:09.534 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:09.555 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:09.578 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:09.573+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:09.678 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:09.674+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:09.769 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:09.779 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:09.777+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:09.880 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:09.874+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:09.966 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:09.966 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:09.981 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:09.977+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:09.988 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:10.082 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:10.079+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:10.146 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:10.147 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:10.168 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:10.183 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:10.178+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:10.244 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 43 16 99668 99652 144.828 125.875 0.0039521 0.00690038 2024-09-20T21:02:10.284 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:10.278+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:10.330 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:10.330 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:10.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:10.385 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:10.378+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:10.423 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T21:02:10.423 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:02:10.424 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-20T21:02:10.424 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T21:02:10.424 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T21:02:10.424 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-20T21:02:10.446 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:02:10.485 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:10.483+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:10.502 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:10.502 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:10.524 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:02:10.567 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:10.568 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-20T21:02:10.568 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:10.587 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:10.582+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:10.683 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:10.683 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:10.687 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:10.681+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:10.703 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:10.788 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:10.782+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:10.866 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:10.914 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:10.911+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:10.989 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:10.986+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:11.012 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:11.013 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:11.036 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:11.090 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:11.086+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:11.177 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:11.177 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:11.191 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:11.225 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:11.186+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:11.245 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 44 16 101599 101583 144.279 120.688 0.00801198 0.00692476 2024-09-20T21:02:11.292 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:11.286+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:11.378 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:11.378 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:11.379 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:11.393 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:11.387+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:11.397 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:11.494 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:11.491+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:11.539 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:11.540 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:11.560 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:11.560 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:11.578 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 59.396645483999997, 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.594 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 59.396555448000001, 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:11.600 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:11.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:11.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 59.396469095, 2024-09-20T21:02:11.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.607 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:11.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 59.396400286000002, 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:11.613 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:11.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:11.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:11.616 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:11.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.618 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 59.396367425999998, 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.619 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:11.622 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.623 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 59.396325408999999, 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:11.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:11.627 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.628 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.629 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:11.630 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 59.396200303000001, 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.631 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.632 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.633 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:11.634 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:11.635 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:11.636 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 59.396107954000001, 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:11.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.639 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.640 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:11.641 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 59.396023581999998, 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.642 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:11.644 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.645 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.646 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.630564125999999, 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.647 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.648 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:11.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:11.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.652 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.63001212, 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.653 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:11.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:11.656 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:11.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.629384539, 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.660 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:11.661 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.662 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.663 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.629273529999999, 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.665 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:11.666 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.667 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.668 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.669 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.670 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.625607018, 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.671 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.672 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.673 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:11.674 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.675 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:11.676 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.625292684000001, 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:11.677 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.678 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.679 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:11.680 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:11.681 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 20.625110566, 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:11.682 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.683 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:11.684 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:11.685 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:11.686 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.687 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:86630 5.8 5:16c4b749:::benchmark_data_smithi112_23632_object86629:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:02.736483+0000", 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 8.8562343679999991, 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019885238999999999, 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.688 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 86630 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736483+0000", 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.689 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736483+0000", 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736483+0000", 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3799999999999996e-07 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736553+0000", 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9961000000000003e-05 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.690 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736565+0000", 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1201e-05 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.736573+0000", 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9099999999999994e-06 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.741028+0000", 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0044548369999999997 2024-09-20T21:02:11.691 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.741121+0000", 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2864999999999999e-05 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.741219+0000", 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8356000000000005e-05 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.747323+0000", 2024-09-20T21:02:11.692 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00610314 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.756261+0000", 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0089385009999999997 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.756332+0000", 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0593000000000007e-05 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.693 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:02.756368+0000", 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6037000000000001e-05 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:94194 5.b 5:d81a2a30:::benchmark_data_smithi112_23632_object94193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.534342+0000", 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.0583745789999996, 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021522429999999999, 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.694 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 94194 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534342+0000", 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534342+0000", 2024-09-20T21:02:11.695 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534343+0000", 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7800000000000001e-07 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534384+0000", 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1106000000000003e-05 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.696 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534398+0000", 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3896999999999999e-05 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.534408+0000", 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6490000000000003e-06 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.536794+0000", 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002386207 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.697 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.536910+0000", 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000115821 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.537008+0000", 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8286000000000001e-05 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.540607+0000", 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035984530000000002 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.698 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555771+0000", 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015164082000000001 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555823+0000", 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2544999999999999e-05 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555865+0000", 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1606000000000001e-05 2024-09-20T21:02:11.699 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:94197 5.b 5:db61c181:::benchmark_data_smithi112_23632_object94196:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:07.535955+0000", 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.0567618059999999, 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020025675999999999, 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.700 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 94197 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.535955+0000", 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.535955+0000", 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.701 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.535957+0000", 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.609e-06 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.536064+0000", 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106989 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.536085+0000", 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1019999999999999e-05 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.702 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.536098+0000", 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3395e-05 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.538889+0000", 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027906049999999998 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.539001+0000", 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011236899999999999 2024-09-20T21:02:11.703 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.704 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.704 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.704 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.539083+0000", 2024-09-20T21:02:11.705 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2330999999999995e-05 2024-09-20T21:02:11.705 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.705 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.705 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.705 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.541194+0000", 2024-09-20T21:02:11.705 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002110532 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555901+0000", 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014707433000000001 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555941+0000", 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9595999999999998e-05 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.706 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:07.555981+0000", 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9796999999999999e-05 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:96076 5.b 5:d43cbb66:::benchmark_data_smithi112_23632_object96075:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:08.478580+0000", 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 3.1141366320000001, 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020447066, 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:11.707 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 96076 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.478580+0000", 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.478580+0000", 2024-09-20T21:02:11.708 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.478581+0000", 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4900000000000005e-07 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.478623+0000", 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2073999999999997e-05 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:11.709 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.478632+0000", 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4810000000000006e-06 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.478638+0000", 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6100000000000002e-06 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.480786+0000", 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0021474530000000001 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.710 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.480909+0000", 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012352899999999999 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.481056+0000", 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014635000000000001 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.483659+0000", 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002603302 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.498945+0000", 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015286266 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.498991+0000", 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5612999999999998e-05 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:08.499027+0000", 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6638999999999999e-05 2024-09-20T21:02:11.712 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.713 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.713 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.713 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:11.713 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:11.713 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:11.714 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:11.711+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:11.715 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:11.815 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:11.811+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:11.865 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:11.865 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:11.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.865 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102787 5.6 5:653b0ec4:::benchmark_data_smithi112_23632_object102786:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.858012+0000", 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0067105139999999999, 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0067293359999999998, 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102787 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:11.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858012+0000", 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858012+0000", 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858013+0000", 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7199999999999998e-07 2024-09-20T21:02:11.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858095+0000", 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2514000000000003e-05 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858106+0000", 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0701e-05 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858118+0000", 2024-09-20T21:02:11.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1683e-05 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858167+0000", 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9628e-05 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858243+0000", 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5354999999999999e-05 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858324+0000", 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1772000000000002e-05 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.863653+0000", 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.005328246 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102788 5.8 5:1d4527a9:::benchmark_data_smithi112_23632_object102787:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.858134+0000", 2024-09-20T21:02:11.870 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0065880590000000003, 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0066570789999999998, 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102788 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858134+0000", 2024-09-20T21:02:11.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858134+0000", 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858135+0000", 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.61e-07 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858172+0000", 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7211e-05 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858180+0000", 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9570000000000002e-06 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858187+0000", 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9369999999999998e-06 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858230+0000", 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2654000000000002e-05 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858344+0000", 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113659 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858494+0000", 2024-09-20T21:02:11.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015019600000000001 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.864421+0000", 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059276579999999997 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102789 5.2 5:459d4af3:::benchmark_data_smithi112_23632_object102788:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.858205+0000", 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0065172370000000004, 2024-09-20T21:02:11.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0066301600000000004, 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102789 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858205+0000", 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858205+0000", 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858206+0000", 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5999999999999991e-07 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858244+0000", 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8037999999999997e-05 2024-09-20T21:02:11.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858253+0000", 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4740000000000005e-06 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858259+0000", 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2110000000000003e-06 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858311+0000", 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1638000000000003e-05 2024-09-20T21:02:11.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858435+0000", 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124475 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858575+0000", 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139818 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:11.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.863972+0000", 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053974540000000003 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102790 5.6 5:6b90c2d9:::benchmark_data_smithi112_23632_object102789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.859899+0000", 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.004823623, 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049802409999999998, 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:11.880 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102790 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.859899+0000", 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:11.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.859899+0000", 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.859900+0000", 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.859948+0000", 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7614000000000002e-05 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.859962+0000", 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4537e-05 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.859971+0000", 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2349999999999999e-06 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860022+0000", 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1184999999999999e-05 2024-09-20T21:02:11.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860171+0000", 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014896199999999999 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860292+0000", 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012162 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:11.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.863658+0000", 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033656239999999998 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102791 5.7 5:e68e0670:::benchmark_data_smithi112_23632_object102790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.859989+0000", 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0047332959999999997, 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049450290000000001, 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102791 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.859989+0000", 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.859989+0000", 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.859990+0000", 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2099999999999997e-07 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860028+0000", 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8559000000000001e-05 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860036+0000", 2024-09-20T21:02:11.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9810000000000003e-06 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860043+0000", 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3829999999999997e-06 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860111+0000", 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8192e-05 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860243+0000", 2024-09-20T21:02:11.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013188300000000001 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860326+0000", 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3027000000000003e-05 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.863764+0000", 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034382929999999998 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102792 5.7 5:e9c2e30f:::benchmark_data_smithi112_23632_object102791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.860195+0000", 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0045278310000000004, 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047986119999999998, 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102792 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.890 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860195+0000", 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860195+0000", 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860195+0000", 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6700000000000003e-07 2024-09-20T21:02:11.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860230+0000", 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4962000000000002e-05 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860240+0000", 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860248+0000", 2024-09-20T21:02:11.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1589999999999993e-06 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861916+0000", 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016686730000000001 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862042+0000", 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012529500000000001 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862190+0000", 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014782400000000001 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.864261+0000", 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0020712529999999999 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102794 5.5 5:a62b85f3:::benchmark_data_smithi112_23632_object102793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.860803+0000", 2024-09-20T21:02:11.894 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0039195860000000001, 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0042340099999999999, 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102794 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860803+0000", 2024-09-20T21:02:11.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860803+0000", 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860804+0000", 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1999999999999999e-07 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:11.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860885+0000", 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1547999999999999e-05 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860895+0000", 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8449999999999998e-06 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.860902+0000", 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1300000000000003e-06 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861933+0000", 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001031073 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862076+0000", 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014278399999999999 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862229+0000", 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015286 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.864696+0000", 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0024670489999999998 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102795 5.3 5:c524e6fd:::benchmark_data_smithi112_23632_object102794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.861899+0000", 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0028237800000000001, 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031793260000000001, 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:11.899 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102795 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861899+0000", 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861899+0000", 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861899+0000", 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861944+0000", 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5025999999999999e-05 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861955+0000", 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0361e-05 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861960+0000", 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.899e-06 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862030+0000", 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0432999999999995e-05 2024-09-20T21:02:11.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862165+0000", 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013472199999999999 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862384+0000", 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021884399999999999 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.864961+0000", 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025770910000000001 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.903 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102796 5.8 5:1e32c355:::benchmark_data_smithi112_23632_object102795:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.861980+0000", 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0027419950000000001, 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031383930000000002, 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102796 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.904 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861980+0000", 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861980+0000", 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.861981+0000", 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9299999999999998e-07 2024-09-20T21:02:11.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862024+0000", 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3303999999999997e-05 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862032+0000", 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.841e-06 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862038+0000", 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9669999999999998e-06 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862106+0000", 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7440999999999993e-05 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862217+0000", 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111648 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862354+0000", 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000136391 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.864968+0000", 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026138649999999999 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102783 5.c 5:3017a3fa:::benchmark_data_smithi112_23632_object102782:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.855767+0000", 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0089559119999999999, 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0093942999999999995, 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102783 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.855767+0000", 2024-09-20T21:02:11.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.855767+0000", 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.855767+0000", 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4300000000000003e-07 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.855880+0000", 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112587 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.855891+0000", 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0986e-05 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.855895+0000", 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6210000000000003e-06 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858023+0000", 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021276929999999999 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858149+0000", 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012596499999999999 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.858298+0000", 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148882 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:11.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:11.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.862309+0000", 2024-09-20T21:02:11.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0040109000000000004 2024-09-20T21:02:11.913 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.913 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:11.913 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.913 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:11.913 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:11.913 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 10 2024-09-20T21:02:11.913 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:11.914 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:11.915 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:11.914+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:12.016 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:12.011+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:12.069 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:12.069 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:12.092 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:12.117 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:12.118+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:12.219 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:12.218+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:12.245 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 45 16 103536 103520 143.762 121.062 0.00474997 0.00695133 2024-09-20T21:02:12.252 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:12.252 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:12.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:12.252 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:12.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.252 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.252 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.055316818000001, 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.055182619, 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:12.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:12.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.055077613000002, 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.270 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.054958087999999, 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:12.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:12.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:12.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.054888081000001, 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:12.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:12.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.054813029000002, 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.283 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:12.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.054726002999999, 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:12.289 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:12.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:12.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.293 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.054657229999997, 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:12.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:12.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:12.298 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.53691056699999995, 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:12.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:12.302 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.53407492400000001, 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.53362511899999998, 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.53352195400000002, 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:12.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.53343396799999998, 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:12.320 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:12.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:12.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.53262146399999999, 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.326 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:12.330 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.53085290500000004, 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:12.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:12.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.53038838600000004, 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:12.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:12.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.53019251499999998, 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.342 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:12.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:12.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.529710652, 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:12.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.353 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.527562592, 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:12.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:12.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:12.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:12.359 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.52443130800000004, 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:12.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:12.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:12.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.363 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:12.364 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:12.364 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:12.365 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:02:12.365 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:12.361+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:12.465 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:12.466+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:12.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:104094 5.5 e41/21 5:a3db8aea:::benchmark_data_smithi112_23632_object104093:head v 41'6487, mlcod=41'6485)", 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:12.514526+0000", 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0048047139999999999, 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0048273949999999999, 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.520 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514526+0000", 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514526+0000", 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514527+0000", 2024-09-20T21:02:12.521 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1600000000000001e-07 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514639+0000", 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011208400000000001 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514652+0000", 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2877999999999999e-05 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514660+0000", 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7610000000000007e-06 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514693+0000", 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.3966e-05 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514708+0000", 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4567e-05 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.523 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.519346+0000", 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0046379849999999999 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:104095 5.3 e41/21 5:ca6e0442:::benchmark_data_smithi112_23632_object104094:head v 41'6465, mlcod=41'6463)", 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:12.514677+0000", 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0046538999999999999, 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0047475290000000003, 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.524 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514677+0000", 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514677+0000", 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.525 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514677+0000", 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.1199999999999998e-07 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514708+0000", 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0346999999999999e-05 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514716+0000", 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.1960000000000008e-06 2024-09-20T21:02:12.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514724+0000", 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7170000000000008e-06 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514784+0000", 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.9970999999999999e-05 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514800+0000", 2024-09-20T21:02:12.527 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6053999999999999e-05 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:104098 5.c e41/21 5:3a640f41:::benchmark_data_smithi112_23632_object104097:head v 41'6421, mlcod=41'6419)", 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:12.514907+0000", 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0044240859999999998, 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004574318, 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.528 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514907+0000", 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514907+0000", 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514907+0000", 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.9299999999999998e-07 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.529 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514946+0000", 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.8914e-05 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514956+0000", 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.026e-05 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.514964+0000", 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.6380000000000004e-06 2024-09-20T21:02:12.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.515034+0000", 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.0387000000000002e-05 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.515055+0000", 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0434000000000001e-05 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.531 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:104096 5.3 e41/21 5:cdf323f9:::benchmark_data_smithi112_23632_object104095:head v 41'6466, mlcod=41'6463)", 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:12.516362+0000", 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0029685480000000001, 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0031729029999999999, 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.516362+0000", 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.532 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.516362+0000", 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.516363+0000", 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.1799999999999995e-07 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.516466+0000", 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00010306600000000001 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.533 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.516474+0000", 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.2810000000000008e-06 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.516479+0000", 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0019999999999997e-06 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.516687+0000", 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020749700000000001 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.534 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.516704+0000", 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7130999999999999e-05 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:104099 5.1 e41/21 5:8796e542:::benchmark_data_smithi112_23632_object104098:head v 41'6633, mlcod=41'6631)", 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:12.517226+0000", 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00210509, 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0023652500000000002, 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.535 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517226+0000", 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517226+0000", 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517226+0000", 2024-09-20T21:02:12.536 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.6799999999999999e-07 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517279+0000", 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.2995999999999999e-05 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517292+0000", 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2485e-05 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517301+0000", 2024-09-20T21:02:12.537 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1710000000000008e-06 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517344+0000", 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.3334999999999998e-05 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517357+0000", 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2955e-05 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:104100 5.6 e41/21 5:66ca8b68:::benchmark_data_smithi112_23632_object104099:head v 41'6476, mlcod=41'6474)", 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:12.517357+0000", 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0019741730000000001, 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0022888650000000002, 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517357+0000", 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.539 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517357+0000", 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517357+0000", 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3799999999999997e-07 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517415+0000", 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.8054999999999999e-05 2024-09-20T21:02:12.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517428+0000", 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2376e-05 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517436+0000", 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.1780000000000003e-06 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517490+0000", 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4298000000000001e-05 2024-09-20T21:02:12.541 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.517512+0000", 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1957999999999999e-05 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:104102 5.2 e41/21 5:49de7082:::benchmark_data_smithi112_23632_object104101:head v 41'6501, mlcod=41'6499)", 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:12.518059+0000", 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0012722440000000001, 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0016413700000000001, 2024-09-20T21:02:12.542 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518059+0000", 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518059+0000", 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.543 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518059+0000", 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5499999999999997e-07 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518119+0000", 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.0056000000000002e-05 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518128+0000", 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.551e-06 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.544 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518142+0000", 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4551e-05 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518209+0000", 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6347999999999996e-05 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518227+0000", 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8406e-05 2024-09-20T21:02:12.545 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:104108 5.f e41/21 5:fcc2c9cc:::benchmark_data_smithi112_23632_object104107:head v 41'6481, mlcod=41'6479)", 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:12.518991+0000", 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00033971099999999997, 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00076849299999999998, 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.546 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518991+0000", 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518991+0000", 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.518992+0000", 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.2799999999999995e-07 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.547 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.519042+0000", 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.0362000000000003e-05 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.519055+0000", 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3217999999999999e-05 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.519062+0000", 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.9079999999999998e-06 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.548 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.519136+0000", 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.3773e-05 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:12.519154+0000", 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7915e-05 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:02:12.550 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 8 2024-09-20T21:02:12.550 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:12.551 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:12.566 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:12.566+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:12.666 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:12.666+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:12.700 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:12.700 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:02:12.700 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:02:12.700 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:02:12.700 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:12.718 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:12.767 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:12.763+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:12.869 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:12.866+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:12.875 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:12.875 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:02:12.875 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:02:12.875 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 70.911109210000006, 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:02:12.876 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.877 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:02:12.878 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:02:12.881 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.882 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 69.906114435999996, 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:02:12.883 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:02:12.884 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:02:12.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.886 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.887 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.678175039999999, 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:02:12.888 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.889 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:02:12.890 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:02:12.891 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:02:12.892 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.893 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.678027821000001, 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.894 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:02:12.895 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:02:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:02:12.897 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:02:12.898 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.677901888999997, 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.899 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.900 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.901 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:02:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:02:12.903 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:12.904 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.677817292999997, 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.905 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:02:12.906 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:02:12.907 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.908 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:12.909 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.677499691999998, 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.911 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.912 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.913 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:02:12.914 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.677397976000002, 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.915 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.916 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.917 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.918 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:02:12.919 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.677317379999998, 2024-09-20T21:02:12.920 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.921 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:02:12.922 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.923 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:02:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.677240314000002, 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:02:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:02:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.677028845999999, 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.933 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.934 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.935 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.936 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.676953009000002, 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:02:12.940 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:02:12.941 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.676830946999999, 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:02:12.942 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.943 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:02:12.944 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:02:12.945 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.946 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.947 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.676762697999997, 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.948 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:02:12.949 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.950 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.952 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.953 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.676669912000001, 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.954 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.955 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:02:12.956 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.957 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.958 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.676608055999999, 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.959 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.960 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.961 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:02:12.962 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:02:12.963 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.964 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.676525679999997, 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.965 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.966 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.967 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.968 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.969 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.67644112, 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:12.970 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.971 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.972 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.973 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.974 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.676377213999999, 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:02:12.975 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.976 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.977 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:02:12.978 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:12.979 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 60.676314470999998, 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:12.981 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.982 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.983 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:02:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:12.985 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:12.986 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:12.987 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:12.983+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:13.087 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:13.083+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:13.139 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:105402 5.a e41/21 5:565a5327:::benchmark_data_smithi112_23632_object105401:head v 41'6585, mlcod=41'6583)", 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:13.135949+0000", 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0041525360000000001, 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0041761400000000001, 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.135949+0000", 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.135949+0000", 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.135950+0000", 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.06e-07 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136007+0000", 2024-09-20T21:02:13.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6597e-05 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136018+0000", 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1778e-05 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136025+0000", 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3679999999999998e-06 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136077+0000", 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2006999999999999e-05 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136090+0000", 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3438000000000001e-05 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:105409 5.b 5:da99ea01:::benchmark_data_smithi112_23632_object105408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:13.136223+0000", 2024-09-20T21:02:13.143 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0038792969999999999, 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0039779300000000002, 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 105409 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136223+0000", 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136223+0000", 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136223+0000", 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9100000000000003e-07 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136267+0000", 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3420000000000001e-05 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136276+0000", 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.397e-06 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136284+0000", 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3470000000000001e-06 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136349+0000", 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5951999999999995e-05 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136500+0000", 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000150612 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.136668+0000", 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016830099999999999 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:105410 5.d 5:b42acfce:::benchmark_data_smithi112_23632_object105409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:13.137594+0000", 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002507493, 2024-09-20T21:02:13.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002689725, 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 105410 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.137594+0000", 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.137594+0000", 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.137600+0000", 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.137651+0000", 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0698999999999997e-05 2024-09-20T21:02:13.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.137664+0000", 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3356999999999999e-05 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.137671+0000", 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8340000000000001e-06 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.137723+0000", 2024-09-20T21:02:13.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1733000000000001e-05 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.137838+0000", 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000115097 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.137957+0000", 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000119453 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:105408 5.a e41/21 5:56ef076f:::benchmark_data_smithi112_23632_object105407:head v 41'6586, mlcod=41'6583)", 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:13.138561+0000", 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0015407000000000001, 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017852370000000001, 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.138561+0000", 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.138561+0000", 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.138562+0000", 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3799999999999996e-07 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.138592+0000", 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.0097999999999999e-05 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.138603+0000", 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.117e-05 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.138609+0000", 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6450000000000002e-06 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.138657+0000", 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8474999999999999e-05 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.138680+0000", 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2453e-05 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:105413 5.d 5:bb902f1b:::benchmark_data_smithi112_23632_object105412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:13.139597+0000", 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00050524800000000003, 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00081876400000000004, 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.155 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 105413 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.139597+0000", 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.139597+0000", 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.139598+0000", 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8800000000000001e-07 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.139669+0000", 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1174999999999995e-05 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.139681+0000", 2024-09-20T21:02:13.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2417e-05 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.139687+0000", 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8860000000000001e-06 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.139736+0000", 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9497999999999999e-05 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.139823+0000", 2024-09-20T21:02:13.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6417999999999998e-05 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.139906+0000", 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3126000000000003e-05 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:105401 5.0 e41/21 ondisk, result = 0)", 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:13.140303+0000", 2024-09-20T21:02:13.159 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9997988, 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018734599999999999, 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140303+0000", 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140303+0000", 2024-09-20T21:02:13.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140304+0000", 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3900000000000004e-07 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140309+0000", 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3809999999999998e-06 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140320+0000", 2024-09-20T21:02:13.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0366e-05 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140328+0000", 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8790000000000003e-06 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140375+0000", 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7271999999999997e-05 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140383+0000", 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0220000000000004e-06 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140493+0000", 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000109652 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:105403 5.e e41/21 ondisk, result = 0)", 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:13.140361+0000", 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9997411, 2024-09-20T21:02:13.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00019656200000000001, 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140361+0000", 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140361+0000", 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140361+0000", 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2300000000000001e-07 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140364+0000", 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.858e-06 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140371+0000", 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140377+0000", 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3319999999999999e-06 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140482+0000", 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000104751 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:13.140489+0000", 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5950000000000001e-06 2024-09-20T21:02:13.166 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.167 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.167 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.167 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.167 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:13.167 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 7 2024-09-20T21:02:13.167 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:13.168 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:13.188 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:13.183+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:13.245 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 46 16 105649 105633 143.508 132.062 0.00612439 0.00696408 2024-09-20T21:02:13.289 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:13.285+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:13.320 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:13.320 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:13.320 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:13.321 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:13.321 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:13.343 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:13.389 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:13.385+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:13.465 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:02:13.490 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:13.490+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:13.502 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:13.502 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.305304225999997, 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:13.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:13.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:13.509 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.305214190000001, 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:13.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:13.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:13.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.515 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.305127837000001, 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:13.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.305059028000002, 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:13.522 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:13.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:13.528 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.305026167999998, 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:13.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:13.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:13.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.304984150999999, 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:13.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:13.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:13.540 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.304859045000001, 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:13.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:13.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.546 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.304766696000002, 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.547 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:13.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:13.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.304682323999998, 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:13.552 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:13.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.556 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.539222868, 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.557 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:13.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:13.562 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.538670862, 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.563 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:13.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:13.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.568 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.538043281, 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.569 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:13.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.537932271999999, 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:13.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:13.580 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.53426576, 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:13.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.533951426000002, 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.586 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:13.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:13.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:13.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.533769308, 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.592 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:13.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.597 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.788309385, 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.598 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:13.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:13.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:13.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.603 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.78395846, 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:13.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:13.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:13.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:13.607 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.7757163889999998, 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.609 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:13.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:13.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.613 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.614 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:103545 5.b 5:d91feae6:::benchmark_data_smithi112_23632_object103544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.24896224, 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021689756000000001, 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.615 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 103545 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.616 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252414+0000", 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7700000000000004e-07 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252448+0000", 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4388999999999999e-05 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252469+0000", 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0270000000000001e-05 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252475+0000", 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0290000000000002e-06 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257523+0000", 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050483749999999999 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257683+0000", 2024-09-20T21:02:13.618 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016024999999999999 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257839+0000", 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015597000000000001 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.263823+0000", 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0059834420000000003 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:13.619 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.273976+0000", 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010153206 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.274049+0000", 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.339e-05 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.274103+0000", 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3758000000000003e-05 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.620 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.621 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:13.621 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:13.621 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:13.622 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:13.623 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:13.617+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:13.716 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:13.722 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:13.719+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:13.781 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:13.781 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:13.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.781 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:106777 5.8 5:18b976b5:::benchmark_data_smithi112_23632_object106776:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-20T21:02:13.781 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:13.776356+0000", 2024-09-20T21:02:13.781 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0041113599999999997, 2024-09-20T21:02:13.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0041397200000000004, 2024-09-20T21:02:13.781 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:13.781 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 106777 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776356+0000", 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776356+0000", 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776357+0000", 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7100000000000011e-07 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776429+0000", 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1520000000000006e-05 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776438+0000", 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4630000000000007e-06 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776445+0000", 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9759999999999998e-06 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776504+0000", 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8566000000000001e-05 2024-09-20T21:02:13.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776646+0000", 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014194000000000001 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776788+0000", 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014248099999999999 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779090+0000", 2024-09-20T21:02:13.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023021890000000001 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:106779 5.4 5:21765922:::benchmark_data_smithi112_23632_object106778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:13.776589+0000", 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0038787930000000002, 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003988686, 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:13.786 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 106779 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776589+0000", 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776589+0000", 2024-09-20T21:02:13.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776589+0000", 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4799999999999998e-07 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776644+0000", 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4960000000000002e-05 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776651+0000", 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0389999999999999e-06 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776656+0000", 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1960000000000001e-06 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776701+0000", 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5021999999999997e-05 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776828+0000", 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012743100000000001 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.777176+0000", 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034812599999999998 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.790 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:106780 5.4 5:25248b25:::benchmark_data_smithi112_23632_object106779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:13.776723+0000", 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0037441129999999999, 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039239030000000003, 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 106780 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776723+0000", 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776723+0000", 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776724+0000", 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7599999999999997e-07 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776771+0000", 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6621e-05 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776776+0000", 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3260000000000003e-06 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.776779+0000", 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4000000000000001e-06 2024-09-20T21:02:13.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779416+0000", 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026368279999999999 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779564+0000", 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014736999999999999 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:13.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779803+0000", 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023908499999999999 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:106784 5.a 5:53cff9dd:::benchmark_data_smithi112_23632_object106783:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:13.779575+0000", 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00089277099999999999, 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001115689, 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:13.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 106784 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779575+0000", 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:13.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779575+0000", 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779576+0000", 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2999999999999999e-07 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779633+0000", 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7818000000000001e-05 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779642+0000", 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1669999999999999e-06 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779647+0000", 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7540000000000003e-06 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779689+0000", 2024-09-20T21:02:13.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2018999999999999e-05 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779855+0000", 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016530700000000001 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779957+0000", 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102681 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:106785 5.c 5:3954e9c5:::benchmark_data_smithi112_23632_object106784:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:13.779750+0000", 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00071718200000000002, 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0009795959999999999, 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 106785 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779750+0000", 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779750+0000", 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:13.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779751+0000", 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779844+0000", 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2725000000000004e-05 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779854+0000", 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0372e-05 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779861+0000", 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9709999999999998e-06 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779943+0000", 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1712000000000006e-05 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.780075+0000", 2024-09-20T21:02:13.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000131655 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.780210+0000", 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013542099999999999 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:106775 5.e e42/21 5:77d02c8f:::benchmark_data_smithi112_23632_object106774:head v 42'6661, mlcod=42'6658)", 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:13.779797+0000", 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00067095100000000003, 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00097129400000000004, 2024-09-20T21:02:13.804 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779797+0000", 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779797+0000", 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779797+0000", 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6700000000000003e-07 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779929+0000", 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013181900000000001 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779942+0000", 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.276e-05 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.779957+0000", 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5407999999999999e-05 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.780004+0000", 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6810000000000001e-05 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.780021+0000", 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7306e-05 2024-09-20T21:02:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:106781 5.e e42/21)", 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:13.780329+0000", 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00013850000000000001, 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046693400000000001, 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.780329+0000", 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.780329+0000", 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.780330+0000", 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.37e-07 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.780456+0000", 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0001262 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.780468+0000", 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2476999999999999e-05 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.780475+0000", 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4930000000000003e-06 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:106767 5.5 5:a8ebeb45:::benchmark_data_smithi112_23632_object106766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:13.771794+0000", 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0086736039999999997, 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.009031964, 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:13.811 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 106767 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.771794+0000", 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.771794+0000", 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.771795+0000", 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0130000000000001e-06 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.771864+0000", 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9375999999999994e-05 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.771876+0000", 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1748e-05 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.771884+0000", 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2360000000000004e-06 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.773996+0000", 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021111720000000001 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.774119+0000", 2024-09-20T21:02:13.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012394899999999999 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.774264+0000", 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014411799999999999 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:13.777282+0000", 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030188400000000001 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.815 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:13.816 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:13.816 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 8 2024-09-20T21:02:13.816 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:13.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:13.863 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:13.861+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:13.870 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:13.870 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:13.888 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:13.889 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:13.907 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:13.907 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:13.923 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:13.922+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:13.968 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:13.968 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:13.990 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:14.025 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:14.022+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:14.126 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:14.123+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:14.184 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:14.184 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:14.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:02:14.226 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:14.221+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:14.245 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 47 16 107675 107659 143.148 126.625 0.00706425 0.00698134 2024-09-20T21:02:14.327 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:14.323+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:14.358 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:14.358 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:14.380 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:14.428 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:14.426+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:14.529 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:14.525+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:14.575 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:14.575 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:14.594 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:14.639 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:14.635+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:14.730 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:14.730+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:14.745 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:14.745 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:14.768 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:14.831 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:14.830+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:14.924 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:14.925 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:14.932 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:14.927+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:14.945 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:15.033 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:15.034+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:15.134 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:15.129+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:15.143 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:15.143 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:15.163 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:15.245 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 48 16 109816 109800 142.954 133.812 0.00877123 0.00699106 2024-09-20T21:02:15.253 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:15.254+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:15.336 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:15.333+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:15.354 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:15.355 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:15.376 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:15.437 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:15.431+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:15.488 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T21:02:15.530 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:15.530 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:15.538 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:15.535+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:15.552 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:15.593 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T21:02:15.594 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-20T21:02:15.640 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:15.638+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:15.709 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:15.709 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:15.728 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:15.740 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:15.738+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:15.841 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:15.842+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:15.886 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:15.886 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:15.904 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:02:15.925 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:15.950 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:15.947+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:16.043 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:16.039+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:16.051 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:16.051 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:16.072 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:16.078 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:16.078 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:16.096 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:16.096 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:16.114 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:16.114 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:16.144 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:16.141+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:16.245 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:16.241+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:16.245 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 49 16 111808 111792 142.577 124.5 0.00509013 0.00700935 2024-09-20T21:02:16.262 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:16.262 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:02:16.262 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:02:16.262 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:02:16.262 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:16.284 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:16.346 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:16.346+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:16.437 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:16.437 INFO:teuthology.orchestra.run.smithi161.stdout: "size": 20, 2024-09-20T21:02:16.437 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 600, 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 74.472681046999995, 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.33315160500000002, 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:02:16.438 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 1 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962600+0000", 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.439 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962602+0000", 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.3369999999999998e-06 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962615+0000", 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.322e-05 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962638+0000", 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2376000000000001e-05 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962654+0000", 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6192999999999999e-05 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962832+0000", 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017765599999999999 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for peered", 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:01.962848+0000", 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.6799999999999998e-05 2024-09-20T21:02:16.441 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.291828+0000", 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.32897961599999997 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292171+0000", 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034286800000000002 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.292476+0000", 2024-09-20T21:02:16.442 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00030503000000000003 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.294898+0000", 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024222950000000001 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295508+0000", 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00060948600000000001 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.443 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295638+0000", 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013024799999999999 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.295751+0000", 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011348 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4173.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:16.444 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 73.467686272999998, 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024810191999999998, 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4173", 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/521141583", 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 165 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.445 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967595+0000", 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967596+0000", 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5540000000000001e-06 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967614+0000", 2024-09-20T21:02:16.446 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7506000000000001e-05 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967636+0000", 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1883e-05 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.967650+0000", 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4219999999999999e-05 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.986884+0000", 2024-09-20T21:02:16.447 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019233734999999998 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987013+0000", 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012981599999999999 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.987205+0000", 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019171499999999999 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.989009+0000", 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0018037159999999999 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992247+0000", 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0032385220000000002 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992338+0000", 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0768999999999998e-05 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:02.992405+0000", 2024-09-20T21:02:16.450 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.6755999999999996e-05 2024-09-20T21:02:16.450 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.450 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.450 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.450 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.450 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.450 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.450 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:16.450 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.239746877000002, 2024-09-20T21:02:16.450 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028010124000000001, 2024-09-20T21:02:16.451 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.451 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.451 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.451 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.451 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.451 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.451 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195534+0000", 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195537+0000", 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.0900000000000001e-06 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.452 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195591+0000", 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4313e-05 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195621+0000", 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.97e-05 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195641+0000", 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0009000000000001e-05 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.453 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200093+0000", 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.004451923 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200351+0000", 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000257908 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200886+0000", 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00053542200000000002 2024-09-20T21:02:16.454 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.210822+0000", 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0099352069999999997 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223318+0000", 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012496480000000001 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223443+0000", 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000125103 2024-09-20T21:02:16.455 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223544+0000", 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000100969 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.239599658000003, 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028315928000000001, 2024-09-20T21:02:16.456 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195681+0000", 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.457 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195683+0000", 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.72e-06 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195694+0000", 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1436e-05 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195720+0000", 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5527000000000001e-05 2024-09-20T21:02:16.458 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195767+0000", 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7315999999999999e-05 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202885+0000", 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0071176319999999996 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203125+0000", 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024060499999999999 2024-09-20T21:02:16.459 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203468+0000", 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034299100000000001 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213009+0000", 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0095403720000000001 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223668+0000", 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010659307999999999 2024-09-20T21:02:16.460 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223821+0000", 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015296600000000001 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223997+0000", 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017605499999999999 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.461 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.239473726, 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.028777915000000001, 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.462 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195807+0000", 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195810+0000", 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195822+0000", 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2464e-05 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.463 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195848+0000", 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.603e-05 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195872+0000", 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.349e-05 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204072+0000", 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0082004469999999996 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.464 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204257+0000", 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00018438800000000001 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204428+0000", 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017095899999999999 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213023+0000", 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0085959030000000002 2024-09-20T21:02:16.465 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224138+0000", 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011114206999999999 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224487+0000", 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034953499999999999 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224585+0000", 2024-09-20T21:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7879000000000003e-05 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.239389130000006, 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029059366, 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.467 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195892+0000", 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195893+0000", 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.468 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195900+0000", 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.883e-06 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.195920+0000", 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0250000000000001e-05 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196169+0000", 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024876800000000001 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.469 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205134+0000", 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0089648850000000006 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205331+0000", 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000196715 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205705+0000", 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00037435399999999997 2024-09-20T21:02:16.470 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213071+0000", 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0073664689999999996 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224694+0000", 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011622479999999999 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224848+0000", 2024-09-20T21:02:16.471 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000154239 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224951+0000", 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000102983 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.239071529, 2024-09-20T21:02:16.472 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029549044999999999, 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196209+0000", 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.473 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196211+0000", 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7770000000000001e-06 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196222+0000", 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0676000000000001e-05 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196252+0000", 2024-09-20T21:02:16.474 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.9933999999999998e-05 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196269+0000", 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7679000000000001e-05 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206427+0000", 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010157605 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.475 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206679+0000", 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025190800000000001 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207044+0000", 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00036494400000000002 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213180+0000", 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.006135873 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.476 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225102+0000", 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011922228 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225349+0000", 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00024666100000000002 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225758+0000", 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00040976000000000001 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.477 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238969812999997, 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030161844, 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.478 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196311+0000", 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196313+0000", 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5260000000000001e-06 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.479 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4269999999999997e-06 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196342+0000", 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9936999999999999e-05 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196356+0000", 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4436e-05 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207726+0000", 2024-09-20T21:02:16.480 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.011370086 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207922+0000", 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00019597899999999999 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208204+0000", 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00028149099999999998 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.213198+0000", 2024-09-20T21:02:16.481 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0049940710000000001 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226047+0000", 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012848861 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226272+0000", 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022529099999999999 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226473+0000", 2024-09-20T21:02:16.482 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020073899999999999 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238889216999993, 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030464055, 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.483 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196393+0000", 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3400000000000001e-06 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.484 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196401+0000", 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.7800000000000001e-06 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196424+0000", 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2929999999999999e-05 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196446+0000", 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1789000000000001e-05 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.485 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208810+0000", 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.012364135 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209089+0000", 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00027976800000000001 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.209435+0000", 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034547400000000002 2024-09-20T21:02:16.486 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.216263+0000", 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0068278669999999996 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226590+0000", 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.010326811 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226735+0000", 2024-09-20T21:02:16.487 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000144955 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226856+0000", 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000121206 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238812151000005, 2024-09-20T21:02:16.488 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.039096831999999998, 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196469+0000", 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.489 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196470+0000", 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196534+0000", 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.3869999999999997e-05 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:16.490 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.2330000000000001e-05 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196575+0000", 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.8258999999999999e-05 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218399+0000", 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021824818999999999 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.491 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218615+0000", 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00021549199999999999 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.218946+0000", 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000330854 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226886+0000", 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0079398679999999992 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.492 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235361+0000", 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0084748919999999995 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235445+0000", 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4599999999999996e-05 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.235566+0000", 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120425 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.493 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238600683000001, 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026490169000000001, 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.494 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196682+0000", 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.514e-06 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.495 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196690+0000", 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.9859999999999994e-06 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196710+0000", 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0129999999999999e-05 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196727+0000", 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7540000000000001e-05 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.496 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199574+0000", 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002846805 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199782+0000", 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00020769500000000001 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200080+0000", 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029791799999999999 2024-09-20T21:02:16.497 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206568+0000", 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0064880129999999999 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.222896+0000", 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.01632836 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223041+0000", 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014465300000000001 2024-09-20T21:02:16.498 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223170+0000", 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000129555 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238524846000004, 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029774875999999999, 2024-09-20T21:02:16.499 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196756+0000", 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.500 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196757+0000", 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1829999999999999e-06 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196764+0000", 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.8870000000000003e-06 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196782+0000", 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7839e-05 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.501 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196795+0000", 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3074000000000001e-05 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.199254+0000", 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0024588909999999999 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200399+0000", 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001144644 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200659+0000", 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026029500000000001 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206574+0000", 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0059156240000000004 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225091+0000", 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018516419999999999 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.503 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225341+0000", 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00025051799999999998 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226531+0000", 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0011895009999999999 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.504 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238402784000002, 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.031045657000000001, 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.505 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196878+0000", 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196880+0000", 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.423e-06 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196889+0000", 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.5840000000000001e-06 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.506 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196910+0000", 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0948999999999999e-05 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196925+0000", 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4912999999999999e-05 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202455+0000", 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0055297480000000001 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.507 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203264+0000", 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00080893100000000004 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203490+0000", 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00022649399999999999 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207548+0000", 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0040580829999999997 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.508 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227617+0000", 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020068328 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227778+0000", 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000161509 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227924+0000", 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014569499999999999 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.509 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238334535000007, 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029026089000000001, 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:16.510 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196946+0000", 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196948+0000", 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4729999999999999e-06 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196976+0000", 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.8044000000000001e-05 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.196996+0000", 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0412999999999999e-05 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197014+0000", 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7893e-05 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.512 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200035+0000", 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0030206209999999998 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200302+0000", 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026755099999999999 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201028+0000", 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000725451 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.513 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204740+0000", 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0037118709999999998 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225591+0000", 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.020851719000000001 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225857+0000", 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00026536399999999998 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.514 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.225972+0000", 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000115689 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238241748999997, 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026565332000000001, 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.515 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197039+0000", 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197040+0000", 2024-09-20T21:02:16.516 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.2100000000000001e-06 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197048+0000", 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.5669999999999997e-06 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197067+0000", 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9083e-05 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.517 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197082+0000", 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.4630000000000001e-05 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202433+0000", 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.005351359 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204070+0000", 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.001636708 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204248+0000", 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00017873100000000001 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.207562+0000", 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0033132109999999999 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223376+0000", 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.015814261 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223507+0000", 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013126300000000001 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223604+0000", 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.7309e-05 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238179892999995, 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.024551005000000001, 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.521 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197101+0000", 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197102+0000", 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.13e-06 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197108+0000", 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 6.1299999999999998e-06 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.522 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197130+0000", 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.1413999999999999e-05 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197144+0000", 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.428e-05 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197299+0000", 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015542799999999999 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.523 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197650+0000", 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00035077399999999999 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.198150+0000", 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00049997300000000002 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202746+0000", 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0045962479999999998 2024-09-20T21:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221404+0000", 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.018657402999999999 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221521+0000", 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00011725199999999999 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.221652+0000", 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013097299999999999 2024-09-20T21:02:16.525 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238097517, 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026769211000000001, 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.526 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197183+0000", 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197185+0000", 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.127e-06 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.527 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197193+0000", 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197230+0000", 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7766999999999999e-05 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197246+0000", 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.535e-05 2024-09-20T21:02:16.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204927+0000", 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0076817810000000004 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205254+0000", 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000326874 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.205565+0000", 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00031036099999999999 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.529 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.208826+0000", 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.003261258 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223710+0000", 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.014884468 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223842+0000", 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013109600000000001 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.530 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.223953+0000", 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000111086 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.238012956999995, 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.029085501999999999, 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.531 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197268+0000", 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.532 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197269+0000", 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.147e-06 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197276+0000", 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.306e-06 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197295+0000", 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9057000000000001e-05 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.533 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197311+0000", 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.5749000000000001e-05 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202922+0000", 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0056104680000000004 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203135+0000", 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000212871 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.534 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.203333+0000", 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000198712 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206203+0000", 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.002869684 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226098+0000", 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.019894866000000001 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.535 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226262+0000", 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00016431900000000001 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226353+0000", 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1323000000000006e-05 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.536 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.237949051000001, 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.030409906, 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.537 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197332+0000", 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197333+0000", 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.1629999999999999e-06 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197340+0000", 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.538 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197359+0000", 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.9086e-05 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197372+0000", 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.314e-05 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.200821+0000", 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0034487279999999999 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.539 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.201167+0000", 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00034594999999999998 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.202695+0000", 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0015284249999999999 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.204873+0000", 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0021775729999999999 2024-09-20T21:02:16.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226802+0000", 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.021928713999999998 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "commit_sent", 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.226928+0000", 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00012597199999999999 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.227742+0000", 2024-09-20T21:02:16.541 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00081404800000000005 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 64.237886308, 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.026907772, 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:16.542 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197395+0000", 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197396+0000", 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:16.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197421+0000", 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.5185999999999999e-05 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197442+0000", 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0602999999999999e-05 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.197463+0000", 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 2.0769999999999999e-05 2024-09-20T21:02:16.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206645+0000", 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00918274 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.206945+0000", 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00029993700000000001 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "done", 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:01:12.224302+0000", 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.017357139000000001 2024-09-20T21:02:16.545 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.546 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.546 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.546 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:16.546 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:16.546 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:16.547 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.0 to 1 (10000) 2024-09-20T21:02:16.547 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-20T21:02:16.548 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:16.549 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:16.543+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:16.549 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-20T21:02:16.648 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:16.643+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:16.708 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:16.708 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:16.708 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.708 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:112791 5.b 5:d770425f:::benchmark_data_smithi112_23632_object112790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-20T21:02:16.708 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:16.703768+0000", 2024-09-20T21:02:16.708 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0050850790000000002, 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0051067049999999996, 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 112791 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.703768+0000", 2024-09-20T21:02:16.709 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:16.710 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.710 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.710 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:16.710 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.703768+0000", 2024-09-20T21:02:16.710 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:16.710 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.710 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.710 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:16.710 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.703769+0000", 2024-09-20T21:02:16.711 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2900000000000002e-07 2024-09-20T21:02:16.711 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.711 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:16.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.703803+0000", 2024-09-20T21:02:16.711 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4007999999999997e-05 2024-09-20T21:02:16.711 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.711 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:16.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.703811+0000", 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8169999999999999e-06 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.703816+0000", 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9150000000000004e-06 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.704654+0000", 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00083771300000000002 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.712 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.704766+0000", 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000111708 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.704889+0000", 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012340499999999999 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707087+0000", 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0021982210000000002 2024-09-20T21:02:16.713 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:112793 5.0 5:008cc7e7:::benchmark_data_smithi112_23632_object112792:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:16.704833+0000", 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0040206269999999997, 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040935989999999998, 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:16.714 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 112793 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.704833+0000", 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.704833+0000", 2024-09-20T21:02:16.715 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.704834+0000", 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7199999999999997e-07 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.704897+0000", 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3652000000000007e-05 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:16.716 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.704908+0000", 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0101999999999999e-05 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.704916+0000", 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1969999999999996e-06 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.704955+0000", 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8872000000000003e-05 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.717 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.705034+0000", 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9417000000000002e-05 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.705117+0000", 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3127000000000006e-05 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707618+0000", 2024-09-20T21:02:16.718 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0025012889999999999 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:112799 5.4 e43/38 5:24c4f057:::benchmark_data_smithi112_23632_object112798:head v 43'7093, mlcod=43'7091)", 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:16.707472+0000", 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0013814579999999999, 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001497162, 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.719 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707472+0000", 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707472+0000", 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707473+0000", 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:16.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707542+0000", 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9512999999999997e-05 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707552+0000", 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0156999999999999e-05 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707559+0000", 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0389999999999999e-06 2024-09-20T21:02:16.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707597+0000", 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7938000000000002e-05 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707616+0000", 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9105000000000001e-05 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.722 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:112800 5.8 e43/38 5:18384699:::benchmark_data_smithi112_23632_object112799:head v 43'7105, mlcod=43'7101)", 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:16.707820+0000", 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001033745, 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0011817799999999999, 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707820+0000", 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:16.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707820+0000", 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707820+0000", 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2099999999999997e-07 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707863+0000", 2024-09-20T21:02:16.724 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2851e-05 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707872+0000", 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5469999999999997e-06 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707876+0000", 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3819999999999997e-06 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:16.725 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707921+0000", 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4753999999999999e-05 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:16.707938+0000", 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6790999999999999e-05 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 4 2024-09-20T21:02:16.726 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:16.729 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:16.749 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:16.745+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:16.850 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:16.847+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:16.879 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:16.879 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:16.879 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:16.879 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:16.880 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:16.901 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:16.950 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:16.950+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:17.052 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:17.047+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:17.061 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:17.061 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:17.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:17.061 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:17.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.061 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.062 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:17.062 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 64.862210218000001, 2024-09-20T21:02:17.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:17.062 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.062 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.062 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.063 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:17.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:17.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:17.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:17.065 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:17.066 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:17.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.066 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:17.066 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:17.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:17.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:17.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:17.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:17.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.069 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:17.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:17.069 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:17.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.070 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.070 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.070 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:17.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:17.070 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.070 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.071 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.071 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:17.071 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:17.071 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.071 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.071 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.072 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:17.072 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:17.072 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.072 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.072 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.072 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:17.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:17.073 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.073 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.073 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.073 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:17.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:17.073 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.074 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.074 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.074 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:17.074 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:17.074 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.074 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.075 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.075 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:17.075 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:17.075 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.075 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.075 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.076 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.076 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.076 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.076 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:17.076 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 64.862120181999998, 2024-09-20T21:02:17.077 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:17.077 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.077 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.077 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.077 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.077 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:17.078 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.078 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.078 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:17.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:17.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:17.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.080 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.080 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:17.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:17.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:17.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:17.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:17.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:17.082 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.083 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:17.083 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:17.083 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.083 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.083 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:17.083 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:17.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:17.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:17.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:17.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.085 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.085 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.085 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:17.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:17.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:17.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:17.086 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:17.087 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:17.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:17.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:17.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.088 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:17.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:17.089 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.089 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.089 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.089 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:17.089 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:17.089 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.090 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.090 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.090 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.090 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.090 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.090 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:17.091 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 64.862033828999998, 2024-09-20T21:02:17.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:17.091 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.091 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.091 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.091 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:17.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:17.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:17.094 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:17.094 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.094 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.094 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:17.095 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:17.095 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.095 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.095 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.095 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:17.095 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:17.096 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.096 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.096 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:17.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:17.096 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:17.097 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:17.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:17.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:17.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:17.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:17.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:17.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:17.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:17.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:17.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:17.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:17.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:17.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:17.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:17.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:17.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:17.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:17.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:17.104 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.104 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.104 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.105 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.105 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:17.105 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 64.86196502, 2024-09-20T21:02:17.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:17.105 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.105 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.106 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.106 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.106 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:17.106 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.107 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.107 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.107 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.107 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:17.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.107 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.108 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.108 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.108 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:17.108 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:17.108 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.108 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:17.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:17.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:17.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:17.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:17.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:17.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:17.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:17.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:17.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:17.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:17.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.113 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.113 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:17.113 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:17.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.113 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.114 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:17.114 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:17.114 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.114 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.114 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.114 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:17.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:17.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:17.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:17.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:17.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:17.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:17.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:17.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:17.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:17.118 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.118 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.118 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.119 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.119 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.119 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:17.119 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 64.861932159999995, 2024-09-20T21:02:17.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:17.119 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.119 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.119 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.120 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:17.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:17.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:17.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 64.861890142999997, 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:17.125 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:17.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:17.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:17.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 64.861765036999998, 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:17.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:17.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 64.861672687999999, 2024-09-20T21:02:17.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:17.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:17.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:17.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 64.861588315999995, 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.143 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:17.147 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 26.09612886, 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.148 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:17.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:17.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:17.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.153 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 26.095576854000001, 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.154 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:17.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:17.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:17.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:17.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 26.094949273000001, 2024-09-20T21:02:17.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:17.161 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.161 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.161 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.161 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.161 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.161 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.161 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:17.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.162 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:17.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:17.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:17.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:17.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:17.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:17.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:17.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:17.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:17.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:17.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:17.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:17.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:17.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:17.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:17.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:17.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:17.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:17.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:17.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:17.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:17.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:17.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:17.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:17.169 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.170 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.170 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.170 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:17.170 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:17.170 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 26.094838264, 2024-09-20T21:02:17.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:17.171 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.171 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.171 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.171 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.171 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.171 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.171 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:17.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.172 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:17.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:17.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:17.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:17.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:17.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:17.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:17.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:17.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:17.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:17.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:17.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:17.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:17.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:17.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.177 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:17.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:17.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:17.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:17.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:17.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:17.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:17.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:17.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:17.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:17.180 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.180 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.180 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.181 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:17.181 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:17.181 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 26.091171752000001, 2024-09-20T21:02:17.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:17.181 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.181 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.181 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.182 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.182 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.182 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.182 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:17.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.182 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:17.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:17.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.184 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.184 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:17.184 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:17.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.184 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:17.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:17.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:17.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:17.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:17.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:17.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:17.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:17.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:17.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:17.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:17.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:17.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:17.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:17.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:17.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:17.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:17.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:17.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.190 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:17.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:17.191 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.191 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.191 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.191 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:17.191 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:17.191 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 26.090857417999999, 2024-09-20T21:02:17.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:17.192 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.192 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.192 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.192 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.192 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.192 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.192 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:17.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.193 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:17.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:17.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:17.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:17.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.195 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:17.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:17.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:17.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:17.196 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:17.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:17.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.197 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:17.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:17.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:17.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:17.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:17.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:17.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:17.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:17.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:17.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:17.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:17.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:17.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 26.090675300000001, 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:17.201 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.202 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.202 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.202 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.202 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.202 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.202 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:17.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.202 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.202 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:17.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:17.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:17.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:17.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.3452153769999997, 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.208 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:17.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:17.213 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.3408644519999999, 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.214 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:17.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 5.3326223810000002, 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:17.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:17.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:17.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:103545 5.b 5:d91feae6:::benchmark_data_smithi112_23632_object103544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.8058682319999999, 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021689756000000001, 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:17.225 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 103545 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252414+0000", 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7700000000000004e-07 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252448+0000", 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4388999999999999e-05 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252469+0000", 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0270000000000001e-05 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252475+0000", 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0290000000000002e-06 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257523+0000", 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050483749999999999 2024-09-20T21:02:17.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257683+0000", 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016024999999999999 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257839+0000", 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015597000000000001 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.263823+0000", 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0059834420000000003 2024-09-20T21:02:17.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.273976+0000", 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010153206 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.274049+0000", 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.339e-05 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.274103+0000", 2024-09-20T21:02:17.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3758000000000003e-05 2024-09-20T21:02:17.231 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.231 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.231 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.231 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:17.231 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:17.231 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:17.232 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:17.233 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:17.229+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:17.245 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 50 16 113931 113915 142.379 132.688 0.00846615 0.00701929 2024-09-20T21:02:17.333 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:17.330+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:17.390 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:114208 5.5 5:aa79ea2f:::benchmark_data_smithi112_23632_object114207:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-20T21:02:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:17.384841+0000", 2024-09-20T21:02:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0048211540000000002, 2024-09-20T21:02:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048396580000000002, 2024-09-20T21:02:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114208 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.384841+0000", 2024-09-20T21:02:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.384841+0000", 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.384842+0000", 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5600000000000005e-07 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.384930+0000", 2024-09-20T21:02:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8797999999999999e-05 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.384939+0000", 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4940000000000003e-06 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.384943+0000", 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5050000000000001e-06 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386776+0000", 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001832897 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386923+0000", 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014679600000000001 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387189+0000", 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000266261 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:114209 5.8 5:1b31fcf7:::benchmark_data_smithi112_23632_object114208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:17.386534+0000", 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003127679, 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003197039, 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114209 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386534+0000", 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386534+0000", 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386535+0000", 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8200000000000001e-07 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386561+0000", 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6548999999999999e-05 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386568+0000", 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8340000000000001e-06 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386572+0000", 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0450000000000002e-06 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387001+0000", 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042861499999999997 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387158+0000", 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015714799999999999 2024-09-20T21:02:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387298+0000", 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014024400000000001 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:114211 5.a 5:5b8d51cb:::benchmark_data_smithi112_23632_object114210:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:17.386580+0000", 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0030819490000000001, 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031917540000000002, 2024-09-20T21:02:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114211 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386580+0000", 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386580+0000", 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386580+0000", 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8099999999999999e-07 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386602+0000", 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1957999999999999e-05 2024-09-20T21:02:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386608+0000", 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.677e-06 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386612+0000", 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6600000000000001e-06 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386662+0000", 2024-09-20T21:02:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0120999999999997e-05 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386825+0000", 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000163385 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.386952+0000", 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012718399999999999 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.389517+0000", 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002564986 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:114212 5.1 5:8ffdfe28:::benchmark_data_smithi112_23632_object114211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:17.387050+0000", 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0026121479999999999, 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027657379999999998, 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114212 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387050+0000", 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387050+0000", 2024-09-20T21:02:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387051+0000", 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7599999999999996e-07 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387096+0000", 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5286e-05 2024-09-20T21:02:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387105+0000", 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4399999999999994e-06 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387112+0000", 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999996e-06 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387180+0000", 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7214999999999999e-05 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387299+0000", 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011924700000000001 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387432+0000", 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013274900000000001 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:114213 5.c 5:3e7d6081:::benchmark_data_smithi112_23632_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:17.387136+0000", 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0025259309999999999, 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002717863, 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114213 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387136+0000", 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387136+0000", 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387137+0000", 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9500000000000003e-07 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387172+0000", 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5828999999999999e-05 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387180+0000", 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0560000000000005e-06 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387186+0000", 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7089999999999999e-06 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387236+0000", 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9876999999999997e-05 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387377+0000", 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140901 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.387511+0000", 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013447200000000001 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:114214 5.3 5:cac1e91c:::benchmark_data_smithi112_23632_object114213:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:17.388084+0000", 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001578114, 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001808568, 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114214 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.388084+0000", 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.388084+0000", 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.388085+0000", 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8899999999999998e-07 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.388113+0000", 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8643999999999999e-05 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.388125+0000", 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1956999999999999e-05 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.388132+0000", 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7299999999999999e-06 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.388314+0000", 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018216200000000001 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.388481+0000", 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016702199999999999 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:17.388613+0000", 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013141800000000001 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 6 2024-09-20T21:02:17.417 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:17.419 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:17.434 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:17.434+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:17.474 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.1 to 1 (10000) 2024-09-20T21:02:17.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-20T21:02:17.534 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:17.531+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:17.574 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:17.574 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:17.574 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:17.574 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:17.574 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:17.594 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:17.635 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:17.631+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:17.736 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:17.731+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:17.745 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:17.745 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:17.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:17.745 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.548736065, 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:17.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:17.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:17.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.548601865999998, 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:17.752 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:17.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:17.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:17.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:17.758 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.54849686, 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:17.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:17.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:17.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.764 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.548377334999998, 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:17.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:17.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.548307328000007, 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:17.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:17.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.548232275999993, 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:17.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:17.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.548145250000005, 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:17.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:17.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.548076476999995, 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.788 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:17.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0303298139999999, 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:17.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0274941709999998, 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:17.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:17.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:17.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.803 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0270443660000002, 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.804 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:17.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0269412009999996, 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.810 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:17.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:17.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.026853215, 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:17.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.821 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0260407110000003, 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.825 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.024272152, 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.826 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:17.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.831 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0238076329999997, 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.832 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:17.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:17.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0236117619999998, 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.838 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:17.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:17.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0231298989999997, 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.844 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:17.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:17.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0209818390000001, 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:17.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:17.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:17.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0178505549999999, 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:17.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:17.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:17.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:17.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:17.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:17.860 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.860 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.860 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.860 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:17.860 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:17.860 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:17.862 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:02:17.862 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:17.855+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:17.962 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:17.957+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:18.010 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:18.010 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [ 2024-09-20T21:02:18.010 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.010 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4448.0:115421 5.9 5:99bda0e6:::benchmark_data_smithi112_23632_object115420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-20T21:02:18.010 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:18.001735+0000", 2024-09-20T21:02:18.010 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0078414890000000001, 2024-09-20T21:02:18.010 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0078673519999999993, 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4448", 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 115421 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.001735+0000", 2024-09-20T21:02:18.011 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.001735+0000", 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.001736+0000", 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.0599999999999999e-07 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:18.012 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.001856+0000", 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.000120481 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.001865+0000", 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.9830000000000002e-06 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.001870+0000", 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.5900000000000001e-06 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.013 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.001911+0000", 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.0720999999999999e-05 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.002006+0000", 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.4791999999999996e-05 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.002090+0000", 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.4334999999999998e-05 2024-09-20T21:02:18.014 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "op_commit", 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.003790+0000", 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0016999129999999999 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_op(client.4448.0:115432 5.9 5:96ad1a3e:::benchmark_data_smithi112_23632_object115431:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:18.007121+0000", 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.00245598, 2024-09-20T21:02:18.015 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0025485490000000002, 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "client_info": { 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "client": "client.4448", 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "tid": 115432 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007121+0000", 2024-09-20T21:02:18.016 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007121+0000", 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007122+0000", 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.192e-06 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007255+0000", 2024-09-20T21:02:18.017 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00013283500000000001 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007264+0000", 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.6059999999999992e-06 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007270+0000", 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.2850000000000002e-06 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.018 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007322+0000", 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.2778999999999997e-05 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007474+0000", 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00015195599999999999 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007624+0000", 2024-09-20T21:02:18.019 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.00014958899999999999 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:115430 5.3 e44/21 5:c7c1418d:::benchmark_data_smithi112_23632_object115429:head v 44'7168, mlcod=44'7166)", 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:18.007319+0000", 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0022578329999999999, 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0023916269999999999, 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:18.020 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007319+0000", 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007319+0000", 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:18.021 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007319+0000", 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.9400000000000005e-07 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007407+0000", 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.7865e-05 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007415+0000", 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 7.3300000000000001e-06 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.022 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007419+0000", 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.4680000000000003e-06 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007466+0000", 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7411999999999999e-05 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007484+0000", 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.7810000000000001e-05 2024-09-20T21:02:18.023 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:115428 5.c e44/21 5:3b41b6a5:::benchmark_data_smithi112_23632_object115427:head v 44'7130, mlcod=44'7128)", 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:18.007435+0000", 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 0.0021419350000000002, 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0.0023354309999999998, 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "started", 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:18.024 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007435+0000", 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007435+0000", 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007435+0000", 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.4200000000000002e-07 2024-09-20T21:02:18.025 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007475+0000", 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.0159e-05 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007481+0000", 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 5.4079999999999997e-06 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007484+0000", 2024-09-20T21:02:18.026 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 3.7890000000000001e-06 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "reached_pg", 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007528+0000", 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.3924999999999997e-05 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "started", 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.007542+0000", 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.3971000000000001e-05 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:18.027 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: "description": "osd_repop(client.4448.0:115431 5.2 e44/21)", 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: "initiated_at": "2024-09-20T21:02:18.009751+0000", 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: "age": 4294967295.999826, 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 8.0034e-05, 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: "continuous": false, 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: "type_data": { 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: "events": [ 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "initiated", 2024-09-20T21:02:18.028 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.009751+0000", 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "header_read", 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.009751+0000", 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 0 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "throttled", 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.009752+0000", 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 9.1200000000000001e-07 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.029 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "all_read", 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.009799+0000", 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 4.7682999999999997e-05 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "dispatched", 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.009810+0000", 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0951999999999999e-05 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: "event": "queued_for_pg", 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: "time": "2024-09-20T21:02:18.009820+0000", 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: "duration": 1.0295999999999999e-05 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.030 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-20T21:02:18.031 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.031 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-20T21:02:18.031 INFO:teuthology.orchestra.run.smithi161.stdout: ], 2024-09-20T21:02:18.031 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 5 2024-09-20T21:02:18.031 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:18.032 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T21:02:18.078 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:18.075+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:18.132 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:18.164 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:18.159+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:18.178 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:02:18.178 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:02:18.178 INFO:teuthology.orchestra.run.smithi161.stdout: "complaint_time": 30, 2024-09-20T21:02:18.178 INFO:teuthology.orchestra.run.smithi161.stdout: "num_blocked_ops": 0 2024-09-20T21:02:18.179 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:02:18.197 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T21:02:18.246 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 51 16 115930 115914 142.036 124.938 0.00628036 0.00703619 2024-09-20T21:02:18.265 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:18.261+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:18.288 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:18.288 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:18.306 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:18.306 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:18.325 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:18.325 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:18.365 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:18.359+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:18.387 INFO:teuthology.orchestra.run.smithi161.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:18.387 INFO:teuthology.orchestra.run.smithi161.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:18.408 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:18.466 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:18.466+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:18.493 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.2 to 1 (10000) 2024-09-20T21:02:18.516 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-20T21:02:18.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:02:18.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:02:18.562 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:18.562 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:18.567 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:18.561+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:18.582 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:18.667 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:18.663+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:18.768 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:02:18.763+0000 7fccc62a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22930) UID: 0 2024-09-20T21:02:18.780 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:18.780 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:18.799 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:18.852 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:02:18.854 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:02:18.868 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:18.866+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:18.870 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-20T21:02:18.488643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7160531869,"num_objects":109278,"num_object_clones":0,"num_object_copies":218556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109278,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":109502,"num_write_kb":6995604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59624,"ondisk_log_size":59624,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1212796,"kb_used_data":862400,"kb_used_omap":4,"kb_used_meta":350331,"kb_avail":281902724,"statfs":{"total":289910292480,"available":288668389376,"internally_reserved":0,"allocated":883097600,"data_stored":14106863807,"data_compressed":67596968,"data_compressed_allocated":881655808,"data_compressed_original":14106329088,"omap_allocated":4788,"internal_metadata":358739276},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":662372352,"num_objects":10107,"num_object_clones":0,"num_object_copies":20214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10107,"num_write_kb":646848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.612320"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464194+0000","last_change":"2024-09-20T21:02:06.428072+0000","last_active":"2024-09-20T21:02:13.464194+0000","last_peered":"2024-09-20T21:02:13.464194+0000","last_clean":"2024-09-20T21:02:13.464194+0000","last_became_active":"2024-09-20T21:02:06.427340+0000","last_became_peered":"2024-09-20T21:02:06.427340+0000","last_unstale":"2024-09-20T21:02:13.464194+0000","last_undegraded":"2024-09-20T21:02:13.464194+0000","last_fullsized":"2024-09-20T21:02:13.464194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:07.692487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464826+0000","last_change":"2024-09-20T21:02:06.426971+0000","last_active":"2024-09-20T21:02:13.464826+0000","last_peered":"2024-09-20T21:02:13.464826+0000","last_clean":"2024-09-20T21:02:13.464826+0000","last_became_active":"2024-09-20T21:02:06.426643+0000","last_became_peered":"2024-09-20T21:02:06.426643+0000","last_unstale":"2024-09-20T21:02:13.464826+0000","last_undegraded":"2024-09-20T21:02:13.464826+0000","last_fullsized":"2024-09-20T21:02:13.464826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:12:01.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466677+0000","last_change":"2024-09-20T21:01:26.196187+0000","last_active":"2024-09-20T21:02:13.466677+0000","last_peered":"2024-09-20T21:02:13.466677+0000","last_clean":"2024-09-20T21:02:13.466677+0000","last_became_active":"2024-09-20T21:01:26.194809+0000","last_became_peered":"2024-09-20T21:01:26.194809+0000","last_unstale":"2024-09-20T21:02:13.466677+0000","last_undegraded":"2024-09-20T21:02:13.466677+0000","last_fullsized":"2024-09-20T21:02:13.466677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:32:57.333723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464031+0000","last_change":"2024-09-20T21:01:26.187140+0000","last_active":"2024-09-20T21:02:13.464031+0000","last_peered":"2024-09-20T21:02:13.464031+0000","last_clean":"2024-09-20T21:02:13.464031+0000","last_became_active":"2024-09-20T21:01:26.184626+0000","last_became_peered":"2024-09-20T21:01:26.184626+0000","last_unstale":"2024-09-20T21:02:13.464031+0000","last_undegraded":"2024-09-20T21:02:13.464031+0000","last_fullsized":"2024-09-20T21:02:13.464031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:23.486608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463453+0000","last_change":"2024-09-20T21:02:06.422301+0000","last_active":"2024-09-20T21:02:13.463453+0000","last_peered":"2024-09-20T21:02:13.463453+0000","last_clean":"2024-09-20T21:02:13.463453+0000","last_became_active":"2024-09-20T21:02:06.421576+0000","last_became_peered":"2024-09-20T21:02:06.421576+0000","last_unstale":"2024-09-20T21:02:13.463453+0000","last_undegraded":"2024-09-20T21:02:13.463453+0000","last_fullsized":"2024-09-20T21:02:13.463453+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:14.175466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464932+0000","last_change":"2024-09-20T21:01:26.187112+0000","last_active":"2024-09-20T21:02:13.464932+0000","last_peered":"2024-09-20T21:02:13.464932+0000","last_clean":"2024-09-20T21:02:13.464932+0000","last_became_active":"2024-09-20T21:01:26.185335+0000","last_became_peered":"2024-09-20T21:01:26.185335+0000","last_unstale":"2024-09-20T21:02:13.464932+0000","last_undegraded":"2024-09-20T21:02:13.464932+0000","last_fullsized":"2024-09-20T21:02:13.464932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:16.681572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463052+0000","last_change":"2024-09-20T21:01:26.195111+0000","last_active":"2024-09-20T21:02:13.463052+0000","last_peered":"2024-09-20T21:02:13.463052+0000","last_clean":"2024-09-20T21:02:13.463052+0000","last_became_active":"2024-09-20T21:01:26.194334+0000","last_became_peered":"2024-09-20T21:01:26.194334+0000","last_unstale":"2024-09-20T21:02:13.463052+0000","last_undegraded":"2024-09-20T21:02:13.463052+0000","last_fullsized":"2024-09-20T21:02:13.463052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:32.305202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465044+0000","last_change":"2024-09-20T21:01:26.187350+0000","last_active":"2024-09-20T21:02:13.465044+0000","last_peered":"2024-09-20T21:02:13.465044+0000","last_clean":"2024-09-20T21:02:13.465044+0000","last_became_active":"2024-09-20T21:01:26.185422+0000","last_became_peered":"2024-09-20T21:01:26.185422+0000","last_unstale":"2024-09-20T21:02:13.465044+0000","last_undegraded":"2024-09-20T21:02:13.465044+0000","last_fullsized":"2024-09-20T21:02:13.465044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:54:07.656861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463546+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:02:13.463546+0000","last_peered":"2024-09-20T21:02:13.463546+0000","last_clean":"2024-09-20T21:02:13.463546+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:02:13.463546+0000","last_undegraded":"2024-09-20T21:02:13.463546+0000","last_fullsized":"2024-09-20T21:02:13.463546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465448+0000","last_change":"2024-09-20T21:02:06.427547+0000","last_active":"2024-09-20T21:02:13.465448+0000","last_peered":"2024-09-20T21:02:13.465448+0000","last_clean":"2024-09-20T21:02:13.465448+0000","last_became_active":"2024-09-20T21:02:06.427270+0000","last_became_peered":"2024-09-20T21:02:06.427270+0000","last_unstale":"2024-09-20T21:02:13.465448+0000","last_undegraded":"2024-09-20T21:02:13.465448+0000","last_fullsized":"2024-09-20T21:02:13.465448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:07.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463819+0000","last_change":"2024-09-20T21:01:26.195459+0000","last_active":"2024-09-20T21:02:13.463819+0000","last_peered":"2024-09-20T21:02:13.463819+0000","last_clean":"2024-09-20T21:02:13.463819+0000","last_became_active":"2024-09-20T21:01:26.194481+0000","last_became_peered":"2024-09-20T21:01:26.194481+0000","last_unstale":"2024-09-20T21:02:13.463819+0000","last_undegraded":"2024-09-20T21:02:13.463819+0000","last_fullsized":"2024-09-20T21:02:13.463819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:26.903534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466174+0000","last_change":"2024-09-20T21:01:12.229580+0000","last_active":"2024-09-20T21:02:13.466174+0000","last_peered":"2024-09-20T21:02:13.466174+0000","last_clean":"2024-09-20T21:02:13.466174+0000","last_became_active":"2024-09-20T21:01:12.226915+0000","last_became_peered":"2024-09-20T21:01:12.226915+0000","last_unstale":"2024-09-20T21:02:13.466174+0000","last_undegraded":"2024-09-20T21:02:13.466174+0000","last_fullsized":"2024-09-20T21:02:13.466174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.985765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463623+0000","last_change":"2024-09-20T21:02:06.422473+0000","last_active":"2024-09-20T21:02:13.463623+0000","last_peered":"2024-09-20T21:02:13.463623+0000","last_clean":"2024-09-20T21:02:13.463623+0000","last_became_active":"2024-09-20T21:02:06.421735+0000","last_became_peered":"2024-09-20T21:02:06.421735+0000","last_unstale":"2024-09-20T21:02:13.463623+0000","last_undegraded":"2024-09-20T21:02:13.463623+0000","last_fullsized":"2024-09-20T21:02:13.463623+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:36.002640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468967+0000","last_change":"2024-09-20T21:02:06.428272+0000","last_active":"2024-09-20T21:02:13.468967+0000","last_peered":"2024-09-20T21:02:13.468967+0000","last_clean":"2024-09-20T21:02:13.468967+0000","last_became_active":"2024-09-20T21:02:06.427512+0000","last_became_peered":"2024-09-20T21:02:06.427512+0000","last_unstale":"2024-09-20T21:02:13.468967+0000","last_undegraded":"2024-09-20T21:02:13.468967+0000","last_fullsized":"2024-09-20T21:02:13.468967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:32.305202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467673+0000","last_change":"2024-09-20T21:02:06.424951+0000","last_active":"2024-09-20T21:02:13.467673+0000","last_peered":"2024-09-20T21:02:13.467673+0000","last_clean":"2024-09-20T21:02:13.467673+0000","last_became_active":"2024-09-20T21:02:06.424328+0000","last_became_peered":"2024-09-20T21:02:06.424328+0000","last_unstale":"2024-09-20T21:02:13.467673+0000","last_undegraded":"2024-09-20T21:02:13.467673+0000","last_fullsized":"2024-09-20T21:02:13.467673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:32:57.333723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465170+0000","last_change":"2024-09-20T21:01:26.186757+0000","last_active":"2024-09-20T21:02:13.465170+0000","last_peered":"2024-09-20T21:02:13.465170+0000","last_clean":"2024-09-20T21:02:13.465170+0000","last_became_active":"2024-09-20T21:01:26.184738+0000","last_became_peered":"2024-09-20T21:01:26.184738+0000","last_unstale":"2024-09-20T21:02:13.465170+0000","last_undegraded":"2024-09-20T21:02:13.465170+0000","last_fullsized":"2024-09-20T21:02:13.465170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:56.030003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464281+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:02:13.464281+0000","last_peered":"2024-09-20T21:02:13.464281+0000","last_clean":"2024-09-20T21:02:13.464281+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:02:13.464281+0000","last_undegraded":"2024-09-20T21:02:13.464281+0000","last_fullsized":"2024-09-20T21:02:13.464281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467021+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:02:13.467021+0000","last_peered":"2024-09-20T21:02:13.467021+0000","last_clean":"2024-09-20T21:02:13.467021+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:02:13.467021+0000","last_undegraded":"2024-09-20T21:02:13.467021+0000","last_fullsized":"2024-09-20T21:02:13.467021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464001+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:02:13.464001+0000","last_peered":"2024-09-20T21:02:13.464001+0000","last_clean":"2024-09-20T21:02:13.464001+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:02:13.464001+0000","last_undegraded":"2024-09-20T21:02:13.464001+0000","last_fullsized":"2024-09-20T21:02:13.464001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464202+0000","last_change":"2024-09-20T21:01:26.187783+0000","last_active":"2024-09-20T21:02:13.464202+0000","last_peered":"2024-09-20T21:02:13.464202+0000","last_clean":"2024-09-20T21:02:13.464202+0000","last_became_active":"2024-09-20T21:01:26.185081+0000","last_became_peered":"2024-09-20T21:01:26.185081+0000","last_unstale":"2024-09-20T21:02:13.464202+0000","last_undegraded":"2024-09-20T21:02:13.464202+0000","last_fullsized":"2024-09-20T21:02:13.464202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464391+0000","last_change":"2024-09-20T21:01:26.197852+0000","last_active":"2024-09-20T21:02:13.464391+0000","last_peered":"2024-09-20T21:02:13.464391+0000","last_clean":"2024-09-20T21:02:13.464391+0000","last_became_active":"2024-09-20T21:01:26.195824+0000","last_became_peered":"2024-09-20T21:01:26.195824+0000","last_unstale":"2024-09-20T21:02:13.464391+0000","last_undegraded":"2024-09-20T21:02:13.464391+0000","last_fullsized":"2024-09-20T21:02:13.464391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:41:54.555337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468111+0000","last_change":"2024-09-20T21:01:12.230375+0000","last_active":"2024-09-20T21:02:13.468111+0000","last_peered":"2024-09-20T21:02:13.468111+0000","last_clean":"2024-09-20T21:02:13.468111+0000","last_became_active":"2024-09-20T21:01:12.228679+0000","last_became_peered":"2024-09-20T21:01:12.228679+0000","last_unstale":"2024-09-20T21:02:13.468111+0000","last_undegraded":"2024-09-20T21:02:13.468111+0000","last_fullsized":"2024-09-20T21:02:13.468111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463156+0000","last_change":"2024-09-20T21:01:12.214484+0000","last_active":"2024-09-20T21:02:13.463156+0000","last_peered":"2024-09-20T21:02:13.463156+0000","last_clean":"2024-09-20T21:02:13.463156+0000","last_became_active":"2024-09-20T21:01:12.212293+0000","last_became_peered":"2024-09-20T21:01:12.212293+0000","last_unstale":"2024-09-20T21:02:13.463156+0000","last_undegraded":"2024-09-20T21:02:13.463156+0000","last_fullsized":"2024-09-20T21:02:13.463156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464937+0000","last_change":"2024-09-20T21:02:06.422977+0000","last_active":"2024-09-20T21:02:13.464937+0000","last_peered":"2024-09-20T21:02:13.464937+0000","last_clean":"2024-09-20T21:02:13.464937+0000","last_became_active":"2024-09-20T21:02:06.421686+0000","last_became_peered":"2024-09-20T21:02:06.421686+0000","last_unstale":"2024-09-20T21:02:13.464937+0000","last_undegraded":"2024-09-20T21:02:13.464937+0000","last_fullsized":"2024-09-20T21:02:13.464937+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:21.668945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468519+0000","last_change":"2024-09-20T21:01:12.237926+0000","last_active":"2024-09-20T21:02:13.468519+0000","last_peered":"2024-09-20T21:02:13.468519+0000","last_clean":"2024-09-20T21:02:13.468519+0000","last_became_active":"2024-09-20T21:01:12.234061+0000","last_became_peered":"2024-09-20T21:01:12.234061+0000","last_unstale":"2024-09-20T21:02:13.468519+0000","last_undegraded":"2024-09-20T21:02:13.468519+0000","last_fullsized":"2024-09-20T21:02:13.468519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465529+0000","last_change":"2024-09-20T21:01:12.214728+0000","last_active":"2024-09-20T21:02:13.465529+0000","last_peered":"2024-09-20T21:02:13.465529+0000","last_clean":"2024-09-20T21:02:13.465529+0000","last_became_active":"2024-09-20T21:01:12.213159+0000","last_became_peered":"2024-09-20T21:01:12.213159+0000","last_unstale":"2024-09-20T21:02:13.465529+0000","last_undegraded":"2024-09-20T21:02:13.465529+0000","last_fullsized":"2024-09-20T21:02:13.465529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.469516+0000","last_change":"2024-09-20T21:02:06.430293+0000","last_active":"2024-09-20T21:02:13.469516+0000","last_peered":"2024-09-20T21:02:13.469516+0000","last_clean":"2024-09-20T21:02:13.469516+0000","last_became_active":"2024-09-20T21:02:06.427788+0000","last_became_peered":"2024-09-20T21:02:06.427788+0000","last_unstale":"2024-09-20T21:02:13.469516+0000","last_undegraded":"2024-09-20T21:02:13.469516+0000","last_fullsized":"2024-09-20T21:02:13.469516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:36.362384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466275+0000","last_change":"2024-09-20T21:01:12.227425+0000","last_active":"2024-09-20T21:02:13.466275+0000","last_peered":"2024-09-20T21:02:13.466275+0000","last_clean":"2024-09-20T21:02:13.466275+0000","last_became_active":"2024-09-20T21:01:12.226625+0000","last_became_peered":"2024-09-20T21:01:12.226625+0000","last_unstale":"2024-09-20T21:02:13.466275+0000","last_undegraded":"2024-09-20T21:02:13.466275+0000","last_fullsized":"2024-09-20T21:02:13.466275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464312+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:02:13.464312+0000","last_peered":"2024-09-20T21:02:13.464312+0000","last_clean":"2024-09-20T21:02:13.464312+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:02:13.464312+0000","last_undegraded":"2024-09-20T21:02:13.464312+0000","last_fullsized":"2024-09-20T21:02:13.464312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468206+0000","last_change":"2024-09-20T21:01:12.230684+0000","last_active":"2024-09-20T21:02:13.468206+0000","last_peered":"2024-09-20T21:02:13.468206+0000","last_clean":"2024-09-20T21:02:13.468206+0000","last_became_active":"2024-09-20T21:01:12.229915+0000","last_became_peered":"2024-09-20T21:01:12.229915+0000","last_unstale":"2024-09-20T21:02:13.468206+0000","last_undegraded":"2024-09-20T21:02:13.468206+0000","last_fullsized":"2024-09-20T21:02:13.468206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463235+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:02:13.463235+0000","last_peered":"2024-09-20T21:02:13.463235+0000","last_clean":"2024-09-20T21:02:13.463235+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:02:13.463235+0000","last_undegraded":"2024-09-20T21:02:13.463235+0000","last_fullsized":"2024-09-20T21:02:13.463235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465185+0000","last_change":"2024-09-20T21:01:26.187763+0000","last_active":"2024-09-20T21:02:13.465185+0000","last_peered":"2024-09-20T21:02:13.465185+0000","last_clean":"2024-09-20T21:02:13.465185+0000","last_became_active":"2024-09-20T21:01:26.185774+0000","last_became_peered":"2024-09-20T21:01:26.185774+0000","last_unstale":"2024-09-20T21:02:13.465185+0000","last_undegraded":"2024-09-20T21:02:13.465185+0000","last_fullsized":"2024-09-20T21:02:13.465185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:07.330848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463824+0000","last_change":"2024-09-20T21:02:06.424569+0000","last_active":"2024-09-20T21:02:13.463824+0000","last_peered":"2024-09-20T21:02:13.463824+0000","last_clean":"2024-09-20T21:02:13.463824+0000","last_became_active":"2024-09-20T21:02:06.423852+0000","last_became_peered":"2024-09-20T21:02:06.423852+0000","last_unstale":"2024-09-20T21:02:13.463824+0000","last_undegraded":"2024-09-20T21:02:13.463824+0000","last_fullsized":"2024-09-20T21:02:13.463824+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:49.304016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463714+0000","last_change":"2024-09-20T21:01:26.197377+0000","last_active":"2024-09-20T21:02:13.463714+0000","last_peered":"2024-09-20T21:02:13.463714+0000","last_clean":"2024-09-20T21:02:13.463714+0000","last_became_active":"2024-09-20T21:01:26.194232+0000","last_became_peered":"2024-09-20T21:01:26.194232+0000","last_unstale":"2024-09-20T21:02:13.463714+0000","last_undegraded":"2024-09-20T21:02:13.463714+0000","last_fullsized":"2024-09-20T21:02:13.463714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:16.800376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464218+0000","last_change":"2024-09-20T21:02:06.429730+0000","last_active":"2024-09-20T21:02:13.464218+0000","last_peered":"2024-09-20T21:02:13.464218+0000","last_clean":"2024-09-20T21:02:13.464218+0000","last_became_active":"2024-09-20T21:02:06.428246+0000","last_became_peered":"2024-09-20T21:02:06.428246+0000","last_unstale":"2024-09-20T21:02:13.464218+0000","last_undegraded":"2024-09-20T21:02:13.464218+0000","last_fullsized":"2024-09-20T21:02:13.464218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:03.230251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465184+0000","last_change":"2024-09-20T21:01:11.220335+0000","last_active":"2024-09-20T21:02:13.465184+0000","last_peered":"2024-09-20T21:02:13.465184+0000","last_clean":"2024-09-20T21:02:13.465184+0000","last_became_active":"2024-09-20T21:01:11.219506+0000","last_became_peered":"2024-09-20T21:01:11.219506+0000","last_unstale":"2024-09-20T21:02:13.465184+0000","last_undegraded":"2024-09-20T21:02:13.465184+0000","last_fullsized":"2024-09-20T21:02:13.465184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:16:05.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465611+0000","last_change":"2024-09-20T21:01:12.214329+0000","last_active":"2024-09-20T21:02:13.465611+0000","last_peered":"2024-09-20T21:02:13.465611+0000","last_clean":"2024-09-20T21:02:13.465611+0000","last_became_active":"2024-09-20T21:01:12.212104+0000","last_became_peered":"2024-09-20T21:01:12.212104+0000","last_unstale":"2024-09-20T21:02:13.465611+0000","last_undegraded":"2024-09-20T21:02:13.465611+0000","last_fullsized":"2024-09-20T21:02:13.465611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468116+0000","last_change":"2024-09-20T21:01:11.213590+0000","last_active":"2024-09-20T21:02:13.468116+0000","last_peered":"2024-09-20T21:02:13.468116+0000","last_clean":"2024-09-20T21:02:13.468116+0000","last_became_active":"2024-09-20T21:01:11.212919+0000","last_became_peered":"2024-09-20T21:01:11.212919+0000","last_unstale":"2024-09-20T21:02:13.468116+0000","last_undegraded":"2024-09-20T21:02:13.468116+0000","last_fullsized":"2024-09-20T21:02:13.468116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.040754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463635+0000","last_change":"2024-09-20T21:01:12.214556+0000","last_active":"2024-09-20T21:02:13.463635+0000","last_peered":"2024-09-20T21:02:13.463635+0000","last_clean":"2024-09-20T21:02:13.463635+0000","last_became_active":"2024-09-20T21:01:12.212508+0000","last_became_peered":"2024-09-20T21:01:12.212508+0000","last_unstale":"2024-09-20T21:02:13.463635+0000","last_undegraded":"2024-09-20T21:02:13.463635+0000","last_fullsized":"2024-09-20T21:02:13.463635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466730+0000","last_change":"2024-09-20T21:02:06.428802+0000","last_active":"2024-09-20T21:02:13.466730+0000","last_peered":"2024-09-20T21:02:13.466730+0000","last_clean":"2024-09-20T21:02:13.466730+0000","last_became_active":"2024-09-20T21:02:06.427772+0000","last_became_peered":"2024-09-20T21:02:06.427772+0000","last_unstale":"2024-09-20T21:02:13.466730+0000","last_undegraded":"2024-09-20T21:02:13.466730+0000","last_fullsized":"2024-09-20T21:02:13.466730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:39.527762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"42'6796","reported_seq":6851,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.952812+0000","last_change":"2024-09-20T21:02:06.433294+0000","last_active":"2024-09-20T21:02:14.952812+0000","last_peered":"2024-09-20T21:02:14.952812+0000","last_clean":"2024-09-20T21:02:14.952812+0000","last_became_active":"2024-09-20T21:02:06.423829+0000","last_became_peered":"2024-09-20T21:02:06.423829+0000","last_unstale":"2024-09-20T21:02:14.952812+0000","last_undegraded":"2024-09-20T21:02:14.952812+0000","last_fullsized":"2024-09-20T21:02:14.952812+0000","mapping_epoch":38,"log_start":"29'3087","ondisk_log_start":"29'3087","created":21,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3709,"log_dups_size":0,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:53.347202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445382656,"num_objects":6796,"num_object_clones":0,"num_object_copies":13592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6796,"num_write_kb":434944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468319+0000","last_change":"2024-09-20T21:01:26.189708+0000","last_active":"2024-09-20T21:02:13.468319+0000","last_peered":"2024-09-20T21:02:13.468319+0000","last_clean":"2024-09-20T21:02:13.468319+0000","last_became_active":"2024-09-20T21:01:26.187755+0000","last_became_peered":"2024-09-20T21:01:26.187755+0000","last_unstale":"2024-09-20T21:02:13.468319+0000","last_undegraded":"2024-09-20T21:02:13.468319+0000","last_fullsized":"2024-09-20T21:02:13.468319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:22.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468522+0000","last_change":"2024-09-20T21:01:12.229503+0000","last_active":"2024-09-20T21:02:13.468522+0000","last_peered":"2024-09-20T21:02:13.468522+0000","last_clean":"2024-09-20T21:02:13.468522+0000","last_became_active":"2024-09-20T21:01:12.228540+0000","last_became_peered":"2024-09-20T21:01:12.228540+0000","last_unstale":"2024-09-20T21:02:13.468522+0000","last_undegraded":"2024-09-20T21:02:13.468522+0000","last_fullsized":"2024-09-20T21:02:13.468522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:13.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"42'6867","reported_seq":6920,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.977516+0000","last_change":"2024-09-20T21:02:06.441673+0000","last_active":"2024-09-20T21:02:14.977516+0000","last_peered":"2024-09-20T21:02:14.977516+0000","last_clean":"2024-09-20T21:02:14.977516+0000","last_became_active":"2024-09-20T21:02:06.427751+0000","last_became_peered":"2024-09-20T21:02:06.427751+0000","last_unstale":"2024-09-20T21:02:14.977516+0000","last_undegraded":"2024-09-20T21:02:14.977516+0000","last_fullsized":"2024-09-20T21:02:14.977516+0000","mapping_epoch":38,"log_start":"29'3240","ondisk_log_start":"29'3240","created":21,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3627,"log_dups_size":0,"ondisk_log_size":3627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:36.928079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450035712,"num_objects":6867,"num_object_clones":0,"num_object_copies":13734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6867,"num_write_kb":439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467156+0000","last_change":"2024-09-20T21:01:11.214247+0000","last_active":"2024-09-20T21:02:13.467156+0000","last_peered":"2024-09-20T21:02:13.467156+0000","last_clean":"2024-09-20T21:02:13.467156+0000","last_became_active":"2024-09-20T21:01:11.212760+0000","last_became_peered":"2024-09-20T21:01:11.212760+0000","last_unstale":"2024-09-20T21:02:13.467156+0000","last_undegraded":"2024-09-20T21:02:13.467156+0000","last_fullsized":"2024-09-20T21:02:13.467156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:20.108703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463385+0000","last_change":"2024-09-20T21:02:06.424582+0000","last_active":"2024-09-20T21:02:13.463385+0000","last_peered":"2024-09-20T21:02:13.463385+0000","last_clean":"2024-09-20T21:02:13.463385+0000","last_became_active":"2024-09-20T21:02:06.421448+0000","last_became_peered":"2024-09-20T21:02:06.421448+0000","last_unstale":"2024-09-20T21:02:13.463385+0000","last_undegraded":"2024-09-20T21:02:13.463385+0000","last_fullsized":"2024-09-20T21:02:13.463385+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:42.804478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"42'6933","reported_seq":6983,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.983550+0000","last_change":"2024-09-20T21:01:26.189622+0000","last_active":"2024-09-20T21:02:14.983550+0000","last_peered":"2024-09-20T21:02:14.983550+0000","last_clean":"2024-09-20T21:02:14.983550+0000","last_became_active":"2024-09-20T21:01:26.186385+0000","last_became_peered":"2024-09-20T21:01:26.186385+0000","last_unstale":"2024-09-20T21:02:14.983550+0000","last_undegraded":"2024-09-20T21:02:14.983550+0000","last_fullsized":"2024-09-20T21:02:14.983550+0000","mapping_epoch":21,"log_start":"29'2900","ondisk_log_start":"29'2900","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4033,"log_dups_size":0,"ondisk_log_size":4033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:50.339650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":454361088,"num_objects":6933,"num_object_clones":0,"num_object_copies":13866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6933,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6933,"num_write_kb":443712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.469681+0000","last_change":"2024-09-20T21:02:06.431245+0000","last_active":"2024-09-20T21:02:13.469681+0000","last_peered":"2024-09-20T21:02:13.469681+0000","last_clean":"2024-09-20T21:02:13.469681+0000","last_became_active":"2024-09-20T21:02:06.429827+0000","last_became_peered":"2024-09-20T21:02:06.429827+0000","last_unstale":"2024-09-20T21:02:13.469681+0000","last_undegraded":"2024-09-20T21:02:13.469681+0000","last_fullsized":"2024-09-20T21:02:13.469681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:56:05.390834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465200+0000","last_change":"2024-09-20T21:01:26.187349+0000","last_active":"2024-09-20T21:02:13.465200+0000","last_peered":"2024-09-20T21:02:13.465200+0000","last_clean":"2024-09-20T21:02:13.465200+0000","last_became_active":"2024-09-20T21:01:26.185876+0000","last_became_peered":"2024-09-20T21:01:26.185876+0000","last_unstale":"2024-09-20T21:02:13.465200+0000","last_undegraded":"2024-09-20T21:02:13.465200+0000","last_fullsized":"2024-09-20T21:02:13.465200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:48.846118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"42'6840","reported_seq":6890,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.960224+0000","last_change":"2024-09-20T21:01:26.189804+0000","last_active":"2024-09-20T21:02:14.960224+0000","last_peered":"2024-09-20T21:02:14.960224+0000","last_clean":"2024-09-20T21:02:14.960224+0000","last_became_active":"2024-09-20T21:01:26.187924+0000","last_became_peered":"2024-09-20T21:01:26.187924+0000","last_unstale":"2024-09-20T21:02:14.960224+0000","last_undegraded":"2024-09-20T21:02:14.960224+0000","last_fullsized":"2024-09-20T21:02:14.960224+0000","mapping_epoch":21,"log_start":"30'3300","ondisk_log_start":"30'3300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:35:44.867498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448266240,"num_objects":6840,"num_object_clones":0,"num_object_copies":13680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6840,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6840,"num_write_kb":437760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464377+0000","last_change":"2024-09-20T21:01:26.189711+0000","last_active":"2024-09-20T21:02:13.464377+0000","last_peered":"2024-09-20T21:02:13.464377+0000","last_clean":"2024-09-20T21:02:13.464377+0000","last_became_active":"2024-09-20T21:01:26.187708+0000","last_became_peered":"2024-09-20T21:01:26.187708+0000","last_unstale":"2024-09-20T21:02:13.464377+0000","last_undegraded":"2024-09-20T21:02:13.464377+0000","last_fullsized":"2024-09-20T21:02:13.464377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:31:35.980589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463838+0000","last_change":"2024-09-20T21:01:12.220592+0000","last_active":"2024-09-20T21:02:13.463838+0000","last_peered":"2024-09-20T21:02:13.463838+0000","last_clean":"2024-09-20T21:02:13.463838+0000","last_became_active":"2024-09-20T21:01:12.219682+0000","last_became_peered":"2024-09-20T21:01:12.219682+0000","last_unstale":"2024-09-20T21:02:13.463838+0000","last_undegraded":"2024-09-20T21:02:13.463838+0000","last_fullsized":"2024-09-20T21:02:13.463838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"42'6802","reported_seq":6852,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.983540+0000","last_change":"2024-09-20T21:01:26.196437+0000","last_active":"2024-09-20T21:02:14.983540+0000","last_peered":"2024-09-20T21:02:14.983540+0000","last_clean":"2024-09-20T21:02:14.983540+0000","last_became_active":"2024-09-20T21:01:26.195712+0000","last_became_peered":"2024-09-20T21:01:26.195712+0000","last_unstale":"2024-09-20T21:02:14.983540+0000","last_undegraded":"2024-09-20T21:02:14.983540+0000","last_fullsized":"2024-09-20T21:02:14.983540+0000","mapping_epoch":21,"log_start":"29'2800","ondisk_log_start":"29'2800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:56:20.379997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445775872,"num_objects":6802,"num_object_clones":0,"num_object_copies":13604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6802,"num_write_kb":435328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464472+0000","last_change":"2024-09-20T21:01:11.220548+0000","last_active":"2024-09-20T21:02:13.464472+0000","last_peered":"2024-09-20T21:02:13.464472+0000","last_clean":"2024-09-20T21:02:13.464472+0000","last_became_active":"2024-09-20T21:01:11.219847+0000","last_became_peered":"2024-09-20T21:01:11.219847+0000","last_unstale":"2024-09-20T21:02:13.464472+0000","last_undegraded":"2024-09-20T21:02:13.464472+0000","last_fullsized":"2024-09-20T21:02:13.464472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464298+0000","last_change":"2024-09-20T21:01:26.189300+0000","last_active":"2024-09-20T21:02:13.464298+0000","last_peered":"2024-09-20T21:02:13.464298+0000","last_clean":"2024-09-20T21:02:13.464298+0000","last_became_active":"2024-09-20T21:01:26.186381+0000","last_became_peered":"2024-09-20T21:01:26.186381+0000","last_unstale":"2024-09-20T21:02:13.464298+0000","last_undegraded":"2024-09-20T21:02:13.464298+0000","last_fullsized":"2024-09-20T21:02:13.464298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:15.197998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"42'6748","reported_seq":6796,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.985199+0000","last_change":"2024-09-20T21:01:26.185429+0000","last_active":"2024-09-20T21:02:14.985199+0000","last_peered":"2024-09-20T21:02:14.985199+0000","last_clean":"2024-09-20T21:02:14.985199+0000","last_became_active":"2024-09-20T21:01:26.184548+0000","last_became_peered":"2024-09-20T21:01:26.184548+0000","last_unstale":"2024-09-20T21:02:14.985199+0000","last_undegraded":"2024-09-20T21:02:14.985199+0000","last_fullsized":"2024-09-20T21:02:14.985199+0000","mapping_epoch":21,"log_start":"29'3200","ondisk_log_start":"29'3200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3548,"log_dups_size":0,"ondisk_log_size":3548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:23.837807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442236928,"num_objects":6748,"num_object_clones":0,"num_object_copies":13496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6748,"num_write_kb":431872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465020+0000","last_change":"2024-09-20T21:01:26.187643+0000","last_active":"2024-09-20T21:02:13.465020+0000","last_peered":"2024-09-20T21:02:13.465020+0000","last_clean":"2024-09-20T21:02:13.465020+0000","last_became_active":"2024-09-20T21:01:26.186342+0000","last_became_peered":"2024-09-20T21:01:26.186342+0000","last_unstale":"2024-09-20T21:02:13.465020+0000","last_undegraded":"2024-09-20T21:02:13.465020+0000","last_fullsized":"2024-09-20T21:02:13.465020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:40.496914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.469561+0000","last_change":"2024-09-20T21:02:06.430762+0000","last_active":"2024-09-20T21:02:13.469561+0000","last_peered":"2024-09-20T21:02:13.469561+0000","last_clean":"2024-09-20T21:02:13.469561+0000","last_became_active":"2024-09-20T21:02:06.428935+0000","last_became_peered":"2024-09-20T21:02:06.428935+0000","last_unstale":"2024-09-20T21:02:13.469561+0000","last_undegraded":"2024-09-20T21:02:13.469561+0000","last_fullsized":"2024-09-20T21:02:13.469561+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:17.812272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"42'6782","reported_seq":6832,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.926580+0000","last_change":"2024-09-20T21:01:26.191101+0000","last_active":"2024-09-20T21:02:14.926580+0000","last_peered":"2024-09-20T21:02:14.926580+0000","last_clean":"2024-09-20T21:02:14.926580+0000","last_became_active":"2024-09-20T21:01:26.190000+0000","last_became_peered":"2024-09-20T21:01:26.190000+0000","last_unstale":"2024-09-20T21:02:14.926580+0000","last_undegraded":"2024-09-20T21:02:14.926580+0000","last_fullsized":"2024-09-20T21:02:14.926580+0000","mapping_epoch":21,"log_start":"28'2800","ondisk_log_start":"28'2800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3982,"log_dups_size":0,"ondisk_log_size":3982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:53.347202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444465152,"num_objects":6782,"num_object_clones":0,"num_object_copies":13564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6782,"num_write_kb":434048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468214+0000","last_change":"2024-09-20T21:01:11.213371+0000","last_active":"2024-09-20T21:02:13.468214+0000","last_peered":"2024-09-20T21:02:13.468214+0000","last_clean":"2024-09-20T21:02:13.468214+0000","last_became_active":"2024-09-20T21:01:11.212385+0000","last_became_peered":"2024-09-20T21:01:11.212385+0000","last_unstale":"2024-09-20T21:02:13.468214+0000","last_undegraded":"2024-09-20T21:02:13.468214+0000","last_fullsized":"2024-09-20T21:02:13.468214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:56.734999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466661+0000","last_change":"2024-09-20T21:01:26.190179+0000","last_active":"2024-09-20T21:02:13.466661+0000","last_peered":"2024-09-20T21:02:13.466661+0000","last_clean":"2024-09-20T21:02:13.466661+0000","last_became_active":"2024-09-20T21:01:26.187701+0000","last_became_peered":"2024-09-20T21:01:26.187701+0000","last_unstale":"2024-09-20T21:02:13.466661+0000","last_undegraded":"2024-09-20T21:02:13.466661+0000","last_fullsized":"2024-09-20T21:02:13.466661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:48.846118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"42'6823","reported_seq":6873,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.992113+0000","last_change":"2024-09-20T21:01:26.192961+0000","last_active":"2024-09-20T21:02:14.992113+0000","last_peered":"2024-09-20T21:02:14.992113+0000","last_clean":"2024-09-20T21:02:14.992113+0000","last_became_active":"2024-09-20T21:01:26.192159+0000","last_became_peered":"2024-09-20T21:01:26.192159+0000","last_unstale":"2024-09-20T21:02:14.992113+0000","last_undegraded":"2024-09-20T21:02:14.992113+0000","last_fullsized":"2024-09-20T21:02:14.992113+0000","mapping_epoch":21,"log_start":"28'2800","ondisk_log_start":"28'2800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4023,"log_dups_size":0,"ondisk_log_size":4023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:50.672763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447152128,"num_objects":6823,"num_object_clones":0,"num_object_copies":13646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6823,"num_write_kb":436672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465240+0000","last_change":"2024-09-20T21:02:06.423082+0000","last_active":"2024-09-20T21:02:13.465240+0000","last_peered":"2024-09-20T21:02:13.465240+0000","last_clean":"2024-09-20T21:02:13.465240+0000","last_became_active":"2024-09-20T21:02:06.422272+0000","last_became_peered":"2024-09-20T21:02:06.422272+0000","last_unstale":"2024-09-20T21:02:13.465240+0000","last_undegraded":"2024-09-20T21:02:13.465240+0000","last_fullsized":"2024-09-20T21:02:13.465240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:30.668000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463726+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:02:13.463726+0000","last_peered":"2024-09-20T21:02:13.463726+0000","last_clean":"2024-09-20T21:02:13.463726+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:02:13.463726+0000","last_undegraded":"2024-09-20T21:02:13.463726+0000","last_fullsized":"2024-09-20T21:02:13.463726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"42'6869","reported_seq":6924,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.951798+0000","last_change":"2024-09-20T21:02:06.435625+0000","last_active":"2024-09-20T21:02:14.951798+0000","last_peered":"2024-09-20T21:02:14.951798+0000","last_clean":"2024-09-20T21:02:14.951798+0000","last_became_active":"2024-09-20T21:02:06.427061+0000","last_became_peered":"2024-09-20T21:02:06.427061+0000","last_unstale":"2024-09-20T21:02:14.951798+0000","last_undegraded":"2024-09-20T21:02:14.951798+0000","last_fullsized":"2024-09-20T21:02:14.951798+0000","mapping_epoch":38,"log_start":"30'3300","ondisk_log_start":"30'3300","created":21,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3569,"log_dups_size":0,"ondisk_log_size":3569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:30.601057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450166784,"num_objects":6869,"num_object_clones":0,"num_object_copies":13738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6869,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6869,"num_write_kb":439616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":241,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466851+0000","last_change":"2024-09-20T21:02:06.428928+0000","last_active":"2024-09-20T21:02:13.466851+0000","last_peered":"2024-09-20T21:02:13.466851+0000","last_clean":"2024-09-20T21:02:13.466851+0000","last_became_active":"2024-09-20T21:02:06.427974+0000","last_became_peered":"2024-09-20T21:02:06.427974+0000","last_unstale":"2024-09-20T21:02:13.466851+0000","last_undegraded":"2024-09-20T21:02:13.466851+0000","last_fullsized":"2024-09-20T21:02:13.466851+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:16.676481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464631+0000","last_change":"2024-09-20T21:01:26.198209+0000","last_active":"2024-09-20T21:02:13.464631+0000","last_peered":"2024-09-20T21:02:13.464631+0000","last_clean":"2024-09-20T21:02:13.464631+0000","last_became_active":"2024-09-20T21:01:26.197583+0000","last_became_peered":"2024-09-20T21:01:26.197583+0000","last_unstale":"2024-09-20T21:02:13.464631+0000","last_undegraded":"2024-09-20T21:02:13.464631+0000","last_fullsized":"2024-09-20T21:02:13.464631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:56:01.208657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465277+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:02:13.465277+0000","last_peered":"2024-09-20T21:02:13.465277+0000","last_clean":"2024-09-20T21:02:13.465277+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:02:13.465277+0000","last_undegraded":"2024-09-20T21:02:13.465277+0000","last_fullsized":"2024-09-20T21:02:13.465277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.469669+0000","last_change":"2024-09-20T21:02:06.430898+0000","last_active":"2024-09-20T21:02:13.469669+0000","last_peered":"2024-09-20T21:02:13.469669+0000","last_clean":"2024-09-20T21:02:13.469669+0000","last_became_active":"2024-09-20T21:02:06.429589+0000","last_became_peered":"2024-09-20T21:02:06.429589+0000","last_unstale":"2024-09-20T21:02:13.469669+0000","last_undegraded":"2024-09-20T21:02:13.469669+0000","last_fullsized":"2024-09-20T21:02:13.469669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:41:54.555337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"42'6806","reported_seq":6856,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.968442+0000","last_change":"2024-09-20T21:01:26.185969+0000","last_active":"2024-09-20T21:02:14.968442+0000","last_peered":"2024-09-20T21:02:14.968442+0000","last_clean":"2024-09-20T21:02:14.968442+0000","last_became_active":"2024-09-20T21:01:26.185337+0000","last_became_peered":"2024-09-20T21:01:26.185337+0000","last_unstale":"2024-09-20T21:02:14.968442+0000","last_undegraded":"2024-09-20T21:02:14.968442+0000","last_fullsized":"2024-09-20T21:02:14.968442+0000","mapping_epoch":21,"log_start":"29'3200","ondisk_log_start":"29'3200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.883963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446038016,"num_objects":6806,"num_object_clones":0,"num_object_copies":13612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6806,"num_write_kb":435584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466827+0000","last_change":"2024-09-20T21:02:06.425059+0000","last_active":"2024-09-20T21:02:13.466827+0000","last_peered":"2024-09-20T21:02:13.466827+0000","last_clean":"2024-09-20T21:02:13.466827+0000","last_became_active":"2024-09-20T21:02:06.424456+0000","last_became_peered":"2024-09-20T21:02:06.424456+0000","last_unstale":"2024-09-20T21:02:13.466827+0000","last_undegraded":"2024-09-20T21:02:13.466827+0000","last_fullsized":"2024-09-20T21:02:13.466827+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:07.427703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463539+0000","last_change":"2024-09-20T21:01:11.220462+0000","last_active":"2024-09-20T21:02:13.463539+0000","last_peered":"2024-09-20T21:02:13.463539+0000","last_clean":"2024-09-20T21:02:13.463539+0000","last_became_active":"2024-09-20T21:01:11.219778+0000","last_became_peered":"2024-09-20T21:01:11.219778+0000","last_unstale":"2024-09-20T21:02:13.463539+0000","last_undegraded":"2024-09-20T21:02:13.463539+0000","last_fullsized":"2024-09-20T21:02:13.463539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:08.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467102+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:02:13.467102+0000","last_peered":"2024-09-20T21:02:13.467102+0000","last_clean":"2024-09-20T21:02:13.467102+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:02:13.467102+0000","last_undegraded":"2024-09-20T21:02:13.467102+0000","last_fullsized":"2024-09-20T21:02:13.467102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"42'6776","reported_seq":6826,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.976282+0000","last_change":"2024-09-20T21:01:26.193658+0000","last_active":"2024-09-20T21:02:14.976282+0000","last_peered":"2024-09-20T21:02:14.976282+0000","last_clean":"2024-09-20T21:02:14.976282+0000","last_became_active":"2024-09-20T21:01:26.193005+0000","last_became_peered":"2024-09-20T21:01:26.193005+0000","last_unstale":"2024-09-20T21:02:14.976282+0000","last_undegraded":"2024-09-20T21:02:14.976282+0000","last_fullsized":"2024-09-20T21:02:14.976282+0000","mapping_epoch":21,"log_start":"29'3200","ondisk_log_start":"29'3200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3576,"log_dups_size":0,"ondisk_log_size":3576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:46.866571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444071936,"num_objects":6776,"num_object_clones":0,"num_object_copies":13552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6776,"num_write_kb":433664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463729+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:02:13.463729+0000","last_peered":"2024-09-20T21:02:13.463729+0000","last_clean":"2024-09-20T21:02:13.463729+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:02:13.463729+0000","last_undegraded":"2024-09-20T21:02:13.463729+0000","last_fullsized":"2024-09-20T21:02:13.463729+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468611+0000","last_change":"2024-09-20T21:01:11.217295+0000","last_active":"2024-09-20T21:02:13.468611+0000","last_peered":"2024-09-20T21:02:13.468611+0000","last_clean":"2024-09-20T21:02:13.468611+0000","last_became_active":"2024-09-20T21:01:11.216350+0000","last_became_peered":"2024-09-20T21:01:11.216350+0000","last_unstale":"2024-09-20T21:02:13.468611+0000","last_undegraded":"2024-09-20T21:02:13.468611+0000","last_fullsized":"2024-09-20T21:02:13.468611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:59.661622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463899+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:02:13.463899+0000","last_peered":"2024-09-20T21:02:13.463899+0000","last_clean":"2024-09-20T21:02:13.463899+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:02:13.463899+0000","last_undegraded":"2024-09-20T21:02:13.463899+0000","last_fullsized":"2024-09-20T21:02:13.463899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"42'6831","reported_seq":6881,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.968507+0000","last_change":"2024-09-20T21:01:26.195204+0000","last_active":"2024-09-20T21:02:14.968507+0000","last_peered":"2024-09-20T21:02:14.968507+0000","last_clean":"2024-09-20T21:02:14.968507+0000","last_became_active":"2024-09-20T21:01:26.193385+0000","last_became_peered":"2024-09-20T21:01:26.193385+0000","last_unstale":"2024-09-20T21:02:14.968507+0000","last_undegraded":"2024-09-20T21:02:14.968507+0000","last_fullsized":"2024-09-20T21:02:14.968507+0000","mapping_epoch":21,"log_start":"30'3300","ondisk_log_start":"30'3300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3531,"log_dups_size":0,"ondisk_log_size":3531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:50.379400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447676416,"num_objects":6831,"num_object_clones":0,"num_object_copies":13662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6831,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6831,"num_write_kb":437184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465293+0000","last_change":"2024-09-20T21:01:26.193870+0000","last_active":"2024-09-20T21:02:13.465293+0000","last_peered":"2024-09-20T21:02:13.465293+0000","last_clean":"2024-09-20T21:02:13.465293+0000","last_became_active":"2024-09-20T21:01:26.193552+0000","last_became_peered":"2024-09-20T21:01:26.193552+0000","last_unstale":"2024-09-20T21:02:13.465293+0000","last_undegraded":"2024-09-20T21:02:13.465293+0000","last_fullsized":"2024-09-20T21:02:13.465293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:32:52.139650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464228+0000","last_change":"2024-09-20T21:01:26.198203+0000","last_active":"2024-09-20T21:02:13.464228+0000","last_peered":"2024-09-20T21:02:13.464228+0000","last_clean":"2024-09-20T21:02:13.464228+0000","last_became_active":"2024-09-20T21:01:26.196361+0000","last_became_peered":"2024-09-20T21:01:26.196361+0000","last_unstale":"2024-09-20T21:02:13.464228+0000","last_undegraded":"2024-09-20T21:02:13.464228+0000","last_fullsized":"2024-09-20T21:02:13.464228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:35.683600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464470+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:02:13.464470+0000","last_peered":"2024-09-20T21:02:13.464470+0000","last_clean":"2024-09-20T21:02:13.464470+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:02:13.464470+0000","last_undegraded":"2024-09-20T21:02:13.464470+0000","last_fullsized":"2024-09-20T21:02:13.464470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"42'6794","reported_seq":6844,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.969141+0000","last_change":"2024-09-20T21:01:26.187690+0000","last_active":"2024-09-20T21:02:14.969141+0000","last_peered":"2024-09-20T21:02:14.969141+0000","last_clean":"2024-09-20T21:02:14.969141+0000","last_became_active":"2024-09-20T21:01:26.184491+0000","last_became_peered":"2024-09-20T21:01:26.184491+0000","last_unstale":"2024-09-20T21:02:14.969141+0000","last_undegraded":"2024-09-20T21:02:14.969141+0000","last_fullsized":"2024-09-20T21:02:14.969141+0000","mapping_epoch":21,"log_start":"29'3200","ondisk_log_start":"29'3200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3594,"log_dups_size":0,"ondisk_log_size":3594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:53:38.207514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445251584,"num_objects":6794,"num_object_clones":0,"num_object_copies":13588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6794,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6794,"num_write_kb":434816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463911+0000","last_change":"2024-09-20T21:01:26.195383+0000","last_active":"2024-09-20T21:02:13.463911+0000","last_peered":"2024-09-20T21:02:13.463911+0000","last_clean":"2024-09-20T21:02:13.463911+0000","last_became_active":"2024-09-20T21:01:26.193485+0000","last_became_peered":"2024-09-20T21:01:26.193485+0000","last_unstale":"2024-09-20T21:02:13.463911+0000","last_undegraded":"2024-09-20T21:02:13.463911+0000","last_fullsized":"2024-09-20T21:02:13.463911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:39.527762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464549+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:02:13.464549+0000","last_peered":"2024-09-20T21:02:13.464549+0000","last_clean":"2024-09-20T21:02:13.464549+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:02:13.464549+0000","last_undegraded":"2024-09-20T21:02:13.464549+0000","last_fullsized":"2024-09-20T21:02:13.464549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468112+0000","last_change":"2024-09-20T21:01:12.227746+0000","last_active":"2024-09-20T21:02:13.468112+0000","last_peered":"2024-09-20T21:02:13.468112+0000","last_clean":"2024-09-20T21:02:13.468112+0000","last_became_active":"2024-09-20T21:01:12.226860+0000","last_became_peered":"2024-09-20T21:01:12.226860+0000","last_unstale":"2024-09-20T21:02:13.468112+0000","last_undegraded":"2024-09-20T21:02:13.468112+0000","last_fullsized":"2024-09-20T21:02:13.468112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:02.144980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"42'6851","reported_seq":6901,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.971601+0000","last_change":"2024-09-20T21:01:26.185208+0000","last_active":"2024-09-20T21:02:14.971601+0000","last_peered":"2024-09-20T21:02:14.971601+0000","last_clean":"2024-09-20T21:02:14.971601+0000","last_became_active":"2024-09-20T21:01:26.184547+0000","last_became_peered":"2024-09-20T21:01:26.184547+0000","last_unstale":"2024-09-20T21:02:14.971601+0000","last_undegraded":"2024-09-20T21:02:14.971601+0000","last_fullsized":"2024-09-20T21:02:14.971601+0000","mapping_epoch":21,"log_start":"30'3300","ondisk_log_start":"30'3300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:11.520890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448987136,"num_objects":6851,"num_object_clones":0,"num_object_copies":13702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6851,"num_write_kb":438464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464551+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:02:13.464551+0000","last_peered":"2024-09-20T21:02:13.464551+0000","last_clean":"2024-09-20T21:02:13.464551+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:02:13.464551+0000","last_undegraded":"2024-09-20T21:02:13.464551+0000","last_fullsized":"2024-09-20T21:02:13.464551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464103+0000","last_change":"2024-09-20T21:02:06.430321+0000","last_active":"2024-09-20T21:02:13.464103+0000","last_peered":"2024-09-20T21:02:13.464103+0000","last_clean":"2024-09-20T21:02:13.464103+0000","last_became_active":"2024-09-20T21:02:06.429077+0000","last_became_peered":"2024-09-20T21:02:06.429077+0000","last_unstale":"2024-09-20T21:02:13.464103+0000","last_undegraded":"2024-09-20T21:02:13.464103+0000","last_fullsized":"2024-09-20T21:02:13.464103+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:28.024220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466020+0000","last_change":"2024-09-20T21:01:12.227533+0000","last_active":"2024-09-20T21:02:13.466020+0000","last_peered":"2024-09-20T21:02:13.466020+0000","last_clean":"2024-09-20T21:02:13.466020+0000","last_became_active":"2024-09-20T21:01:12.226676+0000","last_became_peered":"2024-09-20T21:01:12.226676+0000","last_unstale":"2024-09-20T21:02:13.466020+0000","last_undegraded":"2024-09-20T21:02:13.466020+0000","last_fullsized":"2024-09-20T21:02:13.466020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"42'6932","reported_seq":6982,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.960228+0000","last_change":"2024-09-20T21:01:26.187915+0000","last_active":"2024-09-20T21:02:14.960228+0000","last_peered":"2024-09-20T21:02:14.960228+0000","last_clean":"2024-09-20T21:02:14.960228+0000","last_became_active":"2024-09-20T21:01:26.185921+0000","last_became_peered":"2024-09-20T21:01:26.185921+0000","last_unstale":"2024-09-20T21:02:14.960228+0000","last_undegraded":"2024-09-20T21:02:14.960228+0000","last_fullsized":"2024-09-20T21:02:14.960228+0000","mapping_epoch":21,"log_start":"30'3400","ondisk_log_start":"30'3400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:53.347202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":454295552,"num_objects":6932,"num_object_clones":0,"num_object_copies":13864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6932,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6932,"num_write_kb":443648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464365+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:02:13.464365+0000","last_peered":"2024-09-20T21:02:13.464365+0000","last_clean":"2024-09-20T21:02:13.464365+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:02:13.464365+0000","last_undegraded":"2024-09-20T21:02:13.464365+0000","last_fullsized":"2024-09-20T21:02:13.464365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465690+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:02:13.465690+0000","last_peered":"2024-09-20T21:02:13.465690+0000","last_clean":"2024-09-20T21:02:13.465690+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:02:13.465690+0000","last_undegraded":"2024-09-20T21:02:13.465690+0000","last_fullsized":"2024-09-20T21:02:13.465690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465372+0000","last_change":"2024-09-20T21:01:12.227354+0000","last_active":"2024-09-20T21:02:13.465372+0000","last_peered":"2024-09-20T21:02:13.465372+0000","last_clean":"2024-09-20T21:02:13.465372+0000","last_became_active":"2024-09-20T21:01:12.226078+0000","last_became_peered":"2024-09-20T21:01:12.226078+0000","last_unstale":"2024-09-20T21:02:13.465372+0000","last_undegraded":"2024-09-20T21:02:13.465372+0000","last_fullsized":"2024-09-20T21:02:13.465372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"42'6802","reported_seq":6852,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.984185+0000","last_change":"2024-09-20T21:01:26.199069+0000","last_active":"2024-09-20T21:02:14.984185+0000","last_peered":"2024-09-20T21:02:14.984185+0000","last_clean":"2024-09-20T21:02:14.984185+0000","last_became_active":"2024-09-20T21:01:26.198393+0000","last_became_peered":"2024-09-20T21:01:26.198393+0000","last_unstale":"2024-09-20T21:02:14.984185+0000","last_undegraded":"2024-09-20T21:02:14.984185+0000","last_fullsized":"2024-09-20T21:02:14.984185+0000","mapping_epoch":21,"log_start":"29'2800","ondisk_log_start":"29'2800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:31.789539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445775872,"num_objects":6802,"num_object_clones":0,"num_object_copies":13604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6802,"num_write_kb":435328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465680+0000","last_change":"2024-09-20T21:01:11.220479+0000","last_active":"2024-09-20T21:02:13.465680+0000","last_peered":"2024-09-20T21:02:13.465680+0000","last_clean":"2024-09-20T21:02:13.465680+0000","last_became_active":"2024-09-20T21:01:11.219658+0000","last_became_peered":"2024-09-20T21:01:11.219658+0000","last_unstale":"2024-09-20T21:02:13.465680+0000","last_undegraded":"2024-09-20T21:02:13.465680+0000","last_fullsized":"2024-09-20T21:02:13.465680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.469210+0000","last_change":"2024-09-20T21:02:06.431559+0000","last_active":"2024-09-20T21:02:13.469210+0000","last_peered":"2024-09-20T21:02:13.469210+0000","last_clean":"2024-09-20T21:02:13.469210+0000","last_became_active":"2024-09-20T21:02:06.428211+0000","last_became_peered":"2024-09-20T21:02:06.428211+0000","last_unstale":"2024-09-20T21:02:13.469210+0000","last_undegraded":"2024-09-20T21:02:13.469210+0000","last_fullsized":"2024-09-20T21:02:13.469210+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:31.501423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468113+0000","last_change":"2024-09-20T21:01:12.228307+0000","last_active":"2024-09-20T21:02:13.468113+0000","last_peered":"2024-09-20T21:02:13.468113+0000","last_clean":"2024-09-20T21:02:13.468113+0000","last_became_active":"2024-09-20T21:01:12.226322+0000","last_became_peered":"2024-09-20T21:01:12.226322+0000","last_unstale":"2024-09-20T21:02:13.468113+0000","last_undegraded":"2024-09-20T21:02:13.468113+0000","last_fullsized":"2024-09-20T21:02:13.468113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:52.194070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466975+0000","last_change":"2024-09-20T21:02:06.425447+0000","last_active":"2024-09-20T21:02:13.466975+0000","last_peered":"2024-09-20T21:02:13.466975+0000","last_clean":"2024-09-20T21:02:13.466975+0000","last_became_active":"2024-09-20T21:02:06.424623+0000","last_became_peered":"2024-09-20T21:02:06.424623+0000","last_unstale":"2024-09-20T21:02:13.466975+0000","last_undegraded":"2024-09-20T21:02:13.466975+0000","last_fullsized":"2024-09-20T21:02:13.466975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:28.674101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467390+0000","last_change":"2024-09-20T21:02:06.428165+0000","last_active":"2024-09-20T21:02:13.467390+0000","last_peered":"2024-09-20T21:02:13.467390+0000","last_clean":"2024-09-20T21:02:13.467390+0000","last_became_active":"2024-09-20T21:02:06.427296+0000","last_became_peered":"2024-09-20T21:02:06.427296+0000","last_unstale":"2024-09-20T21:02:13.467390+0000","last_undegraded":"2024-09-20T21:02:13.467390+0000","last_fullsized":"2024-09-20T21:02:13.467390+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:23.459169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465101+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:02:13.465101+0000","last_peered":"2024-09-20T21:02:13.465101+0000","last_clean":"2024-09-20T21:02:13.465101+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:02:13.465101+0000","last_undegraded":"2024-09-20T21:02:13.465101+0000","last_fullsized":"2024-09-20T21:02:13.465101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":63,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467028+0000","last_change":"2024-09-20T21:01:11.220027+0000","last_active":"2024-09-20T21:02:13.467028+0000","last_peered":"2024-09-20T21:02:13.467028+0000","last_clean":"2024-09-20T21:02:13.467028+0000","last_became_active":"2024-09-20T21:01:11.218551+0000","last_became_peered":"2024-09-20T21:01:11.218551+0000","last_unstale":"2024-09-20T21:02:13.467028+0000","last_undegraded":"2024-09-20T21:02:13.467028+0000","last_fullsized":"2024-09-20T21:02:13.467028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:47:59.918561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465506+0000","last_change":"2024-09-20T21:01:26.193337+0000","last_active":"2024-09-20T21:02:13.465506+0000","last_peered":"2024-09-20T21:02:13.465506+0000","last_clean":"2024-09-20T21:02:13.465506+0000","last_became_active":"2024-09-20T21:01:26.192862+0000","last_became_peered":"2024-09-20T21:01:26.192862+0000","last_unstale":"2024-09-20T21:02:13.465506+0000","last_undegraded":"2024-09-20T21:02:13.465506+0000","last_fullsized":"2024-09-20T21:02:13.465506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:11.609879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463308+0000","last_change":"2024-09-20T21:01:12.211553+0000","last_active":"2024-09-20T21:02:13.463308+0000","last_peered":"2024-09-20T21:02:13.463308+0000","last_clean":"2024-09-20T21:02:13.463308+0000","last_became_active":"2024-09-20T21:01:12.210101+0000","last_became_peered":"2024-09-20T21:01:12.210101+0000","last_unstale":"2024-09-20T21:02:13.463308+0000","last_undegraded":"2024-09-20T21:02:13.463308+0000","last_fullsized":"2024-09-20T21:02:13.463308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464202+0000","last_change":"2024-09-20T21:01:11.221867+0000","last_active":"2024-09-20T21:02:13.464202+0000","last_peered":"2024-09-20T21:02:13.464202+0000","last_clean":"2024-09-20T21:02:13.464202+0000","last_became_active":"2024-09-20T21:01:11.220980+0000","last_became_peered":"2024-09-20T21:01:11.220980+0000","last_unstale":"2024-09-20T21:02:13.464202+0000","last_undegraded":"2024-09-20T21:02:13.464202+0000","last_fullsized":"2024-09-20T21:02:13.464202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465298+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:02:13.465298+0000","last_peered":"2024-09-20T21:02:13.465298+0000","last_clean":"2024-09-20T21:02:13.465298+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:02:13.465298+0000","last_undegraded":"2024-09-20T21:02:13.465298+0000","last_fullsized":"2024-09-20T21:02:13.465298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468566+0000","last_change":"2024-09-20T21:01:12.236819+0000","last_active":"2024-09-20T21:02:13.468566+0000","last_peered":"2024-09-20T21:02:13.468566+0000","last_clean":"2024-09-20T21:02:13.468566+0000","last_became_active":"2024-09-20T21:01:12.233922+0000","last_became_peered":"2024-09-20T21:01:12.233922+0000","last_unstale":"2024-09-20T21:02:13.468566+0000","last_undegraded":"2024-09-20T21:02:13.468566+0000","last_fullsized":"2024-09-20T21:02:13.468566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465388+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:02:13.465388+0000","last_peered":"2024-09-20T21:02:13.465388+0000","last_clean":"2024-09-20T21:02:13.465388+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:02:13.465388+0000","last_undegraded":"2024-09-20T21:02:13.465388+0000","last_fullsized":"2024-09-20T21:02:13.465388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465480+0000","last_change":"2024-09-20T21:01:12.227395+0000","last_active":"2024-09-20T21:02:13.465480+0000","last_peered":"2024-09-20T21:02:13.465480+0000","last_clean":"2024-09-20T21:02:13.465480+0000","last_became_active":"2024-09-20T21:01:12.226122+0000","last_became_peered":"2024-09-20T21:01:12.226122+0000","last_unstale":"2024-09-20T21:02:13.465480+0000","last_undegraded":"2024-09-20T21:02:13.465480+0000","last_fullsized":"2024-09-20T21:02:13.465480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463462+0000","last_change":"2024-09-20T21:01:11.220367+0000","last_active":"2024-09-20T21:02:13.463462+0000","last_peered":"2024-09-20T21:02:13.463462+0000","last_clean":"2024-09-20T21:02:13.463462+0000","last_became_active":"2024-09-20T21:01:11.219090+0000","last_became_peered":"2024-09-20T21:01:11.219090+0000","last_unstale":"2024-09-20T21:02:13.463462+0000","last_undegraded":"2024-09-20T21:02:13.463462+0000","last_fullsized":"2024-09-20T21:02:13.463462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466853+0000","last_change":"2024-09-20T21:01:12.238895+0000","last_active":"2024-09-20T21:02:13.466853+0000","last_peered":"2024-09-20T21:02:13.466853+0000","last_clean":"2024-09-20T21:02:13.466853+0000","last_became_active":"2024-09-20T21:01:12.235481+0000","last_became_peered":"2024-09-20T21:01:12.235481+0000","last_unstale":"2024-09-20T21:02:13.466853+0000","last_undegraded":"2024-09-20T21:02:13.466853+0000","last_fullsized":"2024-09-20T21:02:13.466853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464993+0000","last_change":"2024-09-20T21:02:06.421747+0000","last_active":"2024-09-20T21:02:13.464993+0000","last_peered":"2024-09-20T21:02:13.464993+0000","last_clean":"2024-09-20T21:02:13.464993+0000","last_became_active":"2024-09-20T21:02:06.421099+0000","last_became_peered":"2024-09-20T21:02:06.421099+0000","last_unstale":"2024-09-20T21:02:13.464993+0000","last_undegraded":"2024-09-20T21:02:13.464993+0000","last_fullsized":"2024-09-20T21:02:13.464993+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:19.204963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463937+0000","last_change":"2024-09-20T21:02:06.429129+0000","last_active":"2024-09-20T21:02:13.463937+0000","last_peered":"2024-09-20T21:02:13.463937+0000","last_clean":"2024-09-20T21:02:13.463937+0000","last_became_active":"2024-09-20T21:02:06.426810+0000","last_became_peered":"2024-09-20T21:02:06.426810+0000","last_unstale":"2024-09-20T21:02:13.463937+0000","last_undegraded":"2024-09-20T21:02:13.463937+0000","last_fullsized":"2024-09-20T21:02:13.463937+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:48.423546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466112+0000","last_change":"2024-09-20T21:01:11.218440+0000","last_active":"2024-09-20T21:02:13.466112+0000","last_peered":"2024-09-20T21:02:13.466112+0000","last_clean":"2024-09-20T21:02:13.466112+0000","last_became_active":"2024-09-20T21:01:11.217722+0000","last_became_peered":"2024-09-20T21:01:11.217722+0000","last_unstale":"2024-09-20T21:02:13.466112+0000","last_undegraded":"2024-09-20T21:02:13.466112+0000","last_fullsized":"2024-09-20T21:02:13.466112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:11:02.101254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463538+0000","last_change":"2024-09-20T21:01:26.195014+0000","last_active":"2024-09-20T21:02:13.463538+0000","last_peered":"2024-09-20T21:02:13.463538+0000","last_clean":"2024-09-20T21:02:13.463538+0000","last_became_active":"2024-09-20T21:01:26.192848+0000","last_became_peered":"2024-09-20T21:01:26.192848+0000","last_unstale":"2024-09-20T21:02:13.463538+0000","last_undegraded":"2024-09-20T21:02:13.463538+0000","last_fullsized":"2024-09-20T21:02:13.463538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:28.674101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464421+0000","last_change":"2024-09-20T21:01:26.197383+0000","last_active":"2024-09-20T21:02:13.464421+0000","last_peered":"2024-09-20T21:02:13.464421+0000","last_clean":"2024-09-20T21:02:13.464421+0000","last_became_active":"2024-09-20T21:01:26.196662+0000","last_became_peered":"2024-09-20T21:01:26.196662+0000","last_unstale":"2024-09-20T21:02:13.464421+0000","last_undegraded":"2024-09-20T21:02:13.464421+0000","last_fullsized":"2024-09-20T21:02:13.464421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:35.350487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465118+0000","last_change":"2024-09-20T21:01:26.187436+0000","last_active":"2024-09-20T21:02:13.465118+0000","last_peered":"2024-09-20T21:02:13.465118+0000","last_clean":"2024-09-20T21:02:13.465118+0000","last_became_active":"2024-09-20T21:01:26.186319+0000","last_became_peered":"2024-09-20T21:01:26.186319+0000","last_unstale":"2024-09-20T21:02:13.465118+0000","last_undegraded":"2024-09-20T21:02:13.465118+0000","last_fullsized":"2024-09-20T21:02:13.465118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:04.716145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466936+0000","last_change":"2024-09-20T21:01:11.220332+0000","last_active":"2024-09-20T21:02:13.466936+0000","last_peered":"2024-09-20T21:02:13.466936+0000","last_clean":"2024-09-20T21:02:13.466936+0000","last_became_active":"2024-09-20T21:01:11.219022+0000","last_became_peered":"2024-09-20T21:01:11.219022+0000","last_unstale":"2024-09-20T21:02:13.466936+0000","last_undegraded":"2024-09-20T21:02:13.466936+0000","last_fullsized":"2024-09-20T21:02:13.466936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.928114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463646+0000","last_change":"2024-09-20T21:02:06.427461+0000","last_active":"2024-09-20T21:02:13.463646+0000","last_peered":"2024-09-20T21:02:13.463646+0000","last_clean":"2024-09-20T21:02:13.463646+0000","last_became_active":"2024-09-20T21:02:06.426709+0000","last_became_peered":"2024-09-20T21:02:06.426709+0000","last_unstale":"2024-09-20T21:02:13.463646+0000","last_undegraded":"2024-09-20T21:02:13.463646+0000","last_fullsized":"2024-09-20T21:02:13.463646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:25:05.037879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465611+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:02:13.465611+0000","last_peered":"2024-09-20T21:02:13.465611+0000","last_clean":"2024-09-20T21:02:13.465611+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:02:13.465611+0000","last_undegraded":"2024-09-20T21:02:13.465611+0000","last_fullsized":"2024-09-20T21:02:13.465611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465278+0000","last_change":"2024-09-20T21:01:26.190436+0000","last_active":"2024-09-20T21:02:13.465278+0000","last_peered":"2024-09-20T21:02:13.465278+0000","last_clean":"2024-09-20T21:02:13.465278+0000","last_became_active":"2024-09-20T21:01:26.186848+0000","last_became_peered":"2024-09-20T21:01:26.186848+0000","last_unstale":"2024-09-20T21:02:13.465278+0000","last_undegraded":"2024-09-20T21:02:13.465278+0000","last_fullsized":"2024-09-20T21:02:13.465278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:03:53.389519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":64,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464086+0000","last_change":"2024-09-20T21:01:11.222738+0000","last_active":"2024-09-20T21:02:13.464086+0000","last_peered":"2024-09-20T21:02:13.464086+0000","last_clean":"2024-09-20T21:02:13.464086+0000","last_became_active":"2024-09-20T21:01:11.221990+0000","last_became_peered":"2024-09-20T21:01:11.221990+0000","last_unstale":"2024-09-20T21:02:13.464086+0000","last_undegraded":"2024-09-20T21:02:13.464086+0000","last_fullsized":"2024-09-20T21:02:13.464086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7159939072,"num_objects":109252,"num_object_clones":0,"num_object_copies":218504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109252,"num_write_kb":6992128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":894930944,"data_stored":14318895104,"data_compressed":68601815,"data_compressed_allocated":894930944,"data_compressed_original":14318895104,"omap_allocated":0,"internal_metadata":0},"log_size":59425,"ondisk_log_size":59425,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341604,"kb_used_data":242384,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94030236,"statfs":{"total":96636764160,"available":96286961664,"internally_reserved":0,"allocated":248201216,"data_stored":3963522809,"data_compressed":18995679,"data_compressed_allocated":247713792,"data_compressed_original":3963338752,"omap_allocated":1596,"internal_metadata":101579204},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":372440,"kb_used_data":269060,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":93999400,"statfs":{"total":96636764160,"available":96255385600,"internally_reserved":0,"allocated":275517440,"data_stored":4400386420,"data_compressed":21088828,"data_compressed_allocated":275017728,"data_compressed_original":4400201728,"omap_allocated":1596,"internal_metadata":105839044},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":498752,"kb_used_data":350956,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93873088,"statfs":{"total":96636764160,"available":96126042112,"internally_reserved":0,"allocated":359378944,"data_stored":5742954578,"data_compressed":27512461,"data_compressed_allocated":358924288,"data_compressed_original":5742788608,"omap_allocated":1596,"internal_metadata":151321028},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":364032000,"data_stored":5824512000,"data_compressed":27905266,"data_compressed_allocated":364032000,"data_compressed_original":5824512000,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278904832,"data_stored":4462477312,"data_compressed":21379729,"data_compressed_allocated":278904832,"data_compressed_original":4462477312,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":251994112,"data_stored":4031905792,"data_compressed":19316820,"data_compressed_allocated":251994112,"data_compressed_original":4031905792,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:02:18.875 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:02:18.955 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:18.955 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:18.969 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:18.970+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:18.975 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:19.070 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:19.065+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:19.133 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:19.133 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:19.153 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:19.196 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:19.193+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:19.234 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:02:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:02:19.246 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 52 16 118024 118008 141.822 130.875 0.00918486 0.00704676 2024-09-20T21:02:19.253 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-20T21:02:18.877907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7160531869,"num_objects":109278,"num_object_clones":0,"num_object_copies":218556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109278,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":109502,"num_write_kb":6995604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59624,"ondisk_log_size":59624,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1212796,"kb_used_data":862400,"kb_used_omap":4,"kb_used_meta":350331,"kb_avail":281902724,"statfs":{"total":289910292480,"available":288668389376,"internally_reserved":0,"allocated":883097600,"data_stored":14106863807,"data_compressed":67596968,"data_compressed_allocated":881655808,"data_compressed_original":14106329088,"omap_allocated":4788,"internal_metadata":358739276},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":662372352,"num_objects":10107,"num_object_clones":0,"num_object_copies":20214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10107,"num_write_kb":646848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.415310"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464194+0000","last_change":"2024-09-20T21:02:06.428072+0000","last_active":"2024-09-20T21:02:13.464194+0000","last_peered":"2024-09-20T21:02:13.464194+0000","last_clean":"2024-09-20T21:02:13.464194+0000","last_became_active":"2024-09-20T21:02:06.427340+0000","last_became_peered":"2024-09-20T21:02:06.427340+0000","last_unstale":"2024-09-20T21:02:13.464194+0000","last_undegraded":"2024-09-20T21:02:13.464194+0000","last_fullsized":"2024-09-20T21:02:13.464194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:07.692487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464826+0000","last_change":"2024-09-20T21:02:06.426971+0000","last_active":"2024-09-20T21:02:13.464826+0000","last_peered":"2024-09-20T21:02:13.464826+0000","last_clean":"2024-09-20T21:02:13.464826+0000","last_became_active":"2024-09-20T21:02:06.426643+0000","last_became_peered":"2024-09-20T21:02:06.426643+0000","last_unstale":"2024-09-20T21:02:13.464826+0000","last_undegraded":"2024-09-20T21:02:13.464826+0000","last_fullsized":"2024-09-20T21:02:13.464826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:12:01.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466677+0000","last_change":"2024-09-20T21:01:26.196187+0000","last_active":"2024-09-20T21:02:13.466677+0000","last_peered":"2024-09-20T21:02:13.466677+0000","last_clean":"2024-09-20T21:02:13.466677+0000","last_became_active":"2024-09-20T21:01:26.194809+0000","last_became_peered":"2024-09-20T21:01:26.194809+0000","last_unstale":"2024-09-20T21:02:13.466677+0000","last_undegraded":"2024-09-20T21:02:13.466677+0000","last_fullsized":"2024-09-20T21:02:13.466677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:32:57.333723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464031+0000","last_change":"2024-09-20T21:01:26.187140+0000","last_active":"2024-09-20T21:02:13.464031+0000","last_peered":"2024-09-20T21:02:13.464031+0000","last_clean":"2024-09-20T21:02:13.464031+0000","last_became_active":"2024-09-20T21:01:26.184626+0000","last_became_peered":"2024-09-20T21:01:26.184626+0000","last_unstale":"2024-09-20T21:02:13.464031+0000","last_undegraded":"2024-09-20T21:02:13.464031+0000","last_fullsized":"2024-09-20T21:02:13.464031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:23.486608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463453+0000","last_change":"2024-09-20T21:02:06.422301+0000","last_active":"2024-09-20T21:02:13.463453+0000","last_peered":"2024-09-20T21:02:13.463453+0000","last_clean":"2024-09-20T21:02:13.463453+0000","last_became_active":"2024-09-20T21:02:06.421576+0000","last_became_peered":"2024-09-20T21:02:06.421576+0000","last_unstale":"2024-09-20T21:02:13.463453+0000","last_undegraded":"2024-09-20T21:02:13.463453+0000","last_fullsized":"2024-09-20T21:02:13.463453+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:14.175466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464932+0000","last_change":"2024-09-20T21:01:26.187112+0000","last_active":"2024-09-20T21:02:13.464932+0000","last_peered":"2024-09-20T21:02:13.464932+0000","last_clean":"2024-09-20T21:02:13.464932+0000","last_became_active":"2024-09-20T21:01:26.185335+0000","last_became_peered":"2024-09-20T21:01:26.185335+0000","last_unstale":"2024-09-20T21:02:13.464932+0000","last_undegraded":"2024-09-20T21:02:13.464932+0000","last_fullsized":"2024-09-20T21:02:13.464932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:16.681572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463052+0000","last_change":"2024-09-20T21:01:26.195111+0000","last_active":"2024-09-20T21:02:13.463052+0000","last_peered":"2024-09-20T21:02:13.463052+0000","last_clean":"2024-09-20T21:02:13.463052+0000","last_became_active":"2024-09-20T21:01:26.194334+0000","last_became_peered":"2024-09-20T21:01:26.194334+0000","last_unstale":"2024-09-20T21:02:13.463052+0000","last_undegraded":"2024-09-20T21:02:13.463052+0000","last_fullsized":"2024-09-20T21:02:13.463052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:32.305202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465044+0000","last_change":"2024-09-20T21:01:26.187350+0000","last_active":"2024-09-20T21:02:13.465044+0000","last_peered":"2024-09-20T21:02:13.465044+0000","last_clean":"2024-09-20T21:02:13.465044+0000","last_became_active":"2024-09-20T21:01:26.185422+0000","last_became_peered":"2024-09-20T21:01:26.185422+0000","last_unstale":"2024-09-20T21:02:13.465044+0000","last_undegraded":"2024-09-20T21:02:13.465044+0000","last_fullsized":"2024-09-20T21:02:13.465044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:54:07.656861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463546+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:02:13.463546+0000","last_peered":"2024-09-20T21:02:13.463546+0000","last_clean":"2024-09-20T21:02:13.463546+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:02:13.463546+0000","last_undegraded":"2024-09-20T21:02:13.463546+0000","last_fullsized":"2024-09-20T21:02:13.463546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465448+0000","last_change":"2024-09-20T21:02:06.427547+0000","last_active":"2024-09-20T21:02:13.465448+0000","last_peered":"2024-09-20T21:02:13.465448+0000","last_clean":"2024-09-20T21:02:13.465448+0000","last_became_active":"2024-09-20T21:02:06.427270+0000","last_became_peered":"2024-09-20T21:02:06.427270+0000","last_unstale":"2024-09-20T21:02:13.465448+0000","last_undegraded":"2024-09-20T21:02:13.465448+0000","last_fullsized":"2024-09-20T21:02:13.465448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:07.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463819+0000","last_change":"2024-09-20T21:01:26.195459+0000","last_active":"2024-09-20T21:02:13.463819+0000","last_peered":"2024-09-20T21:02:13.463819+0000","last_clean":"2024-09-20T21:02:13.463819+0000","last_became_active":"2024-09-20T21:01:26.194481+0000","last_became_peered":"2024-09-20T21:01:26.194481+0000","last_unstale":"2024-09-20T21:02:13.463819+0000","last_undegraded":"2024-09-20T21:02:13.463819+0000","last_fullsized":"2024-09-20T21:02:13.463819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:26.903534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466174+0000","last_change":"2024-09-20T21:01:12.229580+0000","last_active":"2024-09-20T21:02:13.466174+0000","last_peered":"2024-09-20T21:02:13.466174+0000","last_clean":"2024-09-20T21:02:13.466174+0000","last_became_active":"2024-09-20T21:01:12.226915+0000","last_became_peered":"2024-09-20T21:01:12.226915+0000","last_unstale":"2024-09-20T21:02:13.466174+0000","last_undegraded":"2024-09-20T21:02:13.466174+0000","last_fullsized":"2024-09-20T21:02:13.466174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.985765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463623+0000","last_change":"2024-09-20T21:02:06.422473+0000","last_active":"2024-09-20T21:02:13.463623+0000","last_peered":"2024-09-20T21:02:13.463623+0000","last_clean":"2024-09-20T21:02:13.463623+0000","last_became_active":"2024-09-20T21:02:06.421735+0000","last_became_peered":"2024-09-20T21:02:06.421735+0000","last_unstale":"2024-09-20T21:02:13.463623+0000","last_undegraded":"2024-09-20T21:02:13.463623+0000","last_fullsized":"2024-09-20T21:02:13.463623+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:36.002640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468967+0000","last_change":"2024-09-20T21:02:06.428272+0000","last_active":"2024-09-20T21:02:13.468967+0000","last_peered":"2024-09-20T21:02:13.468967+0000","last_clean":"2024-09-20T21:02:13.468967+0000","last_became_active":"2024-09-20T21:02:06.427512+0000","last_became_peered":"2024-09-20T21:02:06.427512+0000","last_unstale":"2024-09-20T21:02:13.468967+0000","last_undegraded":"2024-09-20T21:02:13.468967+0000","last_fullsized":"2024-09-20T21:02:13.468967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:32.305202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467673+0000","last_change":"2024-09-20T21:02:06.424951+0000","last_active":"2024-09-20T21:02:13.467673+0000","last_peered":"2024-09-20T21:02:13.467673+0000","last_clean":"2024-09-20T21:02:13.467673+0000","last_became_active":"2024-09-20T21:02:06.424328+0000","last_became_peered":"2024-09-20T21:02:06.424328+0000","last_unstale":"2024-09-20T21:02:13.467673+0000","last_undegraded":"2024-09-20T21:02:13.467673+0000","last_fullsized":"2024-09-20T21:02:13.467673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:32:57.333723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465170+0000","last_change":"2024-09-20T21:01:26.186757+0000","last_active":"2024-09-20T21:02:13.465170+0000","last_peered":"2024-09-20T21:02:13.465170+0000","last_clean":"2024-09-20T21:02:13.465170+0000","last_became_active":"2024-09-20T21:01:26.184738+0000","last_became_peered":"2024-09-20T21:01:26.184738+0000","last_unstale":"2024-09-20T21:02:13.465170+0000","last_undegraded":"2024-09-20T21:02:13.465170+0000","last_fullsized":"2024-09-20T21:02:13.465170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:19:56.030003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464281+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:02:13.464281+0000","last_peered":"2024-09-20T21:02:13.464281+0000","last_clean":"2024-09-20T21:02:13.464281+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:02:13.464281+0000","last_undegraded":"2024-09-20T21:02:13.464281+0000","last_fullsized":"2024-09-20T21:02:13.464281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467021+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:02:13.467021+0000","last_peered":"2024-09-20T21:02:13.467021+0000","last_clean":"2024-09-20T21:02:13.467021+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:02:13.467021+0000","last_undegraded":"2024-09-20T21:02:13.467021+0000","last_fullsized":"2024-09-20T21:02:13.467021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464001+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:02:13.464001+0000","last_peered":"2024-09-20T21:02:13.464001+0000","last_clean":"2024-09-20T21:02:13.464001+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:02:13.464001+0000","last_undegraded":"2024-09-20T21:02:13.464001+0000","last_fullsized":"2024-09-20T21:02:13.464001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464202+0000","last_change":"2024-09-20T21:01:26.187783+0000","last_active":"2024-09-20T21:02:13.464202+0000","last_peered":"2024-09-20T21:02:13.464202+0000","last_clean":"2024-09-20T21:02:13.464202+0000","last_became_active":"2024-09-20T21:01:26.185081+0000","last_became_peered":"2024-09-20T21:01:26.185081+0000","last_unstale":"2024-09-20T21:02:13.464202+0000","last_undegraded":"2024-09-20T21:02:13.464202+0000","last_fullsized":"2024-09-20T21:02:13.464202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464391+0000","last_change":"2024-09-20T21:01:26.197852+0000","last_active":"2024-09-20T21:02:13.464391+0000","last_peered":"2024-09-20T21:02:13.464391+0000","last_clean":"2024-09-20T21:02:13.464391+0000","last_became_active":"2024-09-20T21:01:26.195824+0000","last_became_peered":"2024-09-20T21:01:26.195824+0000","last_unstale":"2024-09-20T21:02:13.464391+0000","last_undegraded":"2024-09-20T21:02:13.464391+0000","last_fullsized":"2024-09-20T21:02:13.464391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:41:54.555337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468111+0000","last_change":"2024-09-20T21:01:12.230375+0000","last_active":"2024-09-20T21:02:13.468111+0000","last_peered":"2024-09-20T21:02:13.468111+0000","last_clean":"2024-09-20T21:02:13.468111+0000","last_became_active":"2024-09-20T21:01:12.228679+0000","last_became_peered":"2024-09-20T21:01:12.228679+0000","last_unstale":"2024-09-20T21:02:13.468111+0000","last_undegraded":"2024-09-20T21:02:13.468111+0000","last_fullsized":"2024-09-20T21:02:13.468111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463156+0000","last_change":"2024-09-20T21:01:12.214484+0000","last_active":"2024-09-20T21:02:13.463156+0000","last_peered":"2024-09-20T21:02:13.463156+0000","last_clean":"2024-09-20T21:02:13.463156+0000","last_became_active":"2024-09-20T21:01:12.212293+0000","last_became_peered":"2024-09-20T21:01:12.212293+0000","last_unstale":"2024-09-20T21:02:13.463156+0000","last_undegraded":"2024-09-20T21:02:13.463156+0000","last_fullsized":"2024-09-20T21:02:13.463156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464937+0000","last_change":"2024-09-20T21:02:06.422977+0000","last_active":"2024-09-20T21:02:13.464937+0000","last_peered":"2024-09-20T21:02:13.464937+0000","last_clean":"2024-09-20T21:02:13.464937+0000","last_became_active":"2024-09-20T21:02:06.421686+0000","last_became_peered":"2024-09-20T21:02:06.421686+0000","last_unstale":"2024-09-20T21:02:13.464937+0000","last_undegraded":"2024-09-20T21:02:13.464937+0000","last_fullsized":"2024-09-20T21:02:13.464937+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:21.668945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468519+0000","last_change":"2024-09-20T21:01:12.237926+0000","last_active":"2024-09-20T21:02:13.468519+0000","last_peered":"2024-09-20T21:02:13.468519+0000","last_clean":"2024-09-20T21:02:13.468519+0000","last_became_active":"2024-09-20T21:01:12.234061+0000","last_became_peered":"2024-09-20T21:01:12.234061+0000","last_unstale":"2024-09-20T21:02:13.468519+0000","last_undegraded":"2024-09-20T21:02:13.468519+0000","last_fullsized":"2024-09-20T21:02:13.468519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465529+0000","last_change":"2024-09-20T21:01:12.214728+0000","last_active":"2024-09-20T21:02:13.465529+0000","last_peered":"2024-09-20T21:02:13.465529+0000","last_clean":"2024-09-20T21:02:13.465529+0000","last_became_active":"2024-09-20T21:01:12.213159+0000","last_became_peered":"2024-09-20T21:01:12.213159+0000","last_unstale":"2024-09-20T21:02:13.465529+0000","last_undegraded":"2024-09-20T21:02:13.465529+0000","last_fullsized":"2024-09-20T21:02:13.465529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.469516+0000","last_change":"2024-09-20T21:02:06.430293+0000","last_active":"2024-09-20T21:02:13.469516+0000","last_peered":"2024-09-20T21:02:13.469516+0000","last_clean":"2024-09-20T21:02:13.469516+0000","last_became_active":"2024-09-20T21:02:06.427788+0000","last_became_peered":"2024-09-20T21:02:06.427788+0000","last_unstale":"2024-09-20T21:02:13.469516+0000","last_undegraded":"2024-09-20T21:02:13.469516+0000","last_fullsized":"2024-09-20T21:02:13.469516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:36.362384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466275+0000","last_change":"2024-09-20T21:01:12.227425+0000","last_active":"2024-09-20T21:02:13.466275+0000","last_peered":"2024-09-20T21:02:13.466275+0000","last_clean":"2024-09-20T21:02:13.466275+0000","last_became_active":"2024-09-20T21:01:12.226625+0000","last_became_peered":"2024-09-20T21:01:12.226625+0000","last_unstale":"2024-09-20T21:02:13.466275+0000","last_undegraded":"2024-09-20T21:02:13.466275+0000","last_fullsized":"2024-09-20T21:02:13.466275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464312+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:02:13.464312+0000","last_peered":"2024-09-20T21:02:13.464312+0000","last_clean":"2024-09-20T21:02:13.464312+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:02:13.464312+0000","last_undegraded":"2024-09-20T21:02:13.464312+0000","last_fullsized":"2024-09-20T21:02:13.464312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468206+0000","last_change":"2024-09-20T21:01:12.230684+0000","last_active":"2024-09-20T21:02:13.468206+0000","last_peered":"2024-09-20T21:02:13.468206+0000","last_clean":"2024-09-20T21:02:13.468206+0000","last_became_active":"2024-09-20T21:01:12.229915+0000","last_became_peered":"2024-09-20T21:01:12.229915+0000","last_unstale":"2024-09-20T21:02:13.468206+0000","last_undegraded":"2024-09-20T21:02:13.468206+0000","last_fullsized":"2024-09-20T21:02:13.468206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463235+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:02:13.463235+0000","last_peered":"2024-09-20T21:02:13.463235+0000","last_clean":"2024-09-20T21:02:13.463235+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:02:13.463235+0000","last_undegraded":"2024-09-20T21:02:13.463235+0000","last_fullsized":"2024-09-20T21:02:13.463235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465185+0000","last_change":"2024-09-20T21:01:26.187763+0000","last_active":"2024-09-20T21:02:13.465185+0000","last_peered":"2024-09-20T21:02:13.465185+0000","last_clean":"2024-09-20T21:02:13.465185+0000","last_became_active":"2024-09-20T21:01:26.185774+0000","last_became_peered":"2024-09-20T21:01:26.185774+0000","last_unstale":"2024-09-20T21:02:13.465185+0000","last_undegraded":"2024-09-20T21:02:13.465185+0000","last_fullsized":"2024-09-20T21:02:13.465185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:07.330848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463824+0000","last_change":"2024-09-20T21:02:06.424569+0000","last_active":"2024-09-20T21:02:13.463824+0000","last_peered":"2024-09-20T21:02:13.463824+0000","last_clean":"2024-09-20T21:02:13.463824+0000","last_became_active":"2024-09-20T21:02:06.423852+0000","last_became_peered":"2024-09-20T21:02:06.423852+0000","last_unstale":"2024-09-20T21:02:13.463824+0000","last_undegraded":"2024-09-20T21:02:13.463824+0000","last_fullsized":"2024-09-20T21:02:13.463824+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:49.304016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463714+0000","last_change":"2024-09-20T21:01:26.197377+0000","last_active":"2024-09-20T21:02:13.463714+0000","last_peered":"2024-09-20T21:02:13.463714+0000","last_clean":"2024-09-20T21:02:13.463714+0000","last_became_active":"2024-09-20T21:01:26.194232+0000","last_became_peered":"2024-09-20T21:01:26.194232+0000","last_unstale":"2024-09-20T21:02:13.463714+0000","last_undegraded":"2024-09-20T21:02:13.463714+0000","last_fullsized":"2024-09-20T21:02:13.463714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:16.800376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464218+0000","last_change":"2024-09-20T21:02:06.429730+0000","last_active":"2024-09-20T21:02:13.464218+0000","last_peered":"2024-09-20T21:02:13.464218+0000","last_clean":"2024-09-20T21:02:13.464218+0000","last_became_active":"2024-09-20T21:02:06.428246+0000","last_became_peered":"2024-09-20T21:02:06.428246+0000","last_unstale":"2024-09-20T21:02:13.464218+0000","last_undegraded":"2024-09-20T21:02:13.464218+0000","last_fullsized":"2024-09-20T21:02:13.464218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:03.230251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465184+0000","last_change":"2024-09-20T21:01:11.220335+0000","last_active":"2024-09-20T21:02:13.465184+0000","last_peered":"2024-09-20T21:02:13.465184+0000","last_clean":"2024-09-20T21:02:13.465184+0000","last_became_active":"2024-09-20T21:01:11.219506+0000","last_became_peered":"2024-09-20T21:01:11.219506+0000","last_unstale":"2024-09-20T21:02:13.465184+0000","last_undegraded":"2024-09-20T21:02:13.465184+0000","last_fullsized":"2024-09-20T21:02:13.465184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:16:05.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465611+0000","last_change":"2024-09-20T21:01:12.214329+0000","last_active":"2024-09-20T21:02:13.465611+0000","last_peered":"2024-09-20T21:02:13.465611+0000","last_clean":"2024-09-20T21:02:13.465611+0000","last_became_active":"2024-09-20T21:01:12.212104+0000","last_became_peered":"2024-09-20T21:01:12.212104+0000","last_unstale":"2024-09-20T21:02:13.465611+0000","last_undegraded":"2024-09-20T21:02:13.465611+0000","last_fullsized":"2024-09-20T21:02:13.465611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468116+0000","last_change":"2024-09-20T21:01:11.213590+0000","last_active":"2024-09-20T21:02:13.468116+0000","last_peered":"2024-09-20T21:02:13.468116+0000","last_clean":"2024-09-20T21:02:13.468116+0000","last_became_active":"2024-09-20T21:01:11.212919+0000","last_became_peered":"2024-09-20T21:01:11.212919+0000","last_unstale":"2024-09-20T21:02:13.468116+0000","last_undegraded":"2024-09-20T21:02:13.468116+0000","last_fullsized":"2024-09-20T21:02:13.468116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.040754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463635+0000","last_change":"2024-09-20T21:01:12.214556+0000","last_active":"2024-09-20T21:02:13.463635+0000","last_peered":"2024-09-20T21:02:13.463635+0000","last_clean":"2024-09-20T21:02:13.463635+0000","last_became_active":"2024-09-20T21:01:12.212508+0000","last_became_peered":"2024-09-20T21:01:12.212508+0000","last_unstale":"2024-09-20T21:02:13.463635+0000","last_undegraded":"2024-09-20T21:02:13.463635+0000","last_fullsized":"2024-09-20T21:02:13.463635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:30.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466730+0000","last_change":"2024-09-20T21:02:06.428802+0000","last_active":"2024-09-20T21:02:13.466730+0000","last_peered":"2024-09-20T21:02:13.466730+0000","last_clean":"2024-09-20T21:02:13.466730+0000","last_became_active":"2024-09-20T21:02:06.427772+0000","last_became_peered":"2024-09-20T21:02:06.427772+0000","last_unstale":"2024-09-20T21:02:13.466730+0000","last_undegraded":"2024-09-20T21:02:13.466730+0000","last_fullsized":"2024-09-20T21:02:13.466730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:39.527762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"42'6796","reported_seq":6851,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.952812+0000","last_change":"2024-09-20T21:02:06.433294+0000","last_active":"2024-09-20T21:02:14.952812+0000","last_peered":"2024-09-20T21:02:14.952812+0000","last_clean":"2024-09-20T21:02:14.952812+0000","last_became_active":"2024-09-20T21:02:06.423829+0000","last_became_peered":"2024-09-20T21:02:06.423829+0000","last_unstale":"2024-09-20T21:02:14.952812+0000","last_undegraded":"2024-09-20T21:02:14.952812+0000","last_fullsized":"2024-09-20T21:02:14.952812+0000","mapping_epoch":38,"log_start":"29'3087","ondisk_log_start":"29'3087","created":21,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3709,"log_dups_size":0,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:53.347202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445382656,"num_objects":6796,"num_object_clones":0,"num_object_copies":13592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6796,"num_write_kb":434944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468319+0000","last_change":"2024-09-20T21:01:26.189708+0000","last_active":"2024-09-20T21:02:13.468319+0000","last_peered":"2024-09-20T21:02:13.468319+0000","last_clean":"2024-09-20T21:02:13.468319+0000","last_became_active":"2024-09-20T21:01:26.187755+0000","last_became_peered":"2024-09-20T21:01:26.187755+0000","last_unstale":"2024-09-20T21:02:13.468319+0000","last_undegraded":"2024-09-20T21:02:13.468319+0000","last_fullsized":"2024-09-20T21:02:13.468319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:22.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468522+0000","last_change":"2024-09-20T21:01:12.229503+0000","last_active":"2024-09-20T21:02:13.468522+0000","last_peered":"2024-09-20T21:02:13.468522+0000","last_clean":"2024-09-20T21:02:13.468522+0000","last_became_active":"2024-09-20T21:01:12.228540+0000","last_became_peered":"2024-09-20T21:01:12.228540+0000","last_unstale":"2024-09-20T21:02:13.468522+0000","last_undegraded":"2024-09-20T21:02:13.468522+0000","last_fullsized":"2024-09-20T21:02:13.468522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:13.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"42'6867","reported_seq":6920,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.977516+0000","last_change":"2024-09-20T21:02:06.441673+0000","last_active":"2024-09-20T21:02:14.977516+0000","last_peered":"2024-09-20T21:02:14.977516+0000","last_clean":"2024-09-20T21:02:14.977516+0000","last_became_active":"2024-09-20T21:02:06.427751+0000","last_became_peered":"2024-09-20T21:02:06.427751+0000","last_unstale":"2024-09-20T21:02:14.977516+0000","last_undegraded":"2024-09-20T21:02:14.977516+0000","last_fullsized":"2024-09-20T21:02:14.977516+0000","mapping_epoch":38,"log_start":"29'3240","ondisk_log_start":"29'3240","created":21,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3627,"log_dups_size":0,"ondisk_log_size":3627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:36.928079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450035712,"num_objects":6867,"num_object_clones":0,"num_object_copies":13734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6867,"num_write_kb":439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467156+0000","last_change":"2024-09-20T21:01:11.214247+0000","last_active":"2024-09-20T21:02:13.467156+0000","last_peered":"2024-09-20T21:02:13.467156+0000","last_clean":"2024-09-20T21:02:13.467156+0000","last_became_active":"2024-09-20T21:01:11.212760+0000","last_became_peered":"2024-09-20T21:01:11.212760+0000","last_unstale":"2024-09-20T21:02:13.467156+0000","last_undegraded":"2024-09-20T21:02:13.467156+0000","last_fullsized":"2024-09-20T21:02:13.467156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:20.108703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463385+0000","last_change":"2024-09-20T21:02:06.424582+0000","last_active":"2024-09-20T21:02:13.463385+0000","last_peered":"2024-09-20T21:02:13.463385+0000","last_clean":"2024-09-20T21:02:13.463385+0000","last_became_active":"2024-09-20T21:02:06.421448+0000","last_became_peered":"2024-09-20T21:02:06.421448+0000","last_unstale":"2024-09-20T21:02:13.463385+0000","last_undegraded":"2024-09-20T21:02:13.463385+0000","last_fullsized":"2024-09-20T21:02:13.463385+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:42.804478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"42'6933","reported_seq":6983,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.983550+0000","last_change":"2024-09-20T21:01:26.189622+0000","last_active":"2024-09-20T21:02:14.983550+0000","last_peered":"2024-09-20T21:02:14.983550+0000","last_clean":"2024-09-20T21:02:14.983550+0000","last_became_active":"2024-09-20T21:01:26.186385+0000","last_became_peered":"2024-09-20T21:01:26.186385+0000","last_unstale":"2024-09-20T21:02:14.983550+0000","last_undegraded":"2024-09-20T21:02:14.983550+0000","last_fullsized":"2024-09-20T21:02:14.983550+0000","mapping_epoch":21,"log_start":"29'2900","ondisk_log_start":"29'2900","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4033,"log_dups_size":0,"ondisk_log_size":4033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:50.339650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":454361088,"num_objects":6933,"num_object_clones":0,"num_object_copies":13866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6933,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6933,"num_write_kb":443712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.469681+0000","last_change":"2024-09-20T21:02:06.431245+0000","last_active":"2024-09-20T21:02:13.469681+0000","last_peered":"2024-09-20T21:02:13.469681+0000","last_clean":"2024-09-20T21:02:13.469681+0000","last_became_active":"2024-09-20T21:02:06.429827+0000","last_became_peered":"2024-09-20T21:02:06.429827+0000","last_unstale":"2024-09-20T21:02:13.469681+0000","last_undegraded":"2024-09-20T21:02:13.469681+0000","last_fullsized":"2024-09-20T21:02:13.469681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:56:05.390834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465200+0000","last_change":"2024-09-20T21:01:26.187349+0000","last_active":"2024-09-20T21:02:13.465200+0000","last_peered":"2024-09-20T21:02:13.465200+0000","last_clean":"2024-09-20T21:02:13.465200+0000","last_became_active":"2024-09-20T21:01:26.185876+0000","last_became_peered":"2024-09-20T21:01:26.185876+0000","last_unstale":"2024-09-20T21:02:13.465200+0000","last_undegraded":"2024-09-20T21:02:13.465200+0000","last_fullsized":"2024-09-20T21:02:13.465200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:48.846118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"42'6840","reported_seq":6890,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.960224+0000","last_change":"2024-09-20T21:01:26.189804+0000","last_active":"2024-09-20T21:02:14.960224+0000","last_peered":"2024-09-20T21:02:14.960224+0000","last_clean":"2024-09-20T21:02:14.960224+0000","last_became_active":"2024-09-20T21:01:26.187924+0000","last_became_peered":"2024-09-20T21:01:26.187924+0000","last_unstale":"2024-09-20T21:02:14.960224+0000","last_undegraded":"2024-09-20T21:02:14.960224+0000","last_fullsized":"2024-09-20T21:02:14.960224+0000","mapping_epoch":21,"log_start":"30'3300","ondisk_log_start":"30'3300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:35:44.867498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448266240,"num_objects":6840,"num_object_clones":0,"num_object_copies":13680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6840,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6840,"num_write_kb":437760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464377+0000","last_change":"2024-09-20T21:01:26.189711+0000","last_active":"2024-09-20T21:02:13.464377+0000","last_peered":"2024-09-20T21:02:13.464377+0000","last_clean":"2024-09-20T21:02:13.464377+0000","last_became_active":"2024-09-20T21:01:26.187708+0000","last_became_peered":"2024-09-20T21:01:26.187708+0000","last_unstale":"2024-09-20T21:02:13.464377+0000","last_undegraded":"2024-09-20T21:02:13.464377+0000","last_fullsized":"2024-09-20T21:02:13.464377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:31:35.980589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463838+0000","last_change":"2024-09-20T21:01:12.220592+0000","last_active":"2024-09-20T21:02:13.463838+0000","last_peered":"2024-09-20T21:02:13.463838+0000","last_clean":"2024-09-20T21:02:13.463838+0000","last_became_active":"2024-09-20T21:01:12.219682+0000","last_became_peered":"2024-09-20T21:01:12.219682+0000","last_unstale":"2024-09-20T21:02:13.463838+0000","last_undegraded":"2024-09-20T21:02:13.463838+0000","last_fullsized":"2024-09-20T21:02:13.463838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:44.636331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"42'6802","reported_seq":6852,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.983540+0000","last_change":"2024-09-20T21:01:26.196437+0000","last_active":"2024-09-20T21:02:14.983540+0000","last_peered":"2024-09-20T21:02:14.983540+0000","last_clean":"2024-09-20T21:02:14.983540+0000","last_became_active":"2024-09-20T21:01:26.195712+0000","last_became_peered":"2024-09-20T21:01:26.195712+0000","last_unstale":"2024-09-20T21:02:14.983540+0000","last_undegraded":"2024-09-20T21:02:14.983540+0000","last_fullsized":"2024-09-20T21:02:14.983540+0000","mapping_epoch":21,"log_start":"29'2800","ondisk_log_start":"29'2800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:56:20.379997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445775872,"num_objects":6802,"num_object_clones":0,"num_object_copies":13604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6802,"num_write_kb":435328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464472+0000","last_change":"2024-09-20T21:01:11.220548+0000","last_active":"2024-09-20T21:02:13.464472+0000","last_peered":"2024-09-20T21:02:13.464472+0000","last_clean":"2024-09-20T21:02:13.464472+0000","last_became_active":"2024-09-20T21:01:11.219847+0000","last_became_peered":"2024-09-20T21:01:11.219847+0000","last_unstale":"2024-09-20T21:02:13.464472+0000","last_undegraded":"2024-09-20T21:02:13.464472+0000","last_fullsized":"2024-09-20T21:02:13.464472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464298+0000","last_change":"2024-09-20T21:01:26.189300+0000","last_active":"2024-09-20T21:02:13.464298+0000","last_peered":"2024-09-20T21:02:13.464298+0000","last_clean":"2024-09-20T21:02:13.464298+0000","last_became_active":"2024-09-20T21:01:26.186381+0000","last_became_peered":"2024-09-20T21:01:26.186381+0000","last_unstale":"2024-09-20T21:02:13.464298+0000","last_undegraded":"2024-09-20T21:02:13.464298+0000","last_fullsized":"2024-09-20T21:02:13.464298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:15.197998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"42'6748","reported_seq":6796,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.985199+0000","last_change":"2024-09-20T21:01:26.185429+0000","last_active":"2024-09-20T21:02:14.985199+0000","last_peered":"2024-09-20T21:02:14.985199+0000","last_clean":"2024-09-20T21:02:14.985199+0000","last_became_active":"2024-09-20T21:01:26.184548+0000","last_became_peered":"2024-09-20T21:01:26.184548+0000","last_unstale":"2024-09-20T21:02:14.985199+0000","last_undegraded":"2024-09-20T21:02:14.985199+0000","last_fullsized":"2024-09-20T21:02:14.985199+0000","mapping_epoch":21,"log_start":"29'3200","ondisk_log_start":"29'3200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3548,"log_dups_size":0,"ondisk_log_size":3548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:23.837807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442236928,"num_objects":6748,"num_object_clones":0,"num_object_copies":13496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6748,"num_write_kb":431872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465020+0000","last_change":"2024-09-20T21:01:26.187643+0000","last_active":"2024-09-20T21:02:13.465020+0000","last_peered":"2024-09-20T21:02:13.465020+0000","last_clean":"2024-09-20T21:02:13.465020+0000","last_became_active":"2024-09-20T21:01:26.186342+0000","last_became_peered":"2024-09-20T21:01:26.186342+0000","last_unstale":"2024-09-20T21:02:13.465020+0000","last_undegraded":"2024-09-20T21:02:13.465020+0000","last_fullsized":"2024-09-20T21:02:13.465020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:40.496914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.469561+0000","last_change":"2024-09-20T21:02:06.430762+0000","last_active":"2024-09-20T21:02:13.469561+0000","last_peered":"2024-09-20T21:02:13.469561+0000","last_clean":"2024-09-20T21:02:13.469561+0000","last_became_active":"2024-09-20T21:02:06.428935+0000","last_became_peered":"2024-09-20T21:02:06.428935+0000","last_unstale":"2024-09-20T21:02:13.469561+0000","last_undegraded":"2024-09-20T21:02:13.469561+0000","last_fullsized":"2024-09-20T21:02:13.469561+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:17.812272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"42'6782","reported_seq":6832,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.926580+0000","last_change":"2024-09-20T21:01:26.191101+0000","last_active":"2024-09-20T21:02:14.926580+0000","last_peered":"2024-09-20T21:02:14.926580+0000","last_clean":"2024-09-20T21:02:14.926580+0000","last_became_active":"2024-09-20T21:01:26.190000+0000","last_became_peered":"2024-09-20T21:01:26.190000+0000","last_unstale":"2024-09-20T21:02:14.926580+0000","last_undegraded":"2024-09-20T21:02:14.926580+0000","last_fullsized":"2024-09-20T21:02:14.926580+0000","mapping_epoch":21,"log_start":"28'2800","ondisk_log_start":"28'2800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3982,"log_dups_size":0,"ondisk_log_size":3982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:53.347202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444465152,"num_objects":6782,"num_object_clones":0,"num_object_copies":13564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6782,"num_write_kb":434048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468214+0000","last_change":"2024-09-20T21:01:11.213371+0000","last_active":"2024-09-20T21:02:13.468214+0000","last_peered":"2024-09-20T21:02:13.468214+0000","last_clean":"2024-09-20T21:02:13.468214+0000","last_became_active":"2024-09-20T21:01:11.212385+0000","last_became_peered":"2024-09-20T21:01:11.212385+0000","last_unstale":"2024-09-20T21:02:13.468214+0000","last_undegraded":"2024-09-20T21:02:13.468214+0000","last_fullsized":"2024-09-20T21:02:13.468214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:56.734999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466661+0000","last_change":"2024-09-20T21:01:26.190179+0000","last_active":"2024-09-20T21:02:13.466661+0000","last_peered":"2024-09-20T21:02:13.466661+0000","last_clean":"2024-09-20T21:02:13.466661+0000","last_became_active":"2024-09-20T21:01:26.187701+0000","last_became_peered":"2024-09-20T21:01:26.187701+0000","last_unstale":"2024-09-20T21:02:13.466661+0000","last_undegraded":"2024-09-20T21:02:13.466661+0000","last_fullsized":"2024-09-20T21:02:13.466661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:48.846118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"42'6823","reported_seq":6873,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.992113+0000","last_change":"2024-09-20T21:01:26.192961+0000","last_active":"2024-09-20T21:02:14.992113+0000","last_peered":"2024-09-20T21:02:14.992113+0000","last_clean":"2024-09-20T21:02:14.992113+0000","last_became_active":"2024-09-20T21:01:26.192159+0000","last_became_peered":"2024-09-20T21:01:26.192159+0000","last_unstale":"2024-09-20T21:02:14.992113+0000","last_undegraded":"2024-09-20T21:02:14.992113+0000","last_fullsized":"2024-09-20T21:02:14.992113+0000","mapping_epoch":21,"log_start":"28'2800","ondisk_log_start":"28'2800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4023,"log_dups_size":0,"ondisk_log_size":4023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:50.672763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447152128,"num_objects":6823,"num_object_clones":0,"num_object_copies":13646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6823,"num_write_kb":436672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465240+0000","last_change":"2024-09-20T21:02:06.423082+0000","last_active":"2024-09-20T21:02:13.465240+0000","last_peered":"2024-09-20T21:02:13.465240+0000","last_clean":"2024-09-20T21:02:13.465240+0000","last_became_active":"2024-09-20T21:02:06.422272+0000","last_became_peered":"2024-09-20T21:02:06.422272+0000","last_unstale":"2024-09-20T21:02:13.465240+0000","last_undegraded":"2024-09-20T21:02:13.465240+0000","last_fullsized":"2024-09-20T21:02:13.465240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:30.668000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463726+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:02:13.463726+0000","last_peered":"2024-09-20T21:02:13.463726+0000","last_clean":"2024-09-20T21:02:13.463726+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:02:13.463726+0000","last_undegraded":"2024-09-20T21:02:13.463726+0000","last_fullsized":"2024-09-20T21:02:13.463726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"42'6869","reported_seq":6924,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.951798+0000","last_change":"2024-09-20T21:02:06.435625+0000","last_active":"2024-09-20T21:02:14.951798+0000","last_peered":"2024-09-20T21:02:14.951798+0000","last_clean":"2024-09-20T21:02:14.951798+0000","last_became_active":"2024-09-20T21:02:06.427061+0000","last_became_peered":"2024-09-20T21:02:06.427061+0000","last_unstale":"2024-09-20T21:02:14.951798+0000","last_undegraded":"2024-09-20T21:02:14.951798+0000","last_fullsized":"2024-09-20T21:02:14.951798+0000","mapping_epoch":38,"log_start":"30'3300","ondisk_log_start":"30'3300","created":21,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3569,"log_dups_size":0,"ondisk_log_size":3569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:30.601057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450166784,"num_objects":6869,"num_object_clones":0,"num_object_copies":13738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6869,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6869,"num_write_kb":439616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":241,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466851+0000","last_change":"2024-09-20T21:02:06.428928+0000","last_active":"2024-09-20T21:02:13.466851+0000","last_peered":"2024-09-20T21:02:13.466851+0000","last_clean":"2024-09-20T21:02:13.466851+0000","last_became_active":"2024-09-20T21:02:06.427974+0000","last_became_peered":"2024-09-20T21:02:06.427974+0000","last_unstale":"2024-09-20T21:02:13.466851+0000","last_undegraded":"2024-09-20T21:02:13.466851+0000","last_fullsized":"2024-09-20T21:02:13.466851+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:16.676481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464631+0000","last_change":"2024-09-20T21:01:26.198209+0000","last_active":"2024-09-20T21:02:13.464631+0000","last_peered":"2024-09-20T21:02:13.464631+0000","last_clean":"2024-09-20T21:02:13.464631+0000","last_became_active":"2024-09-20T21:01:26.197583+0000","last_became_peered":"2024-09-20T21:01:26.197583+0000","last_unstale":"2024-09-20T21:02:13.464631+0000","last_undegraded":"2024-09-20T21:02:13.464631+0000","last_fullsized":"2024-09-20T21:02:13.464631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:56:01.208657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465277+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:02:13.465277+0000","last_peered":"2024-09-20T21:02:13.465277+0000","last_clean":"2024-09-20T21:02:13.465277+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:02:13.465277+0000","last_undegraded":"2024-09-20T21:02:13.465277+0000","last_fullsized":"2024-09-20T21:02:13.465277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.469669+0000","last_change":"2024-09-20T21:02:06.430898+0000","last_active":"2024-09-20T21:02:13.469669+0000","last_peered":"2024-09-20T21:02:13.469669+0000","last_clean":"2024-09-20T21:02:13.469669+0000","last_became_active":"2024-09-20T21:02:06.429589+0000","last_became_peered":"2024-09-20T21:02:06.429589+0000","last_unstale":"2024-09-20T21:02:13.469669+0000","last_undegraded":"2024-09-20T21:02:13.469669+0000","last_fullsized":"2024-09-20T21:02:13.469669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:41:54.555337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"42'6806","reported_seq":6856,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.968442+0000","last_change":"2024-09-20T21:01:26.185969+0000","last_active":"2024-09-20T21:02:14.968442+0000","last_peered":"2024-09-20T21:02:14.968442+0000","last_clean":"2024-09-20T21:02:14.968442+0000","last_became_active":"2024-09-20T21:01:26.185337+0000","last_became_peered":"2024-09-20T21:01:26.185337+0000","last_unstale":"2024-09-20T21:02:14.968442+0000","last_undegraded":"2024-09-20T21:02:14.968442+0000","last_fullsized":"2024-09-20T21:02:14.968442+0000","mapping_epoch":21,"log_start":"29'3200","ondisk_log_start":"29'3200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.883963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446038016,"num_objects":6806,"num_object_clones":0,"num_object_copies":13612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6806,"num_write_kb":435584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466827+0000","last_change":"2024-09-20T21:02:06.425059+0000","last_active":"2024-09-20T21:02:13.466827+0000","last_peered":"2024-09-20T21:02:13.466827+0000","last_clean":"2024-09-20T21:02:13.466827+0000","last_became_active":"2024-09-20T21:02:06.424456+0000","last_became_peered":"2024-09-20T21:02:06.424456+0000","last_unstale":"2024-09-20T21:02:13.466827+0000","last_undegraded":"2024-09-20T21:02:13.466827+0000","last_fullsized":"2024-09-20T21:02:13.466827+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:07.427703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463539+0000","last_change":"2024-09-20T21:01:11.220462+0000","last_active":"2024-09-20T21:02:13.463539+0000","last_peered":"2024-09-20T21:02:13.463539+0000","last_clean":"2024-09-20T21:02:13.463539+0000","last_became_active":"2024-09-20T21:01:11.219778+0000","last_became_peered":"2024-09-20T21:01:11.219778+0000","last_unstale":"2024-09-20T21:02:13.463539+0000","last_undegraded":"2024-09-20T21:02:13.463539+0000","last_fullsized":"2024-09-20T21:02:13.463539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:08.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467102+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:02:13.467102+0000","last_peered":"2024-09-20T21:02:13.467102+0000","last_clean":"2024-09-20T21:02:13.467102+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:02:13.467102+0000","last_undegraded":"2024-09-20T21:02:13.467102+0000","last_fullsized":"2024-09-20T21:02:13.467102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"42'6776","reported_seq":6826,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.976282+0000","last_change":"2024-09-20T21:01:26.193658+0000","last_active":"2024-09-20T21:02:14.976282+0000","last_peered":"2024-09-20T21:02:14.976282+0000","last_clean":"2024-09-20T21:02:14.976282+0000","last_became_active":"2024-09-20T21:01:26.193005+0000","last_became_peered":"2024-09-20T21:01:26.193005+0000","last_unstale":"2024-09-20T21:02:14.976282+0000","last_undegraded":"2024-09-20T21:02:14.976282+0000","last_fullsized":"2024-09-20T21:02:14.976282+0000","mapping_epoch":21,"log_start":"29'3200","ondisk_log_start":"29'3200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3576,"log_dups_size":0,"ondisk_log_size":3576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:46.866571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444071936,"num_objects":6776,"num_object_clones":0,"num_object_copies":13552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6776,"num_write_kb":433664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463729+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:02:13.463729+0000","last_peered":"2024-09-20T21:02:13.463729+0000","last_clean":"2024-09-20T21:02:13.463729+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:02:13.463729+0000","last_undegraded":"2024-09-20T21:02:13.463729+0000","last_fullsized":"2024-09-20T21:02:13.463729+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468611+0000","last_change":"2024-09-20T21:01:11.217295+0000","last_active":"2024-09-20T21:02:13.468611+0000","last_peered":"2024-09-20T21:02:13.468611+0000","last_clean":"2024-09-20T21:02:13.468611+0000","last_became_active":"2024-09-20T21:01:11.216350+0000","last_became_peered":"2024-09-20T21:01:11.216350+0000","last_unstale":"2024-09-20T21:02:13.468611+0000","last_undegraded":"2024-09-20T21:02:13.468611+0000","last_fullsized":"2024-09-20T21:02:13.468611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:59.661622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463899+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:02:13.463899+0000","last_peered":"2024-09-20T21:02:13.463899+0000","last_clean":"2024-09-20T21:02:13.463899+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:02:13.463899+0000","last_undegraded":"2024-09-20T21:02:13.463899+0000","last_fullsized":"2024-09-20T21:02:13.463899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"42'6831","reported_seq":6881,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.968507+0000","last_change":"2024-09-20T21:01:26.195204+0000","last_active":"2024-09-20T21:02:14.968507+0000","last_peered":"2024-09-20T21:02:14.968507+0000","last_clean":"2024-09-20T21:02:14.968507+0000","last_became_active":"2024-09-20T21:01:26.193385+0000","last_became_peered":"2024-09-20T21:01:26.193385+0000","last_unstale":"2024-09-20T21:02:14.968507+0000","last_undegraded":"2024-09-20T21:02:14.968507+0000","last_fullsized":"2024-09-20T21:02:14.968507+0000","mapping_epoch":21,"log_start":"30'3300","ondisk_log_start":"30'3300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3531,"log_dups_size":0,"ondisk_log_size":3531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:50.379400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447676416,"num_objects":6831,"num_object_clones":0,"num_object_copies":13662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6831,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6831,"num_write_kb":437184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465293+0000","last_change":"2024-09-20T21:01:26.193870+0000","last_active":"2024-09-20T21:02:13.465293+0000","last_peered":"2024-09-20T21:02:13.465293+0000","last_clean":"2024-09-20T21:02:13.465293+0000","last_became_active":"2024-09-20T21:01:26.193552+0000","last_became_peered":"2024-09-20T21:01:26.193552+0000","last_unstale":"2024-09-20T21:02:13.465293+0000","last_undegraded":"2024-09-20T21:02:13.465293+0000","last_fullsized":"2024-09-20T21:02:13.465293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:32:52.139650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464228+0000","last_change":"2024-09-20T21:01:26.198203+0000","last_active":"2024-09-20T21:02:13.464228+0000","last_peered":"2024-09-20T21:02:13.464228+0000","last_clean":"2024-09-20T21:02:13.464228+0000","last_became_active":"2024-09-20T21:01:26.196361+0000","last_became_peered":"2024-09-20T21:01:26.196361+0000","last_unstale":"2024-09-20T21:02:13.464228+0000","last_undegraded":"2024-09-20T21:02:13.464228+0000","last_fullsized":"2024-09-20T21:02:13.464228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:35.683600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464470+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:02:13.464470+0000","last_peered":"2024-09-20T21:02:13.464470+0000","last_clean":"2024-09-20T21:02:13.464470+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:02:13.464470+0000","last_undegraded":"2024-09-20T21:02:13.464470+0000","last_fullsized":"2024-09-20T21:02:13.464470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"42'6794","reported_seq":6844,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.969141+0000","last_change":"2024-09-20T21:01:26.187690+0000","last_active":"2024-09-20T21:02:14.969141+0000","last_peered":"2024-09-20T21:02:14.969141+0000","last_clean":"2024-09-20T21:02:14.969141+0000","last_became_active":"2024-09-20T21:01:26.184491+0000","last_became_peered":"2024-09-20T21:01:26.184491+0000","last_unstale":"2024-09-20T21:02:14.969141+0000","last_undegraded":"2024-09-20T21:02:14.969141+0000","last_fullsized":"2024-09-20T21:02:14.969141+0000","mapping_epoch":21,"log_start":"29'3200","ondisk_log_start":"29'3200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3594,"log_dups_size":0,"ondisk_log_size":3594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:53:38.207514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445251584,"num_objects":6794,"num_object_clones":0,"num_object_copies":13588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6794,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6794,"num_write_kb":434816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463911+0000","last_change":"2024-09-20T21:01:26.195383+0000","last_active":"2024-09-20T21:02:13.463911+0000","last_peered":"2024-09-20T21:02:13.463911+0000","last_clean":"2024-09-20T21:02:13.463911+0000","last_became_active":"2024-09-20T21:01:26.193485+0000","last_became_peered":"2024-09-20T21:01:26.193485+0000","last_unstale":"2024-09-20T21:02:13.463911+0000","last_undegraded":"2024-09-20T21:02:13.463911+0000","last_fullsized":"2024-09-20T21:02:13.463911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:39.527762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464549+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:02:13.464549+0000","last_peered":"2024-09-20T21:02:13.464549+0000","last_clean":"2024-09-20T21:02:13.464549+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:02:13.464549+0000","last_undegraded":"2024-09-20T21:02:13.464549+0000","last_fullsized":"2024-09-20T21:02:13.464549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468112+0000","last_change":"2024-09-20T21:01:12.227746+0000","last_active":"2024-09-20T21:02:13.468112+0000","last_peered":"2024-09-20T21:02:13.468112+0000","last_clean":"2024-09-20T21:02:13.468112+0000","last_became_active":"2024-09-20T21:01:12.226860+0000","last_became_peered":"2024-09-20T21:01:12.226860+0000","last_unstale":"2024-09-20T21:02:13.468112+0000","last_undegraded":"2024-09-20T21:02:13.468112+0000","last_fullsized":"2024-09-20T21:02:13.468112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:02.144980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"42'6851","reported_seq":6901,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.971601+0000","last_change":"2024-09-20T21:01:26.185208+0000","last_active":"2024-09-20T21:02:14.971601+0000","last_peered":"2024-09-20T21:02:14.971601+0000","last_clean":"2024-09-20T21:02:14.971601+0000","last_became_active":"2024-09-20T21:01:26.184547+0000","last_became_peered":"2024-09-20T21:01:26.184547+0000","last_unstale":"2024-09-20T21:02:14.971601+0000","last_undegraded":"2024-09-20T21:02:14.971601+0000","last_fullsized":"2024-09-20T21:02:14.971601+0000","mapping_epoch":21,"log_start":"30'3300","ondisk_log_start":"30'3300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:11.520890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448987136,"num_objects":6851,"num_object_clones":0,"num_object_copies":13702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6851,"num_write_kb":438464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464551+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:02:13.464551+0000","last_peered":"2024-09-20T21:02:13.464551+0000","last_clean":"2024-09-20T21:02:13.464551+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:02:13.464551+0000","last_undegraded":"2024-09-20T21:02:13.464551+0000","last_fullsized":"2024-09-20T21:02:13.464551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464103+0000","last_change":"2024-09-20T21:02:06.430321+0000","last_active":"2024-09-20T21:02:13.464103+0000","last_peered":"2024-09-20T21:02:13.464103+0000","last_clean":"2024-09-20T21:02:13.464103+0000","last_became_active":"2024-09-20T21:02:06.429077+0000","last_became_peered":"2024-09-20T21:02:06.429077+0000","last_unstale":"2024-09-20T21:02:13.464103+0000","last_undegraded":"2024-09-20T21:02:13.464103+0000","last_fullsized":"2024-09-20T21:02:13.464103+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:28.024220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466020+0000","last_change":"2024-09-20T21:01:12.227533+0000","last_active":"2024-09-20T21:02:13.466020+0000","last_peered":"2024-09-20T21:02:13.466020+0000","last_clean":"2024-09-20T21:02:13.466020+0000","last_became_active":"2024-09-20T21:01:12.226676+0000","last_became_peered":"2024-09-20T21:01:12.226676+0000","last_unstale":"2024-09-20T21:02:13.466020+0000","last_undegraded":"2024-09-20T21:02:13.466020+0000","last_fullsized":"2024-09-20T21:02:13.466020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:17:52.399228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"42'6932","reported_seq":6982,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.960228+0000","last_change":"2024-09-20T21:01:26.187915+0000","last_active":"2024-09-20T21:02:14.960228+0000","last_peered":"2024-09-20T21:02:14.960228+0000","last_clean":"2024-09-20T21:02:14.960228+0000","last_became_active":"2024-09-20T21:01:26.185921+0000","last_became_peered":"2024-09-20T21:01:26.185921+0000","last_unstale":"2024-09-20T21:02:14.960228+0000","last_undegraded":"2024-09-20T21:02:14.960228+0000","last_fullsized":"2024-09-20T21:02:14.960228+0000","mapping_epoch":21,"log_start":"30'3400","ondisk_log_start":"30'3400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:53.347202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":454295552,"num_objects":6932,"num_object_clones":0,"num_object_copies":13864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6932,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6932,"num_write_kb":443648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464365+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:02:13.464365+0000","last_peered":"2024-09-20T21:02:13.464365+0000","last_clean":"2024-09-20T21:02:13.464365+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:02:13.464365+0000","last_undegraded":"2024-09-20T21:02:13.464365+0000","last_fullsized":"2024-09-20T21:02:13.464365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465690+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:02:13.465690+0000","last_peered":"2024-09-20T21:02:13.465690+0000","last_clean":"2024-09-20T21:02:13.465690+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:02:13.465690+0000","last_undegraded":"2024-09-20T21:02:13.465690+0000","last_fullsized":"2024-09-20T21:02:13.465690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465372+0000","last_change":"2024-09-20T21:01:12.227354+0000","last_active":"2024-09-20T21:02:13.465372+0000","last_peered":"2024-09-20T21:02:13.465372+0000","last_clean":"2024-09-20T21:02:13.465372+0000","last_became_active":"2024-09-20T21:01:12.226078+0000","last_became_peered":"2024-09-20T21:01:12.226078+0000","last_unstale":"2024-09-20T21:02:13.465372+0000","last_undegraded":"2024-09-20T21:02:13.465372+0000","last_fullsized":"2024-09-20T21:02:13.465372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:48.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"42'6802","reported_seq":6852,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:14.984185+0000","last_change":"2024-09-20T21:01:26.199069+0000","last_active":"2024-09-20T21:02:14.984185+0000","last_peered":"2024-09-20T21:02:14.984185+0000","last_clean":"2024-09-20T21:02:14.984185+0000","last_became_active":"2024-09-20T21:01:26.198393+0000","last_became_peered":"2024-09-20T21:01:26.198393+0000","last_unstale":"2024-09-20T21:02:14.984185+0000","last_undegraded":"2024-09-20T21:02:14.984185+0000","last_fullsized":"2024-09-20T21:02:14.984185+0000","mapping_epoch":21,"log_start":"29'2800","ondisk_log_start":"29'2800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:31.789539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445775872,"num_objects":6802,"num_object_clones":0,"num_object_copies":13604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6802,"num_write_kb":435328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465680+0000","last_change":"2024-09-20T21:01:11.220479+0000","last_active":"2024-09-20T21:02:13.465680+0000","last_peered":"2024-09-20T21:02:13.465680+0000","last_clean":"2024-09-20T21:02:13.465680+0000","last_became_active":"2024-09-20T21:01:11.219658+0000","last_became_peered":"2024-09-20T21:01:11.219658+0000","last_unstale":"2024-09-20T21:02:13.465680+0000","last_undegraded":"2024-09-20T21:02:13.465680+0000","last_fullsized":"2024-09-20T21:02:13.465680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:41.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.469210+0000","last_change":"2024-09-20T21:02:06.431559+0000","last_active":"2024-09-20T21:02:13.469210+0000","last_peered":"2024-09-20T21:02:13.469210+0000","last_clean":"2024-09-20T21:02:13.469210+0000","last_became_active":"2024-09-20T21:02:06.428211+0000","last_became_peered":"2024-09-20T21:02:06.428211+0000","last_unstale":"2024-09-20T21:02:13.469210+0000","last_undegraded":"2024-09-20T21:02:13.469210+0000","last_fullsized":"2024-09-20T21:02:13.469210+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:31.501423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468113+0000","last_change":"2024-09-20T21:01:12.228307+0000","last_active":"2024-09-20T21:02:13.468113+0000","last_peered":"2024-09-20T21:02:13.468113+0000","last_clean":"2024-09-20T21:02:13.468113+0000","last_became_active":"2024-09-20T21:01:12.226322+0000","last_became_peered":"2024-09-20T21:01:12.226322+0000","last_unstale":"2024-09-20T21:02:13.468113+0000","last_undegraded":"2024-09-20T21:02:13.468113+0000","last_fullsized":"2024-09-20T21:02:13.468113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:52.194070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466975+0000","last_change":"2024-09-20T21:02:06.425447+0000","last_active":"2024-09-20T21:02:13.466975+0000","last_peered":"2024-09-20T21:02:13.466975+0000","last_clean":"2024-09-20T21:02:13.466975+0000","last_became_active":"2024-09-20T21:02:06.424623+0000","last_became_peered":"2024-09-20T21:02:06.424623+0000","last_unstale":"2024-09-20T21:02:13.466975+0000","last_undegraded":"2024-09-20T21:02:13.466975+0000","last_fullsized":"2024-09-20T21:02:13.466975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:28.674101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467390+0000","last_change":"2024-09-20T21:02:06.428165+0000","last_active":"2024-09-20T21:02:13.467390+0000","last_peered":"2024-09-20T21:02:13.467390+0000","last_clean":"2024-09-20T21:02:13.467390+0000","last_became_active":"2024-09-20T21:02:06.427296+0000","last_became_peered":"2024-09-20T21:02:06.427296+0000","last_unstale":"2024-09-20T21:02:13.467390+0000","last_undegraded":"2024-09-20T21:02:13.467390+0000","last_fullsized":"2024-09-20T21:02:13.467390+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:23.459169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465101+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:02:13.465101+0000","last_peered":"2024-09-20T21:02:13.465101+0000","last_clean":"2024-09-20T21:02:13.465101+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:02:13.465101+0000","last_undegraded":"2024-09-20T21:02:13.465101+0000","last_fullsized":"2024-09-20T21:02:13.465101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":63,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.467028+0000","last_change":"2024-09-20T21:01:11.220027+0000","last_active":"2024-09-20T21:02:13.467028+0000","last_peered":"2024-09-20T21:02:13.467028+0000","last_clean":"2024-09-20T21:02:13.467028+0000","last_became_active":"2024-09-20T21:01:11.218551+0000","last_became_peered":"2024-09-20T21:01:11.218551+0000","last_unstale":"2024-09-20T21:02:13.467028+0000","last_undegraded":"2024-09-20T21:02:13.467028+0000","last_fullsized":"2024-09-20T21:02:13.467028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:47:59.918561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465506+0000","last_change":"2024-09-20T21:01:26.193337+0000","last_active":"2024-09-20T21:02:13.465506+0000","last_peered":"2024-09-20T21:02:13.465506+0000","last_clean":"2024-09-20T21:02:13.465506+0000","last_became_active":"2024-09-20T21:01:26.192862+0000","last_became_peered":"2024-09-20T21:01:26.192862+0000","last_unstale":"2024-09-20T21:02:13.465506+0000","last_undegraded":"2024-09-20T21:02:13.465506+0000","last_fullsized":"2024-09-20T21:02:13.465506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:11.609879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463308+0000","last_change":"2024-09-20T21:01:12.211553+0000","last_active":"2024-09-20T21:02:13.463308+0000","last_peered":"2024-09-20T21:02:13.463308+0000","last_clean":"2024-09-20T21:02:13.463308+0000","last_became_active":"2024-09-20T21:01:12.210101+0000","last_became_peered":"2024-09-20T21:01:12.210101+0000","last_unstale":"2024-09-20T21:02:13.463308+0000","last_undegraded":"2024-09-20T21:02:13.463308+0000","last_fullsized":"2024-09-20T21:02:13.463308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:36.991707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464202+0000","last_change":"2024-09-20T21:01:11.221867+0000","last_active":"2024-09-20T21:02:13.464202+0000","last_peered":"2024-09-20T21:02:13.464202+0000","last_clean":"2024-09-20T21:02:13.464202+0000","last_became_active":"2024-09-20T21:01:11.220980+0000","last_became_peered":"2024-09-20T21:01:11.220980+0000","last_unstale":"2024-09-20T21:02:13.464202+0000","last_undegraded":"2024-09-20T21:02:13.464202+0000","last_fullsized":"2024-09-20T21:02:13.464202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:34.618976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465298+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:02:13.465298+0000","last_peered":"2024-09-20T21:02:13.465298+0000","last_clean":"2024-09-20T21:02:13.465298+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:02:13.465298+0000","last_undegraded":"2024-09-20T21:02:13.465298+0000","last_fullsized":"2024-09-20T21:02:13.465298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.468566+0000","last_change":"2024-09-20T21:01:12.236819+0000","last_active":"2024-09-20T21:02:13.468566+0000","last_peered":"2024-09-20T21:02:13.468566+0000","last_clean":"2024-09-20T21:02:13.468566+0000","last_became_active":"2024-09-20T21:01:12.233922+0000","last_became_peered":"2024-09-20T21:01:12.233922+0000","last_unstale":"2024-09-20T21:02:13.468566+0000","last_undegraded":"2024-09-20T21:02:13.468566+0000","last_fullsized":"2024-09-20T21:02:13.468566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:13.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465388+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:02:13.465388+0000","last_peered":"2024-09-20T21:02:13.465388+0000","last_clean":"2024-09-20T21:02:13.465388+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:02:13.465388+0000","last_undegraded":"2024-09-20T21:02:13.465388+0000","last_fullsized":"2024-09-20T21:02:13.465388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465480+0000","last_change":"2024-09-20T21:01:12.227395+0000","last_active":"2024-09-20T21:02:13.465480+0000","last_peered":"2024-09-20T21:02:13.465480+0000","last_clean":"2024-09-20T21:02:13.465480+0000","last_became_active":"2024-09-20T21:01:12.226122+0000","last_became_peered":"2024-09-20T21:01:12.226122+0000","last_unstale":"2024-09-20T21:02:13.465480+0000","last_undegraded":"2024-09-20T21:02:13.465480+0000","last_fullsized":"2024-09-20T21:02:13.465480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463462+0000","last_change":"2024-09-20T21:01:11.220367+0000","last_active":"2024-09-20T21:02:13.463462+0000","last_peered":"2024-09-20T21:02:13.463462+0000","last_clean":"2024-09-20T21:02:13.463462+0000","last_became_active":"2024-09-20T21:01:11.219090+0000","last_became_peered":"2024-09-20T21:01:11.219090+0000","last_unstale":"2024-09-20T21:02:13.463462+0000","last_undegraded":"2024-09-20T21:02:13.463462+0000","last_fullsized":"2024-09-20T21:02:13.463462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:58:43.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466853+0000","last_change":"2024-09-20T21:01:12.238895+0000","last_active":"2024-09-20T21:02:13.466853+0000","last_peered":"2024-09-20T21:02:13.466853+0000","last_clean":"2024-09-20T21:02:13.466853+0000","last_became_active":"2024-09-20T21:01:12.235481+0000","last_became_peered":"2024-09-20T21:01:12.235481+0000","last_unstale":"2024-09-20T21:02:13.466853+0000","last_undegraded":"2024-09-20T21:02:13.466853+0000","last_fullsized":"2024-09-20T21:02:13.466853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464993+0000","last_change":"2024-09-20T21:02:06.421747+0000","last_active":"2024-09-20T21:02:13.464993+0000","last_peered":"2024-09-20T21:02:13.464993+0000","last_clean":"2024-09-20T21:02:13.464993+0000","last_became_active":"2024-09-20T21:02:06.421099+0000","last_became_peered":"2024-09-20T21:02:06.421099+0000","last_unstale":"2024-09-20T21:02:13.464993+0000","last_undegraded":"2024-09-20T21:02:13.464993+0000","last_fullsized":"2024-09-20T21:02:13.464993+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:19.204963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463937+0000","last_change":"2024-09-20T21:02:06.429129+0000","last_active":"2024-09-20T21:02:13.463937+0000","last_peered":"2024-09-20T21:02:13.463937+0000","last_clean":"2024-09-20T21:02:13.463937+0000","last_became_active":"2024-09-20T21:02:06.426810+0000","last_became_peered":"2024-09-20T21:02:06.426810+0000","last_unstale":"2024-09-20T21:02:13.463937+0000","last_undegraded":"2024-09-20T21:02:13.463937+0000","last_fullsized":"2024-09-20T21:02:13.463937+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:48.423546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466112+0000","last_change":"2024-09-20T21:01:11.218440+0000","last_active":"2024-09-20T21:02:13.466112+0000","last_peered":"2024-09-20T21:02:13.466112+0000","last_clean":"2024-09-20T21:02:13.466112+0000","last_became_active":"2024-09-20T21:01:11.217722+0000","last_became_peered":"2024-09-20T21:01:11.217722+0000","last_unstale":"2024-09-20T21:02:13.466112+0000","last_undegraded":"2024-09-20T21:02:13.466112+0000","last_fullsized":"2024-09-20T21:02:13.466112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:11:02.101254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463538+0000","last_change":"2024-09-20T21:01:26.195014+0000","last_active":"2024-09-20T21:02:13.463538+0000","last_peered":"2024-09-20T21:02:13.463538+0000","last_clean":"2024-09-20T21:02:13.463538+0000","last_became_active":"2024-09-20T21:01:26.192848+0000","last_became_peered":"2024-09-20T21:01:26.192848+0000","last_unstale":"2024-09-20T21:02:13.463538+0000","last_undegraded":"2024-09-20T21:02:13.463538+0000","last_fullsized":"2024-09-20T21:02:13.463538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:28.674101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464421+0000","last_change":"2024-09-20T21:01:26.197383+0000","last_active":"2024-09-20T21:02:13.464421+0000","last_peered":"2024-09-20T21:02:13.464421+0000","last_clean":"2024-09-20T21:02:13.464421+0000","last_became_active":"2024-09-20T21:01:26.196662+0000","last_became_peered":"2024-09-20T21:01:26.196662+0000","last_unstale":"2024-09-20T21:02:13.464421+0000","last_undegraded":"2024-09-20T21:02:13.464421+0000","last_fullsized":"2024-09-20T21:02:13.464421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:35.350487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465118+0000","last_change":"2024-09-20T21:01:26.187436+0000","last_active":"2024-09-20T21:02:13.465118+0000","last_peered":"2024-09-20T21:02:13.465118+0000","last_clean":"2024-09-20T21:02:13.465118+0000","last_became_active":"2024-09-20T21:01:26.186319+0000","last_became_peered":"2024-09-20T21:01:26.186319+0000","last_unstale":"2024-09-20T21:02:13.465118+0000","last_undegraded":"2024-09-20T21:02:13.465118+0000","last_fullsized":"2024-09-20T21:02:13.465118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:49:04.716145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.466936+0000","last_change":"2024-09-20T21:01:11.220332+0000","last_active":"2024-09-20T21:02:13.466936+0000","last_peered":"2024-09-20T21:02:13.466936+0000","last_clean":"2024-09-20T21:02:13.466936+0000","last_became_active":"2024-09-20T21:01:11.219022+0000","last_became_peered":"2024-09-20T21:01:11.219022+0000","last_unstale":"2024-09-20T21:02:13.466936+0000","last_undegraded":"2024-09-20T21:02:13.466936+0000","last_fullsized":"2024-09-20T21:02:13.466936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.928114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.463646+0000","last_change":"2024-09-20T21:02:06.427461+0000","last_active":"2024-09-20T21:02:13.463646+0000","last_peered":"2024-09-20T21:02:13.463646+0000","last_clean":"2024-09-20T21:02:13.463646+0000","last_became_active":"2024-09-20T21:02:06.426709+0000","last_became_peered":"2024-09-20T21:02:06.426709+0000","last_unstale":"2024-09-20T21:02:13.463646+0000","last_undegraded":"2024-09-20T21:02:13.463646+0000","last_fullsized":"2024-09-20T21:02:13.463646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:25:05.037879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465611+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:02:13.465611+0000","last_peered":"2024-09-20T21:02:13.465611+0000","last_clean":"2024-09-20T21:02:13.465611+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:02:13.465611+0000","last_undegraded":"2024-09-20T21:02:13.465611+0000","last_fullsized":"2024-09-20T21:02:13.465611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.465278+0000","last_change":"2024-09-20T21:01:26.190436+0000","last_active":"2024-09-20T21:02:13.465278+0000","last_peered":"2024-09-20T21:02:13.465278+0000","last_clean":"2024-09-20T21:02:13.465278+0000","last_became_active":"2024-09-20T21:01:26.186848+0000","last_became_peered":"2024-09-20T21:01:26.186848+0000","last_unstale":"2024-09-20T21:02:13.465278+0000","last_undegraded":"2024-09-20T21:02:13.465278+0000","last_fullsized":"2024-09-20T21:02:13.465278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:03:53.389519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":64,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-20T21:02:13.464086+0000","last_change":"2024-09-20T21:01:11.222738+0000","last_active":"2024-09-20T21:02:13.464086+0000","last_peered":"2024-09-20T21:02:13.464086+0000","last_clean":"2024-09-20T21:02:13.464086+0000","last_became_active":"2024-09-20T21:01:11.221990+0000","last_became_peered":"2024-09-20T21:01:11.221990+0000","last_unstale":"2024-09-20T21:02:13.464086+0000","last_undegraded":"2024-09-20T21:02:13.464086+0000","last_fullsized":"2024-09-20T21:02:13.464086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:39.720445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7159939072,"num_objects":109252,"num_object_clones":0,"num_object_copies":218504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109252,"num_write_kb":6992128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":894930944,"data_stored":14318895104,"data_compressed":68601815,"data_compressed_allocated":894930944,"data_compressed_original":14318895104,"omap_allocated":0,"internal_metadata":0},"log_size":59425,"ondisk_log_size":59425,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341604,"kb_used_data":242384,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94030236,"statfs":{"total":96636764160,"available":96286961664,"internally_reserved":0,"allocated":248201216,"data_stored":3963522809,"data_compressed":18995679,"data_compressed_allocated":247713792,"data_compressed_original":3963338752,"omap_allocated":1596,"internal_metadata":101579204},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":372440,"kb_used_data":269060,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":93999400,"statfs":{"total":96636764160,"available":96255385600,"internally_reserved":0,"allocated":275517440,"data_stored":4400386420,"data_compressed":21088828,"data_compressed_allocated":275017728,"data_compressed_original":4400201728,"omap_allocated":1596,"internal_metadata":105839044},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":498752,"kb_used_data":350956,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93873088,"statfs":{"total":96636764160,"available":96126042112,"internally_reserved":0,"allocated":359378944,"data_stored":5742954578,"data_compressed":27512461,"data_compressed_allocated":358924288,"data_compressed_original":5742788608,"omap_allocated":1596,"internal_metadata":151321028},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":364032000,"data_stored":5824512000,"data_compressed":27905266,"data_compressed_allocated":364032000,"data_compressed_original":5824512000,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278904832,"data_stored":4462477312,"data_compressed":21379729,"data_compressed_allocated":278904832,"data_compressed_original":4462477312,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":251994112,"data_stored":4031905792,"data_compressed":19316820,"data_compressed_allocated":251994112,"data_compressed_original":4031905792,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:02:19.257 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-20T21:02:19.257 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:02:19.257 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-09-20T21:02:19.258 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi161.front.sepia.ceph.com 2024-09-20T21:02:19.258 INFO:teuthology.orchestra.console.smithi161:Power off 2024-09-20T21:02:19.258 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-20T21:02:19.274 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:19.269+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:19.282 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-09-20T21:02:19.356 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:19.356 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:19.374 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:19.369+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:19.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:19.474 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:19.469+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:19.506 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:02:19.573 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:19.573 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:19.575 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:19.569+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:19.594 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:19.676 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:19.674+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:19.752 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:19.752 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:19.771 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:19.776 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:19.773+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:19.877 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:19.874+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:19.962 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:19.962 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:19.978 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:19.978+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:19.982 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:20.079 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:20.073+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:20.175 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:20.175 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:20.180 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:20.177+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:20.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:20.246 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 53 16 120039 120023 141.522 125.938 0.00748322 0.00706182 2024-09-20T21:02:20.283 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:20.277+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:20.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:20.347 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:20.347 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:20.366 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:20.408 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:20.405+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:20.483 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:20.482+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:20.504 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:20.504 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:20.524 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:20.525 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:20.543 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:20.543 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:20.566 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:20.566 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:20.583 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:20.582+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:20.587 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:20.685 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:20.682+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:20.746 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:20.746 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:20.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:20.746 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 68.548971107, 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:20.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:20.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 68.548836907999998, 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:20.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:20.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 68.548731902, 2024-09-20T21:02:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:20.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:20.765 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 68.548612376999998, 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:20.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:20.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 68.548542370000007, 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.777 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 68.548467317999993, 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:20.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:20.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:20.784 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 68.548380292000004, 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:20.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:20.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 68.548311518999995, 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:20.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:20.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:20.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0305648559999998, 2024-09-20T21:02:20.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.798 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0277292130000006, 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:20.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:20.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:20.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:20.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:20.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:20.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0272794080000001, 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.805 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:20.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0271762429999995, 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:20.811 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.816 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0270882570000008, 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:20.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:20.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:20.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:20.822 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0262757530000002, 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.826 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0245071939999999, 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.827 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:20.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.832 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0240426750000005, 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:20.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:20.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:20.838 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0238468039999997, 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:20.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0233649410000005, 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.844 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:20.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0212168810000009, 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.850 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:20.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0180855970000007, 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:20.856 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:20.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:20.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:20.860 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:20.862 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:20.863 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:20.862+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:20.962 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:20.962+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:121580 5.d 5:b67e3151:::benchmark_data_smithi112_23632_object121579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:21.014351+0000", 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0047201989999999996, 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004750003, 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.019 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 121580 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.014351+0000", 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.014351+0000", 2024-09-20T21:02:21.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.014352+0000", 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9899999999999999e-07 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.014437+0000", 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5047000000000001e-05 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.014446+0000", 2024-09-20T21:02:21.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9029999999999993e-06 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.014451+0000", 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1819999999999997e-06 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015805+0000", 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013536869999999999 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015932+0000", 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012733300000000001 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.016068+0000", 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013613000000000001 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018339+0000", 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022705749999999999 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.023 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:121582 5.4 e46/38 5:2595aa1d:::benchmark_data_smithi112_23632_object121581:head v 46'7664, mlcod=46'7662)", 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:21.015218+0000", 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0038532250000000001, 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0039515269999999998, 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015218+0000", 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015218+0000", 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015218+0000", 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1399999999999997e-07 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015283+0000", 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4645000000000002e-05 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015291+0000", 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7970000000000001e-06 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015295+0000", 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5560000000000001e-06 2024-09-20T21:02:21.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015351+0000", 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5408999999999998e-05 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015363+0000", 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2401999999999999e-05 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:121583 5.f 5:f0610880:::benchmark_data_smithi112_23632_object121582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:21.015440+0000", 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0036314569999999998, 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0037682670000000001, 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 121583 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015440+0000", 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015440+0000", 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015441+0000", 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.066e-06 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015519+0000", 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8442999999999994e-05 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015533+0000", 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.331e-05 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.015543+0000", 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0849000000000001e-05 2024-09-20T21:02:21.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.016363+0000", 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000819402 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.016512+0000", 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014929200000000001 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.016678+0000", 2024-09-20T21:02:21.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000165487 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.019158+0000", 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024799090000000002 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:121584 5.4 e46/38 5:22cd1e54:::benchmark_data_smithi112_23632_object121583:head v 46'7665, mlcod=46'7662)", 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:21.017358+0000", 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001713221, 2024-09-20T21:02:21.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018979649999999999, 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017358+0000", 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017358+0000", 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017359+0000", 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0499999999999999e-06 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017397+0000", 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7968e-05 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017406+0000", 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0019999999999995e-06 2024-09-20T21:02:21.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017411+0000", 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.293e-06 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017461+0000", 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9753999999999998e-05 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017482+0000", 2024-09-20T21:02:21.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0574e-05 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:121586 5.0 5:02412252:::benchmark_data_smithi112_23632_object121585:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:21.017984+0000", 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0010869829999999999, 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013053800000000001, 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.036 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.037 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.037 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.037 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 121586 2024-09-20T21:02:21.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.037 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017984+0000", 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017984+0000", 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.017985+0000", 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0200000000000002e-07 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018021+0000", 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5704999999999998e-05 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018031+0000", 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0368e-05 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018037+0000", 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1859999999999997e-06 2024-09-20T21:02:21.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018186+0000", 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014925600000000001 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018322+0000", 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013584 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018424+0000", 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010176200000000001 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:121588 5.4 e46/38)", 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:21.018673+0000", 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00039795800000000001, 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065183099999999996, 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.041 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018673+0000", 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018673+0000", 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018674+0000", 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.61e-07 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018725+0000", 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1520000000000001e-05 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018740+0000", 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.412e-05 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.018764+0000", 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4074999999999999e-05 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:121591 5.a e46/21 5:5902c8ae:::benchmark_data_smithi112_23632_object121590:head v 46'7623, mlcod=46'7621)", 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:21.019042+0000", 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 2.8789000000000002e-05, 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00030773500000000001, 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.044 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.019042+0000", 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.019042+0000", 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.019043+0000", 2024-09-20T21:02:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9500000000000002e-07 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.019087+0000", 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3813999999999998e-05 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.019095+0000", 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5669999999999995e-06 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.019109+0000", 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3448000000000001e-05 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.019157+0000", 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8081999999999998e-05 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:21.019189+0000", 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2255999999999997e-05 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.047 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.048 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.048 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:21.048 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 7 2024-09-20T21:02:21.048 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:21.049 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:21.090 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:21.090+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:21.163 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:21.161+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:21.237 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:21.237 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:21.237 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:21.237 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:21.237 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:21.246 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 54 16 122071 122055 141.252 127 0.00649433 0.00707519 2024-09-20T21:02:21.257 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:21.265 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:21.260+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:21.366 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:21.360+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:21.406 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:21.406 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:21.406 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:21.406 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:21.406 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.406 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:21.406 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:21.406 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 69.208043662999998, 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:21.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.409 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 69.207953626999995, 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:21.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:21.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:21.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 69.207867273999994, 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.418 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.419 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:21.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 69.207798464999996, 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.424 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:21.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 69.207765605000006, 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:21.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:21.435 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 69.207723587999993, 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:21.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:21.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:21.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 69.207598481999995, 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:21.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:21.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 69.207506132999995, 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:21.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 69.207421761000006, 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.441962305000001, 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.457 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:21.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:21.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.441410299000001, 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:21.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.468 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.440782718000001, 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.469 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:21.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:21.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.440671709, 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.475 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:21.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:21.480 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.437005197000001, 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.481 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:21.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:21.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.436690862999999, 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:21.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:21.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:21.492 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 30.436508745000001, 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:21.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.6910488219999991, 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.498 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:21.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:21.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.6866978970000002, 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.504 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:21.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:21.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.6784558260000004, 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.510 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:21.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:21.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:103545 5.b 5:d91feae6:::benchmark_data_smithi112_23632_object103544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.1517016770000001, 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021689756000000001, 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:21.516 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 103545 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:21.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252414+0000", 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7700000000000004e-07 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252448+0000", 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4388999999999999e-05 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252469+0000", 2024-09-20T21:02:21.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0270000000000001e-05 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252475+0000", 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0290000000000002e-06 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257523+0000", 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050483749999999999 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:21.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257683+0000", 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016024999999999999 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257839+0000", 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015597000000000001 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.263823+0000", 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0059834420000000003 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.273976+0000", 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010153206 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.274049+0000", 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.339e-05 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.274103+0000", 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3758000000000003e-05 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.521 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.522 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:21.522 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:21.522 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:21.523 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:21.524 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:21.522+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:21.530 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:02:21.624 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:21.620+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:21.680 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122943 5.4 5:231a2b3a:::benchmark_data_smithi112_23632_object122942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.669324+0000", 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0082649130000000005, 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0083014909999999994, 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122943 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.669324+0000", 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.669324+0000", 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.669324+0000", 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4300000000000003e-07 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.669406+0000", 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1285000000000005e-05 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.669415+0000", 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5810000000000003e-06 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.669422+0000", 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8689999999999998e-06 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.669472+0000", 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9656e-05 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.669595+0000", 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012377199999999999 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.669725+0000", 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0001295 2024-09-20T21:02:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.672314+0000", 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025888230000000001 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122944 5.5 5:af0acb2e:::benchmark_data_smithi112_23632_object122943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.671012+0000", 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0065767519999999999, 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0067762910000000003, 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122944 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671012+0000", 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671012+0000", 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671013+0000", 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000002e-07 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671166+0000", 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015380400000000001 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671181+0000", 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4995e-05 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671188+0000", 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0079999999999996e-06 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671246+0000", 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7797999999999998e-05 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671381+0000", 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013483399999999999 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671503+0000", 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121845 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122946 5.5 5:aec75b82:::benchmark_data_smithi112_23632_object122945:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.671427+0000", 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0061617800000000004, 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064885079999999996, 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122946 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671427+0000", 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671427+0000", 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671427+0000", 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.99e-07 2024-09-20T21:02:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671519+0000", 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1308000000000001e-05 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671529+0000", 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0539e-05 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.671535+0000", 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8930000000000002e-06 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.673450+0000", 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001914289 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.673588+0000", 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013812699999999999 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.673743+0000", 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015548499999999999 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122950 5.5 5:a32bf780:::benchmark_data_smithi112_23632_object122949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.672124+0000", 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0054649939999999999, 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058674870000000002, 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122950 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.672124+0000", 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.672124+0000", 2024-09-20T21:02:21.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.672124+0000", 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.37e-07 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.672151+0000", 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6959000000000001e-05 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.672158+0000", 2024-09-20T21:02:21.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9789999999999996e-06 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.672163+0000", 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0100000000000003e-06 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675667+0000", 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035042139999999999 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675798+0000", 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013053699999999999 2024-09-20T21:02:21.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675936+0000", 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013780300000000001 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122953 5.c 5:322917bb:::benchmark_data_smithi112_23632_object122952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.674481+0000", 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0031075249999999999, 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035813899999999998, 2024-09-20T21:02:21.698 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122953 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674481+0000", 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674481+0000", 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674482+0000", 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.19e-06 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674579+0000", 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7199000000000002e-05 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674591+0000", 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1439e-05 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674598+0000", 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1300000000000003e-06 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674656+0000", 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7809000000000002e-05 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674781+0000", 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012490099999999999 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674912+0000", 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013091099999999999 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122954 5.4 5:2faa6804:::benchmark_data_smithi112_23632_object122953:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.674626+0000", 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0029629719999999999, 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035081420000000001, 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122954 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.703 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674626+0000", 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674626+0000", 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674626+0000", 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6400000000000002e-07 2024-09-20T21:02:21.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674689+0000", 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2253000000000002e-05 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674699+0000", 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0243e-05 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674705+0000", 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7100000000000001e-06 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674755+0000", 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9916000000000001e-05 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.674900+0000", 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014491100000000001 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675044+0000", 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143681 2024-09-20T21:02:21.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:122955 5.b e46/21 5:daf1d022:::benchmark_data_smithi112_23632_object122954:head v 46'7857, mlcod=46'7855)", 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.675392+0000", 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0021963379999999999, 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028139269999999999, 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675392+0000", 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675392+0000", 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675393+0000", 2024-09-20T21:02:21.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5199999999999996e-07 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675426+0000", 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3232000000000003e-05 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675440+0000", 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3645999999999999e-05 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675446+0000", 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5889999999999999e-06 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675527+0000", 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0778999999999993e-05 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.675548+0000", 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0409000000000001e-05 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.710 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122956 5.4 5:21ed548f:::benchmark_data_smithi112_23632_object122955:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.676981+0000", 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000608067, 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00129057, 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122956 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.711 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.676981+0000", 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.676981+0000", 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.676982+0000", 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0610000000000001e-06 2024-09-20T21:02:21.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677014+0000", 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2792e-05 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677026+0000", 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677035+0000", 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8440000000000004e-06 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677332+0000", 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029683800000000001 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677455+0000", 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000123201 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677625+0000", 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000170514 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.714 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122957 5.3 5:c5fab7ea:::benchmark_data_smithi112_23632_object122956:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.677201+0000", 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00038717200000000003, 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011430850000000001, 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.715 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122957 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677201+0000", 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677201+0000", 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677202+0000", 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000004e-07 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677227+0000", 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5199999999999999e-05 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677238+0000", 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677245+0000", 2024-09-20T21:02:21.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0690000000000004e-06 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677290+0000", 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4508999999999997e-05 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677413+0000", 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012333600000000001 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677574+0000", 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016093100000000001 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:122943 5.4 e46/38)", 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.677238+0000", 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00035083100000000002, 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001157244, 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677238+0000", 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677238+0000", 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677238+0000", 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3599999999999999e-07 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677241+0000", 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4820000000000001e-06 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677246+0000", 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.023e-06 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677251+0000", 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8169999999999998e-06 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122958 5.a 5:568c9475:::benchmark_data_smithi112_23632_object122957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.677388+0000", 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00020088699999999999, 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001060224, 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122958 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.722 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677388+0000", 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677388+0000", 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677389+0000", 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8100000000000001e-07 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677466+0000", 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7778e-05 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677506+0000", 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9337e-05 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677518+0000", 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2388999999999999e-05 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677573+0000", 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4567000000000001e-05 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677675+0000", 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010218899999999999 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677803+0000", 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127873 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.725 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122959 5.6 5:68f745ef:::benchmark_data_smithi112_23632_object122958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.677542+0000", 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.7002000000000002e-05, 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098510000000000004, 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122959 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.726 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677542+0000", 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677542+0000", 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677543+0000", 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4300000000000001e-07 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677591+0000", 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8847000000000002e-05 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677602+0000", 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0828e-05 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677610+0000", 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:02:21.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677666+0000", 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5739000000000003e-05 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677792+0000", 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126384 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677933+0000", 2024-09-20T21:02:21.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014010499999999999 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122960 5.5 5:a6e51e92:::benchmark_data_smithi112_23632_object122959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.677633+0000", 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9999557, 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096908200000000002, 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122960 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677633+0000", 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677633+0000", 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677634+0000", 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8700000000000005e-07 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677677+0000", 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3152999999999998e-05 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677689+0000", 2024-09-20T21:02:21.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1567e-05 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677697+0000", 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1589999999999993e-06 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678277+0000", 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00057982300000000004 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678498+0000", 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022182300000000001 2024-09-20T21:02:21.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122961 5.a 5.a97de0da (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.677708+0000", 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9998808, 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000967497, 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122961 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677708+0000", 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677708+0000", 2024-09-20T21:02:21.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677709+0000", 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8999999999999995e-07 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677743+0000", 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4292000000000003e-05 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677757+0000", 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3797e-05 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677766+0000", 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5680000000000005e-06 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:122954 5.4 e46/38)", 2024-09-20T21:02:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.677888+0000", 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9997005, 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000841554, 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677888+0000", 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677888+0000", 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677889+0000", 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0900000000000002e-07 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677892+0000", 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677901+0000", 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4910000000000005e-06 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.677907+0000", 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4320000000000004e-06 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.740 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122962 5.4 5.e8bdc584 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.678023+0000", 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9995656, 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00075477900000000002, 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122962 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678023+0000", 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678023+0000", 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678024+0000", 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7800000000000001e-07 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678129+0000", 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105698 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678138+0000", 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0529999999999996e-06 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678145+0000", 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5860000000000001e-06 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:122964 5.5 5.7a1db655 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:21.678217+0000", 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9993715, 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061562100000000001, 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:21.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 122964 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678217+0000", 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:21.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678217+0000", 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678218+0000", 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678334+0000", 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116455 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678342+0000", 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4139999999999994e-06 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:21.678349+0000", 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 17 2024-09-20T21:02:21.747 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:21.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:21.749 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:21.746+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:21.849 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:21.844+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:21.941 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:21.942 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:21.942 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:21.942 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:21.942 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:21.950 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:21.949+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:21.965 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:22.051 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:22.049+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:22.152 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:22.149+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:22.168 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:22.168 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.971701027999998, 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:22.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:22.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.971566828999997, 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:22.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.971461822999999, 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.182 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:22.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:22.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:22.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.971342297999996, 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.188 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:22.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:22.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:22.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.971272291000005, 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:22.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.971197239000006, 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.200 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:22.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:22.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:22.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:22.205 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.971110213000003, 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:22.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:22.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.971041439999993, 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:22.210 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.214 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.453294777, 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.450459134000001, 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.219 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:22.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:22.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.450009329, 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:22.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.449906164, 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.231 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:22.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:22.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:22.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:22.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.236 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.449818177999999, 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:22.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:22.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:22.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.241 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.449005674, 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:22.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.447237115, 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:22.251 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.446772596000001, 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:22.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:22.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:22.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:22.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.446576725, 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.257 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:22.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:22.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.446094862000001, 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.263 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:22.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.443946801999999, 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.269 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:22.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:22.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:22.274 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.440815518000001, 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:22.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:22.278 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:22.279 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 55 16 124081 124065 140.968 125.625 0.00592906 0.00708952 2024-09-20T21:02:22.280 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:22.280 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:22.276+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:22.381 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:22.377+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:22.433 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:22.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.433 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:124451 5.e 5:78c466e8:::benchmark_data_smithi112_23632_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:22.433 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:22.427778+0000", 2024-09-20T21:02:22.433 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0052204759999999999, 2024-09-20T21:02:22.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0052477579999999999, 2024-09-20T21:02:22.433 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:22.433 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 124451 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.427778+0000", 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:22.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.427778+0000", 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.427779+0000", 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2799999999999996e-07 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.427809+0000", 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.0352999999999999e-05 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:22.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.427817+0000", 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8760000000000005e-06 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.427824+0000", 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2439999999999998e-06 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.427861+0000", 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7455e-05 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.427954+0000", 2024-09-20T21:02:22.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3269000000000004e-05 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.428035+0000", 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0782e-05 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.429615+0000", 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0015800149999999999 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.437 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:124457 5.d 5:b2f08c1f:::benchmark_data_smithi112_23632_object124456:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:22.430999+0000", 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0019996430000000002, 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0021116730000000001, 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 124457 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:22.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.430999+0000", 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.430999+0000", 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431000+0000", 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431027+0000", 2024-09-20T21:02:22.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6342e-05 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431038+0000", 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1062e-05 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431046+0000", 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4479999999999994e-06 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431092+0000", 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6227999999999999e-05 2024-09-20T21:02:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431189+0000", 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6230999999999994e-05 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431286+0000", 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7374000000000007e-05 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:124458 5.0 5:0fe33907:::benchmark_data_smithi112_23632_object124457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:22.431458+0000", 2024-09-20T21:02:22.441 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001540975, 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017242900000000001, 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 124458 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431458+0000", 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431458+0000", 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431459+0000", 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0860000000000001e-06 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431511+0000", 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1529000000000001e-05 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431526+0000", 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5201999999999999e-05 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431536+0000", 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0138e-05 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431587+0000", 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1490000000000003e-05 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431747+0000", 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000159891 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431903+0000", 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015599200000000001 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:124461 5.0 5.941283d0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:22.431558+0000", 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0014413500000000001, 2024-09-20T21:02:22.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016906619999999999, 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 124461 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431558+0000", 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431558+0000", 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431559+0000", 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8899999999999998e-07 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431635+0000", 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6482000000000004e-05 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431649+0000", 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3616e-05 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431659+0000", 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.978e-06 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:124462 5.e 5:74a10fa7:::benchmark_data_smithi112_23632_object124461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:22.431677+0000", 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0013220510000000001, 2024-09-20T21:02:22.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016252230000000001, 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 124462 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431677+0000", 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431677+0000", 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431678+0000", 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8700000000000005e-07 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431750+0000", 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2269999999999998e-05 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431760+0000", 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9010000000000006e-06 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431767+0000", 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5549999999999997e-06 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431815+0000", 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7790000000000002e-05 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432007+0000", 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00019170799999999999 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432203+0000", 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00019663999999999999 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:124463 5.f 5:f580b40e:::benchmark_data_smithi112_23632_object124462:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:22.431783+0000", 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0012160610000000001, 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001588143, 2024-09-20T21:02:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 124463 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431783+0000", 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431783+0000", 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431783+0000", 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4899999999999995e-07 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431826+0000", 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2446e-05 2024-09-20T21:02:22.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431836+0000", 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6050000000000004e-06 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431842+0000", 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7870000000000004e-06 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431893+0000", 2024-09-20T21:02:22.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1079999999999999e-05 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432035+0000", 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014169700000000001 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:124459 5.a e46/21 5:59b5ceb0:::benchmark_data_smithi112_23632_object124458:head v 46'7788, mlcod=46'7786)", 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:22.431953+0000", 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001046363, 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00147926, 2024-09-20T21:02:22.456 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431953+0000", 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431953+0000", 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431953+0000", 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5099999999999999e-07 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432050+0000", 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7108000000000006e-05 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432059+0000", 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0929999999999992e-06 2024-09-20T21:02:22.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432066+0000", 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3620000000000002e-06 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432115+0000", 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9227000000000001e-05 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432134+0000", 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9032e-05 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:124465 5.f 5.84bab52f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:22.431942+0000", 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0010567440000000001, 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001544412, 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:22.460 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 124465 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431942+0000", 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431942+0000", 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.431943+0000", 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1200000000000001e-07 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432050+0000", 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106648 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432061+0000", 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1007e-05 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432068+0000", 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5059999999999998e-06 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.463 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:124451 5.e e46/21)", 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:22.432114+0000", 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00088449199999999996, 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001418817, 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432114+0000", 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432114+0000", 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432115+0000", 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2399999999999998e-07 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432118+0000", 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.258e-06 2024-09-20T21:02:22.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432125+0000", 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7850000000000003e-06 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:22.432131+0000", 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6729999999999997e-06 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:22.466 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:22.467 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 9 2024-09-20T21:02:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:22.467 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:22.510 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:22.509+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:22.524 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:02:22.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:22.583 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:22.581+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:22.664 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:22.664 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:22.664 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:22.664 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:22.664 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:22.685 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:22.681+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:22.686 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:22.716 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:22.716 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:22.734 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-20T21:02:22.735 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T21:02:22.755 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:22.756 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:22.786 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:22.785+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:22.886 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:22.885+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:22.888 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:22.888 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:22.911 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:22.987 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:22.984+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:23.064 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:23.064 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:23.086 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:23.088 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:23.085+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:23.188 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:23.185+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:23.246 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 56 16 126117 126101 140.723 127.25 0.010195 0.00710179 2024-09-20T21:02:23.280 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:23.280 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:23.282 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-20T21:02:23.292 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:23.289+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:23.302 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:23.392 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-09-20T21:02:23.393 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:23.388+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:23.422 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:23.422 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:23.434 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:23.494 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:23.493+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:23.574 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:23.574 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:23.590 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:23.634 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:23.633+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:23.695 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:23.693+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:23.755 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:23.755 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:23.769 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:23.810 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:23.809+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:23.896 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:23.892+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:23.932 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:23.932 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:23.946 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:23.998 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:23.992+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:24.073 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:24.073 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:24.086 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:24.099 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:24.097+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:24.200 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:24.197+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:24.244 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:24.244 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:24.246 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 57 16 126404 126388 138.569 17.9375 0.0045071 0.00712279 2024-09-20T21:02:24.257 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:24.301 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:24.297+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:24.372 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:24.372 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:24.384 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:24.430 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:24.429+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:24.503 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:24.501+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:24.515 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:24.515 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:24.529 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:24.552 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:02:24.614 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:24.613+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:24.704 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:24.701+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:24.731 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:24.731 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:24.751 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:24.774 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:24.805 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:24.800+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:24.905 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:24.905+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:24.926 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:24.926 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:24.926 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:24.943 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:24.944 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:24.947 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.748887830000001, 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:24.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:24.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.954 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.748797793999998, 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:24.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.748711440999998, 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:24.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:24.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:24.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:24.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.966 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.748642631999999, 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:24.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:24.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:24.972 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.748609771999995, 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:24.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:24.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:24.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.748567754999996, 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:24.979 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:24.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:24.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.748442648999998, 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:24.985 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:24.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:24.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.748350299999998, 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:24.991 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.995 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.748265927999995, 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:24.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 33.982806472, 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.001 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:25.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 33.982254466000001, 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:25.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:25.012 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 33.981626884999997, 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:25.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.018 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 33.981515876000003, 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:25.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:25.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 33.977849364000001, 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:25.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:25.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 33.977535029999999, 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:25.030 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:25.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:25.036 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:25.037 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 33.977352912000001, 2024-09-20T21:02:25.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:25.037 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.037 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.037 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.037 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.037 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:25.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.042 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.231892989, 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:25.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:25.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.048 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.227542064, 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.049 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:25.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:25.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.054 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.219299993, 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.055 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:25.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:25.060 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:103545 5.b 5:d91feae6:::benchmark_data_smithi112_23632_object103544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 12.692545844, 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021689756000000001, 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.061 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 103545 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252413+0000", 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252414+0000", 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7700000000000004e-07 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252448+0000", 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4388999999999999e-05 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252469+0000", 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0270000000000001e-05 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.252475+0000", 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0290000000000002e-06 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257523+0000", 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050483749999999999 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257683+0000", 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016024999999999999 2024-09-20T21:02:25.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.257839+0000", 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015597000000000001 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.263823+0000", 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0059834420000000003 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.273976+0000", 2024-09-20T21:02:25.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010153206 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.274049+0000", 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.339e-05 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:12.274103+0000", 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3758000000000003e-05 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.066 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.067 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.067 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:25.067 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:25.068 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:25.069 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:25.064+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:25.168 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:25.165+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:25.247 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:25.247 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:25.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.247 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:127791 5.4 5:23dc71cd:::benchmark_data_smithi112_23632_object127790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:25.247 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.243093+0000", 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003076666, 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031054339999999998, 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 127791 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243093+0000", 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243093+0000", 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243094+0000", 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3399999999999998e-07 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243163+0000", 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9201000000000004e-05 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243172+0000", 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4739999999999994e-06 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243179+0000", 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5799999999999997e-06 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.244231+0000", 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001051927 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.244341+0000", 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109579 2024-09-20T21:02:25.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.244460+0000", 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119294 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:127792 5.4 5.bdd7e624 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.243198+0000", 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0029721169999999998, 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030867220000000001, 2024-09-20T21:02:25.252 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 127792 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243198+0000", 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243198+0000", 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243198+0000", 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3399999999999999e-07 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243233+0000", 2024-09-20T21:02:25.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4764999999999997e-05 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243242+0000", 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8189999999999998e-06 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243247+0000", 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5840000000000002e-06 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.255 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:127793 5.8 5:158ebf89:::benchmark_data_smithi112_23632_object127792:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.243256+0000", 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0029141269999999999, 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030724200000000002, 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 127793 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243256+0000", 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243256+0000", 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243256+0000", 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.75e-07 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243283+0000", 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7245000000000001e-05 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243304+0000", 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0976999999999999e-05 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243310+0000", 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8860000000000001e-06 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243360+0000", 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9353e-05 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243488+0000", 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012848499999999999 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243571+0000", 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3345999999999998e-05 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:127794 5.1 5:889a0049:::benchmark_data_smithi112_23632_object127793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.243327+0000", 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002842893, 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030457969999999998, 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.260 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 127794 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243327+0000", 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243327+0000", 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243327+0000", 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7999999999999996e-07 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243383+0000", 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5699999999999999e-05 2024-09-20T21:02:25.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243391+0000", 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8280000000000003e-06 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243432+0000", 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1547e-05 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243496+0000", 2024-09-20T21:02:25.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3696999999999997e-05 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243636+0000", 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140221 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:127784 5.0 e49/21 5:0af6e44a:::benchmark_data_smithi112_23632_object127783:head v 49'7993, mlcod=49'7990)", 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.243881+0000", 2024-09-20T21:02:25.264 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0022885169999999999, 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025300460000000002, 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243881+0000", 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243881+0000", 2024-09-20T21:02:25.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243882+0000", 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3799999999999996e-07 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243929+0000", 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7104000000000002e-05 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243939+0000", 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4790000000000002e-06 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243945+0000", 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2199999999999997e-06 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.244013+0000", 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8193000000000003e-05 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.244030+0000", 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6772000000000001e-05 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:127783 5.6 5:608720ab:::benchmark_data_smithi112_23632_object127782:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.240359+0000", 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.005811152, 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060879999999999997, 2024-09-20T21:02:25.268 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 127783 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240359+0000", 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240359+0000", 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240360+0000", 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2130000000000001e-06 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240397+0000", 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7737999999999997e-05 2024-09-20T21:02:25.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240408+0000", 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0729e-05 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240417+0000", 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2590000000000006e-06 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240601+0000", 2024-09-20T21:02:25.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000183055 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240738+0000", 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013795100000000001 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:127785 5.6 5:6b4f1371:::benchmark_data_smithi112_23632_object127784:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.240663+0000", 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0055067240000000002, 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058252210000000002, 2024-09-20T21:02:25.272 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 127785 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240663+0000", 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240663+0000", 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240664+0000", 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7899999999999997e-07 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240701+0000", 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7394999999999997e-05 2024-09-20T21:02:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240709+0000", 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0509999999999997e-06 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240714+0000", 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9339999999999997e-06 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.242998+0000", 2024-09-20T21:02:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022841739999999999 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243143+0000", 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144313 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:127786 5.6 5:63f1ab6c:::benchmark_data_smithi112_23632_object127785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.240784+0000", 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0053852580000000004, 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057430700000000003, 2024-09-20T21:02:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 127786 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240784+0000", 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240784+0000", 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240785+0000", 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7899999999999998e-07 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240906+0000", 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012087300000000001 2024-09-20T21:02:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240916+0000", 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8160000000000005e-06 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240923+0000", 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5800000000000003e-06 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.245109+0000", 2024-09-20T21:02:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0041859389999999996 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.245243+0000", 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000134232 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:127781 5.e e49/21 5:78cf8943:::benchmark_data_smithi112_23632_object127780:head v 49'7955, mlcod=49'7952)", 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.240829+0000", 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0053409649999999996, 2024-09-20T21:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057608190000000004, 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240829+0000", 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240829+0000", 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240829+0000", 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7e-07 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240932+0000", 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010266 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240940+0000", 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3729999999999993e-06 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.240946+0000", 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2190000000000001e-06 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.242987+0000", 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002040886 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243006+0000", 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9105000000000001e-05 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:127782 5.0 e49/21 5:04a8fbba:::benchmark_data_smithi112_23632_object127781:head v 49'7992, mlcod=49'7990)", 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.241077+0000", 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0050928070000000004, 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0055584140000000002, 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241077+0000", 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241077+0000", 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241077+0000", 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.63e-07 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241155+0000", 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7379999999999994e-05 2024-09-20T21:02:25.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241165+0000", 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0407999999999999e-05 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241169+0000", 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2440000000000004e-06 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241251+0000", 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1265000000000002e-05 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241263+0000", 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2832e-05 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:127788 5.c 5:357580db:::benchmark_data_smithi112_23632_object127787:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:25.287 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.241153+0000", 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0050168569999999996, 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0055302279999999999, 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 127788 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241153+0000", 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241153+0000", 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241154+0000", 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4099999999999997e-07 2024-09-20T21:02:25.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241234+0000", 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0521999999999999e-05 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241243+0000", 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.439e-06 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241247+0000", 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2869999999999998e-06 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.242670+0000", 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014232629999999999 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.242845+0000", 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017440199999999999 2024-09-20T21:02:25.291 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:127787 5.b e49/21 5:dd7d5a6a:::benchmark_data_smithi112_23632_object127786:head v 49'8147, mlcod=49'8144)", 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.241356+0000", 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0048140040000000002, 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053729930000000004, 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241356+0000", 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241356+0000", 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241356+0000", 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2399999999999999e-07 2024-09-20T21:02:25.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241426+0000", 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0215000000000005e-05 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241433+0000", 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8140000000000003e-06 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241437+0000", 2024-09-20T21:02:25.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5939999999999998e-06 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241474+0000", 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7227000000000001e-05 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.241491+0000", 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7533999999999998e-05 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.295 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:127790 5.2 5:48b76dd7:::benchmark_data_smithi112_23632_object127789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:25.242929+0000", 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0032407450000000002, 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00383527, 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 127790 2024-09-20T21:02:25.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.242929+0000", 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.242929+0000", 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.242930+0000", 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.051e-06 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.242979+0000", 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9078e-05 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.242989+0000", 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7289999999999995e-06 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243031+0000", 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2228000000000003e-05 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243100+0000", 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8745999999999995e-05 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:25.243227+0000", 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012771399999999999 2024-09-20T21:02:25.299 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.300 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.300 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.300 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.300 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:25.300 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 13 2024-09-20T21:02:25.300 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:25.301 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 58 15 127796 127781 137.68 87.0625 0.00451104 0.00725882 2024-09-20T21:02:25.301 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:25.297+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:25.302 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:25.402 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:25.396+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:25.470 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:25.471 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:25.471 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:25.471 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:25.471 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:25.493 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:25.536 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:25.532+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:25.546 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:02:25.604 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:25.601+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:25.705 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:25.700+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:25.711 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.515657934000004, 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:25.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:25.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.515523735000002, 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.718 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.515418729000004, 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.724 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:25.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.515299204000002, 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.730 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:25.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:25.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.736 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.515229196999996, 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.515154144999997, 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.743 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:25.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.515067118999994, 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:25.749 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:25.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.514998345999999, 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.754 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:25.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:25.758 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.997251683, 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:25.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:25.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.994416040000001, 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:25.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:25.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.993966235, 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.769 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:25.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:25.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.99386307, 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:25.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.776 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:25.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:25.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:25.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:25.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.993775083999999, 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:25.783 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:25.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:25.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:25.789 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.99296258, 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.991194021, 2024-09-20T21:02:25.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:25.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:25.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.990729502000001, 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.990533631, 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.807 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:25.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.990051768000001, 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.813 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:25.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:25.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.987903707999999, 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.819 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:25.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:25.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.984772423999999, 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:25.829 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:25.831 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:25.829+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:25.831 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:25.931 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:25.928+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:25.986 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:25.986 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:25.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.986 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:129273 5.f 5:fb0bed79:::benchmark_data_smithi112_23632_object129272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:25.986 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.980679+0000", 2024-09-20T21:02:25.986 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.004612204, 2024-09-20T21:02:25.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0046409069999999997, 2024-09-20T21:02:25.986 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 129273 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980679+0000", 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980679+0000", 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980681+0000", 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.42e-06 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980726+0000", 2024-09-20T21:02:25.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4836999999999998e-05 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980735+0000", 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5659999999999996e-06 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980741+0000", 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8089999999999998e-06 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980802+0000", 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1024999999999999e-05 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980978+0000", 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017563799999999999 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:129268 5.4 e50/38 5:25676d3b:::benchmark_data_smithi112_23632_object129267:head v 50'8180, mlcod=50'8177)", 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.982299+0000", 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0029927069999999998, 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0030933039999999998, 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982299+0000", 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982299+0000", 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982300+0000", 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2099999999999995e-07 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982360+0000", 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0439999999999997e-05 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982369+0000", 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4740000000000005e-06 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982374+0000", 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4729999999999999e-06 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982443+0000", 2024-09-20T21:02:25.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8980999999999996e-05 2024-09-20T21:02:25.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982472+0000", 2024-09-20T21:02:25.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.9008000000000001e-05 2024-09-20T21:02:25.994 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.994 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:129275 5.f 5:f2504416:::benchmark_data_smithi112_23632_object129274:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.982478+0000", 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0028137779999999999, 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029759169999999998, 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:25.995 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 129275 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982478+0000", 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:25.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982478+0000", 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982479+0000", 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8200000000000008e-07 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982520+0000", 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1569999999999997e-05 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982531+0000", 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.982547+0000", 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5140000000000001e-05 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983548+0000", 2024-09-20T21:02:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010015919999999999 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983697+0000", 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014844399999999999 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:129276 5.8 e50/38 5:18133e87:::benchmark_data_smithi112_23632_object129275:head v 50'8124, mlcod=50'8122)", 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.983386+0000", 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00190591, 2024-09-20T21:02:25.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002129457, 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983386+0000", 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983386+0000", 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983387+0000", 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.725e-06 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983456+0000", 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9091000000000006e-05 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983475+0000", 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8544999999999999e-05 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983504+0000", 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.9113000000000001e-05 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983571+0000", 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7391999999999994e-05 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983592+0000", 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0446e-05 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:129277 5.4 e50/38 5:2caa853a:::benchmark_data_smithi112_23632_object129276:head v 50'8181, mlcod=50'8178)", 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.984369+0000", 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00092199199999999995, 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0012036900000000001, 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.003 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984369+0000", 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984369+0000", 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984370+0000", 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0100000000000004e-07 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984448+0000", 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984459+0000", 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0481e-05 2024-09-20T21:02:26.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984464+0000", 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.955e-06 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984523+0000", 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9475999999999998e-05 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984540+0000", 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6789000000000001e-05 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:129279 5.0 5:0d0cc870:::benchmark_data_smithi112_23632_object129278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.984406+0000", 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00088509999999999999, 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0012338850000000001, 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.007 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 129279 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984406+0000", 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984406+0000", 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984407+0000", 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.102e-06 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984533+0000", 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000125031 2024-09-20T21:02:26.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984542+0000", 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6320000000000003e-06 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984549+0000", 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1420000000000004e-06 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984670+0000", 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012089100000000001 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984837+0000", 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000166582 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984991+0000", 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000154671 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.011 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:129280 5.9 5:91246cb5:::benchmark_data_smithi112_23632_object129279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.984567+0000", 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000724941, 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001153811, 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.012 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 129280 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984567+0000", 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984567+0000", 2024-09-20T21:02:26.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984567+0000", 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1399999999999997e-07 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984603+0000", 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5454999999999999e-05 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984611+0000", 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7970000000000006e-06 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984618+0000", 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3709999999999996e-06 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984710+0000", 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1910999999999995e-05 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.984828+0000", 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118231 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:129265 5.0 e50/21)", 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.985108+0000", 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000183635, 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067988499999999997, 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:26.016 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.985108+0000", 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.985108+0000", 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.985109+0000", 2024-09-20T21:02:26.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8299999999999996e-07 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.985114+0000", 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1170000000000003e-06 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.985126+0000", 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2444e-05 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.985135+0000", 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3850000000000002e-06 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:129265 5.0 5:05e36d7f:::benchmark_data_smithi112_23632_object129264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.977367+0000", 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0079248540000000003, 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0084757089999999997, 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:26.019 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 129265 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977367+0000", 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977367+0000", 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977368+0000", 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3340000000000001e-06 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977493+0000", 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012480299999999999 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977508+0000", 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.539e-05 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977518+0000", 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.499e-06 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977566+0000", 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8433999999999997e-05 2024-09-20T21:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977723+0000", 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015693099999999999 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977874+0000", 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015080000000000001 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980775+0000", 2024-09-20T21:02:26.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029015040000000001 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:129267 5.b 5:d566e75c:::benchmark_data_smithi112_23632_object129266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.977536+0000", 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0077555699999999998, 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0083654969999999995, 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.024 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 129267 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977536+0000", 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977536+0000", 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977537+0000", 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0200000000000002e-07 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977588+0000", 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1109999999999997e-05 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977600+0000", 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2536e-05 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977607+0000", 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3370000000000002e-06 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977660+0000", 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2064999999999997e-05 2024-09-20T21:02:26.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977785+0000", 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012559999999999999 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.977914+0000", 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000129197 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983136+0000", 2024-09-20T21:02:26.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0052215760000000003 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:129270 5.b 5:dd8df8bb:::benchmark_data_smithi112_23632_object129269:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.978319+0000", 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0069724779999999998, 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0076283380000000001, 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.029 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 129270 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.978319+0000", 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.978319+0000", 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.978320+0000", 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4900000000000005e-07 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.978400+0000", 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0327000000000005e-05 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.978413+0000", 2024-09-20T21:02:26.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3029e-05 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.978420+0000", 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2289999999999997e-06 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980119+0000", 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001698651 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980312+0000", 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193296 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.980524+0000", 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000211437 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.983647+0000", 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0031231840000000002 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.033 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.034 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.034 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:26.034 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 11 2024-09-20T21:02:26.034 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:26.035 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:26.036 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:26.033+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:26.135 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:26.132+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:26.228 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:26.228 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:26.228 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:26.228 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:26.229 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:26.237 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:26.233+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:26.247 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:26.247 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 59 16 129902 129886 137.576 131.562 0.00663542 0.00726459 2024-09-20T21:02:26.337 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:26.332+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:26.438 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:26.432+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:26.450 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:26.450 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:26.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:26.450 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:26.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.451 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:26.451 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:26.451 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.252388361000001, 2024-09-20T21:02:26.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:26.451 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.451 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.451 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.451 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:26.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:26.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:26.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.457 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.252298324999998, 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:26.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:26.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:26.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:26.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:26.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:26.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.252211971999998, 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:26.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:26.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:26.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:26.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:26.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:26.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:26.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:26.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:26.471 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.252143163, 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:26.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.252110302999995, 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.478 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:26.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:26.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:26.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:26.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:26.484 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.252068285999997, 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:26.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.490 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.251943179999998, 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:26.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:26.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:26.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.496 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.251850830999999, 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:26.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:26.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:26.501 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.251766458999995, 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:26.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:26.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:26.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 35.486307003, 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.506 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:26.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.511 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 35.485754997000001, 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:26.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:26.517 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 35.485127415999997, 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:26.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 35.485016407000003, 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.523 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:26.528 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 35.481349895000001, 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.529 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:26.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:26.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:26.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:26.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.534 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 35.481035560999999, 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:26.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 35.480853443000001, 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:26.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:26.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 14.735393520000001, 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.546 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:26.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 14.731042595, 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:26.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:26.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 14.722800524, 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:26.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:127649 5.b 5:df1d496f:::benchmark_data_smithi112_23632_object127648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.2808655879999999, 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023813432999999998, 2024-09-20T21:02:26.563 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 127649 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:26.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167595+0000", 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167688+0000", 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2756000000000004e-05 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167703+0000", 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5048999999999999e-05 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167710+0000", 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0099999999999998e-06 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167758+0000", 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8479000000000001e-05 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167873+0000", 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114753 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167985+0000", 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011221 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.171532+0000", 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035466080000000001 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191348+0000", 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019815856 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191382+0000", 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4156999999999998e-05 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191408+0000", 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5788000000000001e-05 2024-09-20T21:02:26.568 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.569 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.569 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.569 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:26.569 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:26.569 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:26.570 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:26.569+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:26.570 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:26.673 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:26.669+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:26.728 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:26.728 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:26.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.728 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130986 5.2 5:4ce79bad:::benchmark_data_smithi112_23632_object130985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.728 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.722483+0000", 2024-09-20T21:02:26.728 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.004104496, 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0041230670000000002, 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130986 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.722483+0000", 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.722483+0000", 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.722483+0000", 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4499999999999997e-07 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.722517+0000", 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3658000000000002e-05 2024-09-20T21:02:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.722526+0000", 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2920000000000001e-06 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.722532+0000", 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9569999999999999e-06 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725681+0000", 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031487920000000001 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725802+0000", 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000120715 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:130987 5.e e50/21 5:7215685a:::benchmark_data_smithi112_23632_object130986:head v 50'8144, mlcod=50'8141)", 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.723242+0000", 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0033450419999999999, 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034064009999999999, 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.732 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.723242+0000", 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.723242+0000", 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.723263+0000", 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1090999999999998e-05 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.723304+0000", 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0809000000000002e-05 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.723317+0000", 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2405999999999999e-05 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.723324+0000", 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9890000000000003e-06 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.723390+0000", 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6914000000000003e-05 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.723410+0000", 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9221000000000001e-05 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.735 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130988 5.3 5:cb5dcfa1:::benchmark_data_smithi112_23632_object130987:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.725440+0000", 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001147503, 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012438, 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130988 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725440+0000", 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725440+0000", 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725441+0000", 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1459999999999999e-06 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725470+0000", 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8912e-05 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725478+0000", 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3489999999999992e-06 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725484+0000", 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2920000000000003e-06 2024-09-20T21:02:26.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725538+0000", 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4287999999999999e-05 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725663+0000", 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012557900000000001 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130989 5.c 5:3ebf2cc0:::benchmark_data_smithi112_23632_object130988:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.725503+0000", 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0010838950000000001, 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012163650000000001, 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130989 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725503+0000", 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725503+0000", 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725504+0000", 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2699999999999999e-07 2024-09-20T21:02:26.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725527+0000", 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2762e-05 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725535+0000", 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5699999999999993e-06 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725539+0000", 2024-09-20T21:02:26.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725583+0000", 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3903000000000003e-05 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725740+0000", 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015708700000000001 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130960 5.a 5:5a358a07:::benchmark_data_smithi112_23632_object130959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.711293+0000", 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.015294007, 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015463553999999999, 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130960 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.744 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.711293+0000", 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.711293+0000", 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.711294+0000", 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6700000000000002e-07 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.711404+0000", 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109892 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.711417+0000", 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2778e-05 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.711424+0000", 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2450000000000001e-06 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.716620+0000", 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0051960410000000002 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.716744+0000", 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000123542 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.716873+0000", 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000128968 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721712+0000", 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048394689999999999 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130991 5.c 5.4b20a20c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.725922+0000", 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00066558000000000003, 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087376000000000001, 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130991 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725922+0000", 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725922+0000", 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725923+0000", 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9900000000000009e-07 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726024+0000", 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010168200000000001 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726033+0000", 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1599999999999998e-06 2024-09-20T21:02:26.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726037+0000", 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5859999999999998e-06 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130992 5.4 5.dea57454 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.726058+0000", 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00052914200000000002, 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00076417800000000001, 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.751 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130992 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726058+0000", 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726058+0000", 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726059+0000", 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5199999999999997e-07 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726093+0000", 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4026000000000003e-05 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726100+0000", 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6179999999999997e-06 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726104+0000", 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8720000000000004e-06 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130993 5.5 5:a2835435:::benchmark_data_smithi112_23632_object130992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.726111+0000", 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00047660699999999999, 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00074288399999999997, 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130993 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726111+0000", 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726111+0000", 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726111+0000", 2024-09-20T21:02:26.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4999999999999998e-07 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726140+0000", 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8929999999999999e-05 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726146+0000", 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6919999999999999e-06 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726149+0000", 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0180000000000002e-06 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726200+0000", 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0963e-05 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726335+0000", 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013527400000000001 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.758 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130995 5.5 5.4319d505 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.726281+0000", 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000306767, 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00060511199999999999, 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "no flag points reached", 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130995 2024-09-20T21:02:26.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726281+0000", 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726281+0000", 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726281+0000", 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.68e-07 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726337+0000", 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5892e-05 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726346+0000", 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0140000000000004e-06 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.761 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:130990 5.0 e50/21 5:00fc3e65:::benchmark_data_smithi112_23632_object130989:head v 50'8188, mlcod=50'8186)", 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.726404+0000", 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000182862, 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000506823, 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726404+0000", 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726404+0000", 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726405+0000", 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4899999999999995e-07 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726452+0000", 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6862e-05 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726470+0000", 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7555e-05 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726495+0000", 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5021999999999999e-05 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726638+0000", 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143065 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726655+0000", 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7672999999999998e-05 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:130994 5.e e50/21)", 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.726539+0000", 2024-09-20T21:02:26.765 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.8044000000000003e-05, 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039973599999999998, 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726539+0000", 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726539+0000", 2024-09-20T21:02:26.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726540+0000", 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3599999999999999e-07 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726566+0000", 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6472e-05 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726573+0000", 2024-09-20T21:02:26.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3200000000000002e-06 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.726579+0000", 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3190000000000002e-06 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130966 5.2 5:4d829877:::benchmark_data_smithi112_23632_object130965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.712831+0000", 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.013756175000000001, 2024-09-20T21:02:26.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014135165, 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130966 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.712831+0000", 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.712831+0000", 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.712832+0000", 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9500000000000002e-07 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.712888+0000", 2024-09-20T21:02:26.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6483000000000001e-05 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.712903+0000", 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4532000000000001e-05 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.712909+0000", 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.302e-06 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.718856+0000", 2024-09-20T21:02:26.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059471380000000003 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.719075+0000", 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021822500000000001 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130978 5.2 5:4b7aba87:::benchmark_data_smithi112_23632_object130977:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.720897+0000", 2024-09-20T21:02:26.772 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0056905030000000004, 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006106045, 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130978 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.720897+0000", 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.720897+0000", 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.720898+0000", 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9199999999999999e-07 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.720941+0000", 2024-09-20T21:02:26.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3574e-05 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.720951+0000", 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5599999999999999e-06 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.720956+0000", 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5990000000000004e-06 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721879+0000", 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00092329300000000005 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721965+0000", 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6564000000000007e-05 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130980 5.7 5:ef8d8af8:::benchmark_data_smithi112_23632_object130979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.721591+0000", 2024-09-20T21:02:26.776 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0049967409999999999, 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.005447604, 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130980 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721591+0000", 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721591+0000", 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721592+0000", 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3900000000000003e-07 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721647+0000", 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5627000000000001e-05 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721659+0000", 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1590000000000001e-05 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721740+0000", 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0828000000000006e-05 2024-09-20T21:02:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.723446+0000", 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001706632 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.723575+0000", 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012900499999999999 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130981 5.2 5:433a9418:::benchmark_data_smithi112_23632_object130980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.721788+0000", 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.004798872, 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0052848590000000003, 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130981 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721788+0000", 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721788+0000", 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721789+0000", 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0599999999999999e-07 2024-09-20T21:02:26.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721858+0000", 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9247999999999998e-05 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721870+0000", 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1795e-05 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721877+0000", 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0550000000000002e-06 2024-09-20T21:02:26.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.724026+0000", 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021485810000000001 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.724177+0000", 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015102900000000001 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:130982 5.a 5:5f80838b:::benchmark_data_smithi112_23632_object130981:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:26.721889+0000", 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0046984000000000001, 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0052232210000000001, 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 130982 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:26.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721889+0000", 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721889+0000", 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721890+0000", 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721932+0000", 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2658999999999999e-05 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721941+0000", 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8550000000000008e-06 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.721947+0000", 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.212e-06 2024-09-20T21:02:26.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.724013+0000", 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002066043 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725620+0000", 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016061630000000001 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:26.725804+0000", 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.788 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:26.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:26.789 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:26.789 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 16 2024-09-20T21:02:26.789 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:26.790 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:26.791 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:26.789+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:26.890 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:26.884+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:26.949 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:26.949 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:26.949 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:26.949 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:26.949 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:26.969 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:27.012 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:27.008+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:27.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:27.092 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:27.089+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:27.176 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.980336878000003, 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.177 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:27.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.980202679000001, 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:27.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.980097673000003, 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:27.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:27.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.979978148000001, 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.196 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.979908140999996, 2024-09-20T21:02:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.979833088999996, 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.979746062999993, 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.979677289999998, 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.461930626999999, 2024-09-20T21:02:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.459094984, 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.458645178999999, 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.458542014000001, 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.458454028, 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.457641524, 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.455872964999999, 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.455408446, 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.455212575000001, 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.454730712, 2024-09-20T21:02:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.452582652, 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.449451368, 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:27.290 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:27.291 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:27.291 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:27.291 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:27.292 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:2024-09-20T21:02:27.248353+0000 min lat: 0.00142862 max lat: 1.0585 avg lat: 0.00726382 2024-09-20T21:02:27.292 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-20T21:02:27.292 INFO:tasks.radosbench.radosbench.0.smithi112.stdout: 60 4 132101 132097 137.586 138.188 0.0081344 0.00726382 2024-09-20T21:02:27.292 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:27.293 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:27.293 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:27.284+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:27.294 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:27.294 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:27.294 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:27.391 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:27.389+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:27.393 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-20T21:02:27.417 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:27.417 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:27.430 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:27.492 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:27.488+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:27.503 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-09-20T21:02:27.571 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T21:02:27.593 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:27.589+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:27.598 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:27.598 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:27.614 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:27.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-20T21:02:27.694 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:27.688+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:27.782 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:27.782 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:27.795 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:27.793+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:27.796 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:27.896 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:27.892+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:27.923 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:27.923 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:27.937 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:27.996 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:27.993+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:28.096 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:28.096 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:28.097 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:28.092+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:28.108 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:28.198 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:28.197+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:28.247 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Total time run: 60.0075 2024-09-20T21:02:28.247 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Total writes made: 132101 2024-09-20T21:02:28.247 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Write size: 65536 2024-09-20T21:02:28.247 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Object size: 65536 2024-09-20T21:02:28.247 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Bandwidth (MB/sec): 137.588 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Stddev Bandwidth: 34.2772 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Max bandwidth (MB/sec): 239.312 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Min bandwidth (MB/sec): 17.9375 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Average IOPS: 2201 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Stddev IOPS: 548.435 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Max IOPS: 3829 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Min IOPS: 287 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Average Latency(s): 0.00726389 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Stddev Latency(s): 0.0162378 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Max latency(s): 1.0585 2024-09-20T21:02:28.248 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Min latency(s): 0.00142862 2024-09-20T21:02:28.257 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Cleaning up (deleting benchmark objects) 2024-09-20T21:02:28.271 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:28.271 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:28.288 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:28.298 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:28.292+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:28.399 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:28.392+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:28.449 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:28.450 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:28.469 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:28.502 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:28.496+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:28.565 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-20T21:02:28.603 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:28.601+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:28.621 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:28.621 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:28.642 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:28.703 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:28.696+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:28.804 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:28.800+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:28.835 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:28.835 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:28.857 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:28.904 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:28.901+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:29.005 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:29.001+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:29.010 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:29.010 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:29.029 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:29.105 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:29.100+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:29.179 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:29.179 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:29.198 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:29.244 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:29.240+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:29.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:29.307 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:29.305+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:29.394 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:29.394 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:29.409 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:29.405+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:29.414 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:29.450 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:29.451 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:29.451 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:29.469 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:29.470 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:29.473 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:29.473 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:29.509 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:29.505+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:29.574 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:29.574 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:29.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.574 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:135343 5.f 5:f3acd022:::benchmark_data_smithi112_23632_object3239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:29.569436+0000", 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0047232690000000004, 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047494429999999999, 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 135343 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.575 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569436+0000", 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569436+0000", 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569437+0000", 2024-09-20T21:02:29.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5000000000000001e-07 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569441+0000", 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.121e-06 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569449+0000", 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3089999999999996e-06 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569457+0000", 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2649999999999999e-06 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569592+0000", 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013488500000000001 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569715+0000", 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012378199999999999 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:135345 5.f 5:f24d39ce:::benchmark_data_smithi112_23632_object3241:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:29.569742+0000", 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0044173390000000002, 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0045308709999999997, 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.579 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 135345 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569742+0000", 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569742+0000", 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569743+0000", 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7700000000000004e-07 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569746+0000", 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.382e-06 2024-09-20T21:02:29.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569753+0000", 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1470000000000004e-06 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569758+0000", 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6439999999999999e-06 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.571947+0000", 2024-09-20T21:02:29.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0021893030000000001 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.572039+0000", 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2045000000000004e-05 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:135347 5.f 5:f5c0c4f0:::benchmark_data_smithi112_23632_object3243:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:29.569816+0000", 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0043438879999999997, 2024-09-20T21:02:29.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0045443599999999999, 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 135347 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569816+0000", 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569816+0000", 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569816+0000", 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4299999999999998e-07 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569819+0000", 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5849999999999998e-06 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569825+0000", 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6159999999999998e-06 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569832+0000", 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7830000000000001e-06 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.573736+0000", 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003904032 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.573838+0000", 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000101815 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.587 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:135349 5.f 5.fca3ec1f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:29.569897+0000", 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0042621839999999996, 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0045326760000000002, 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 135349 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569897+0000", 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569897+0000", 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569898+0000", 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1800000000000005e-07 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569901+0000", 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4130000000000002e-06 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569910+0000", 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1019999999999997e-06 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.569917+0000", 2024-09-20T21:02:29.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.216e-06 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:135351 5.e 5:7a1e4424:::benchmark_data_smithi112_23632_object3247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:29.570036+0000", 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0041232120000000002, 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0044550739999999998, 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:29.591 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 135351 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.570036+0000", 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.570036+0000", 2024-09-20T21:02:29.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.570037+0000", 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8599999999999998e-07 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.570040+0000", 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7870000000000002e-06 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.570047+0000", 2024-09-20T21:02:29.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4050000000000003e-06 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.570053+0000", 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.682e-06 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.571405+0000", 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001352734 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.571543+0000", 2024-09-20T21:02:29.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013745200000000001 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.571670+0000", 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012692199999999999 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.573735+0000", 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020647930000000001 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.595 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:135355 5.b 5:dc24d81f:::benchmark_data_smithi112_23632_object3251:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:29.571947+0000", 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0022127900000000001, 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026069539999999999, 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 135355 2024-09-20T21:02:29.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.571947+0000", 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.571947+0000", 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.571948+0000", 2024-09-20T21:02:29.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2109999999999999e-06 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.571953+0000", 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8829999999999997e-06 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.571962+0000", 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5650000000000007e-06 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.571971+0000", 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6489999999999997e-06 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.572016+0000", 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4582000000000001e-05 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.572088+0000", 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2861000000000006e-05 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.572157+0000", 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8738999999999994e-05 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:135359 5.e 5.157772fe (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:29.574045+0000", 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000114694, 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00054566, 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.600 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 135359 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.574045+0000", 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.574045+0000", 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.574046+0000", 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4499999999999996e-07 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.574059+0000", 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.322e-05 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.574068+0000", 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6700000000000006e-06 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:29.574073+0000", 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9570000000000001e-06 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 7 2024-09-20T21:02:29.603 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:29.604 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:29.610 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:29.604+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:29.711 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:29.704+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:29.797 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:29.797 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:29.797 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:29.797 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:29.797 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:29.812 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:29.808+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:29.817 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:29.913 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:29.908+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:29.969 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:29.969 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:29.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:29.969 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:29.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.969 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:29.969 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 77.770860290000002, 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:29.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:29.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:29.975 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 77.770770253999999, 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:29.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:29.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 77.770683900999998, 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.982 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:29.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:29.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.988 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 77.770615092, 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:29.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:29.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:29.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 77.770582231999995, 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:29.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:29.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:29.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:29.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:30.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 77.770540214999997, 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.001 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 77.770415108999998, 2024-09-20T21:02:30.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:30.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:30.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:30.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:30.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:30.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:30.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:30.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:30.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:30.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:30.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:30.023 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.023 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.023 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.023 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.024 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:30.024 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 77.770322759999999, 2024-09-20T21:02:30.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:30.024 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.024 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.024 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:30.025 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:30.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:30.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:30.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:30.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:30.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:30.030 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 77.770238387999996, 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:30.031 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:30.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:30.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:30.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:30.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:30.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:30.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:30.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.036 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 39.004778932000001, 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.037 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:30.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:30.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 39.004226926000001, 2024-09-20T21:02:30.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:30.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:30.048 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 39.003599344999998, 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:30.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:30.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.053 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:30.054 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 39.003488335999997, 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:30.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:30.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 38.999821824000001, 2024-09-20T21:02:30.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.061 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:30.065 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 38.999507489999999, 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.066 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.070 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:30.071 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 38.999325372000001, 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.072 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:30.073 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.074 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.075 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.076 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 18.253865448999999, 2024-09-20T21:02:30.077 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.078 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:30.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:30.082 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 18.249514523999999, 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.083 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:30.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:30.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.088 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 18.241272453000001, 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.089 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:30.090 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.091 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:30.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:30.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:127649 5.b 5:df1d496f:::benchmark_data_smithi112_23632_object127648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.7993375169999997, 2024-09-20T21:02:30.094 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023813432999999998, 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 127649 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.095 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167595+0000", 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167688+0000", 2024-09-20T21:02:30.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2756000000000004e-05 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167703+0000", 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5048999999999999e-05 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167710+0000", 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0099999999999998e-06 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167758+0000", 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8479000000000001e-05 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167873+0000", 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114753 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167985+0000", 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011221 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.171532+0000", 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035466080000000001 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191348+0000", 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019815856 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191382+0000", 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4156999999999998e-05 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:30.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:30.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:30.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191408+0000", 2024-09-20T21:02:30.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5788000000000001e-05 2024-09-20T21:02:30.100 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.100 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.100 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.100 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:30.100 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:30.100 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:30.102 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:30.097+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:30.102 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:30.202 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:30.196+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:30.256 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:30.256 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:30.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.256 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:137071 5.b e51/21 5:d7fa918a:::benchmark_data_smithi112_23632_object4967:head v 51'8767, mlcod=51'8765)", 2024-09-20T21:02:30.256 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:30.254156+0000", 2024-09-20T21:02:30.256 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00132712, 2024-09-20T21:02:30.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013414779999999999, 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254156+0000", 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254156+0000", 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254157+0000", 2024-09-20T21:02:30.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2099999999999997e-07 2024-09-20T21:02:30.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254161+0000", 2024-09-20T21:02:30.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4970000000000003e-06 2024-09-20T21:02:30.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254168+0000", 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7660000000000001e-06 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254172+0000", 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4800000000000003e-06 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254207+0000", 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4808999999999998e-05 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254219+0000", 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1487e-05 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:137075 5.8 5:1a58d414:::benchmark_data_smithi112_23632_object4971:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:30.254173+0000", 2024-09-20T21:02:30.260 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0013098509999999999, 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013645370000000001, 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137075 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254173+0000", 2024-09-20T21:02:30.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254173+0000", 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254174+0000", 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1480000000000001e-06 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254180+0000", 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.198e-06 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254190+0000", 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.083e-05 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254199+0000", 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3739999999999998e-06 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254235+0000", 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6278000000000001e-05 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254350+0000", 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114997 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254461+0000", 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011100299999999999 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:137076 5.7 5:e59c7b26:::benchmark_data_smithi112_23632_object4972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:30.254215+0000", 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0012677249999999999, 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013644449999999999, 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.265 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137076 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254215+0000", 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254215+0000", 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254216+0000", 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7300000000000001e-07 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254218+0000", 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4380000000000002e-06 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254225+0000", 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9689999999999997e-06 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254231+0000", 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.75e-06 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254269+0000", 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.82e-05 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254370+0000", 2024-09-20T21:02:30.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100653 2024-09-20T21:02:30.269 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.269 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.269 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.269 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:137067 5.a e51/21)", 2024-09-20T21:02:30.269 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:30.254498+0000", 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00098515600000000005, 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011154159999999999, 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254498+0000", 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254498+0000", 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254498+0000", 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.99e-07 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254500+0000", 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9429999999999999e-06 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254506+0000", 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7289999999999997e-06 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254510+0000", 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9659999999999998e-06 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:137052 5.8 5:11447c25:::benchmark_data_smithi112_23632_object4948:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:30.245894+0000", 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0095889319999999997, 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097478349999999998, 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137052 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.245894+0000", 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.245894+0000", 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.245895+0000", 2024-09-20T21:02:30.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5300000000000004e-07 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.245898+0000", 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3220000000000001e-06 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.245908+0000", 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7529999999999996e-06 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.245914+0000", 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8139999999999997e-06 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.247150+0000", 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012359859999999999 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.247218+0000", 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8164000000000007e-05 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:30.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.247279+0000", 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1017999999999998e-05 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.250483+0000", 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032042429999999998 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:137067 5.a 5:54472cb7:::benchmark_data_smithi112_23632_object4963:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:30.251093+0000", 2024-09-20T21:02:30.277 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0043900959999999996, 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0045907159999999999, 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137067 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251093+0000", 2024-09-20T21:02:30.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251093+0000", 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251094+0000", 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4899999999999995e-07 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251097+0000", 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3830000000000001e-06 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251105+0000", 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2949999999999994e-06 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251112+0000", 2024-09-20T21:02:30.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2990000000000002e-06 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251154+0000", 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1884000000000001e-05 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251222+0000", 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8248000000000001e-05 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251321+0000", 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.254490+0000", 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003169659 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:137064 5.0 e51/21 5:07bde924:::benchmark_data_smithi112_23632_object4960:head v 51'8580, mlcod=51'8578)", 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:30.251273+0000", 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0042102249999999997, 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004452208, 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251273+0000", 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251273+0000", 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251274+0000", 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7199999999999998e-07 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251279+0000", 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4759999999999997e-06 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251288+0000", 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8939999999999999e-06 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251294+0000", 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.528e-06 2024-09-20T21:02:30.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251417+0000", 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226000000000001 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251435+0000", 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8236e-05 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.286 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:137070 5.8 5:1de937c5:::benchmark_data_smithi112_23632_object4966:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:30.251285+0000", 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0041985579999999998, 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0044748849999999996, 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.287 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137070 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251285+0000", 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251285+0000", 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251285+0000", 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1699999999999998e-07 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251288+0000", 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7700000000000002e-06 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251295+0000", 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9979999999999997e-06 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251300+0000", 2024-09-20T21:02:30.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2179999999999998e-06 2024-09-20T21:02:30.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251431+0000", 2024-09-20T21:02:30.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013136800000000001 2024-09-20T21:02:30.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251573+0000", 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014117200000000001 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.251671+0000", 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8660999999999996e-05 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:137066 5.0 e51/21 5:03406254:::benchmark_data_smithi112_23632_object4962:head v 51'8581, mlcod=51'8578)", 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:30.253164+0000", 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0023186610000000001, 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026326969999999998, 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.253164+0000", 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.253164+0000", 2024-09-20T21:02:30.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.253165+0000", 2024-09-20T21:02:30.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9000000000000005e-07 2024-09-20T21:02:30.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.253172+0000", 2024-09-20T21:02:30.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1510000000000001e-06 2024-09-20T21:02:30.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.253183+0000", 2024-09-20T21:02:30.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1484000000000001e-05 2024-09-20T21:02:30.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.253192+0000", 2024-09-20T21:02:30.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4149999999999999e-06 2024-09-20T21:02:30.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.253428+0000", 2024-09-20T21:02:30.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000236495 2024-09-20T21:02:30.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:30.253440+0000", 2024-09-20T21:02:30.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2057e-05 2024-09-20T21:02:30.297 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.297 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.297 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.297 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.297 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:30.297 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 9 2024-09-20T21:02:30.298 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:30.299 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:30.303 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:30.301+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:30.404 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:30.401+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:30.493 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:30.493 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:30.493 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:30.493 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:30.494 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:30.505 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:30.500+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:30.512 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:30.590 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:02:30.605 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:30.600+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:30.707 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:30.707 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:30.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:30.707 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.511156080999996, 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:30.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:30.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:30.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.511021881999994, 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.714 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:30.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:30.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.510916875999996, 2024-09-20T21:02:30.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:30.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:30.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.726 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.510797350999994, 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:30.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:30.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.510727344000003, 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.733 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:30.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.739 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.510652292000003, 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:30.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:30.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.745 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.510565266, 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:30.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:30.750 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.510496493000005, 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.992749830000001, 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.755 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.989914187, 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:30.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:30.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:30.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:30.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:30.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:30.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:30.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:30.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:30.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:30.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:30.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:30.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:30.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:30.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:30.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:30.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:30.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.772 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.772 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.772 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.772 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:30.773 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.989464382000001, 2024-09-20T21:02:30.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:30.773 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.773 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.773 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.773 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.773 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.774 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:30.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.774 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:30.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:30.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:30.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:30.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:30.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:30.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:30.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:30.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:30.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:30.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:30.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:30.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:30.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:30.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:30.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:30.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:30.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:30.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:30.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:30.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:30.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:30.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:30.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:30.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.785 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.786 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.786 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:30.786 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.989361216999999, 2024-09-20T21:02:30.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:30.787 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.787 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.787 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.787 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.787 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.787 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.788 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:30.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.788 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:30.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:30.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:30.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:30.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:30.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:30.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:30.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:30.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:30.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:30.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:30.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:30.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:30.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:30.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:30.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:30.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:30.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:30.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:30.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:30.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:30.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:30.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:30.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:30.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.799 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.800 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.800 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:30.800 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.989273230999999, 2024-09-20T21:02:30.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:30.800 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.800 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.801 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.801 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:30.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.802 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:30.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:30.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:30.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:30.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:30.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:30.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:30.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:30.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:30.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:30.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:30.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:30.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:30.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:30.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:30.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:30.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:30.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:30.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:30.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:30.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:30.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:30.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:30.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:30.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:30.813 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.813 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.813 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.814 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:30.814 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:30.814 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.988460727, 2024-09-20T21:02:30.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:30.814 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.814 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.815 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.815 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:30.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:30.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:30.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:30.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:30.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:30.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:30.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:30.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:30.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:30.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:30.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:30.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:30.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:30.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:30.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:30.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.986692168000001, 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:30.823 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:30.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:30.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.986227649, 2024-09-20T21:02:30.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:30.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:30.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.835 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.986031778000001, 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:30.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:30.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:30.841 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.985549915, 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:30.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:30.847 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.983401855, 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:30.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:30.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:30.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:30.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.980270570999998, 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:30.853 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:30.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:30.857 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:30.858 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:30.858 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:30.700+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:30.859 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:30.860 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:30.857+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:30.960 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:30.956+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:31.018 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:31.018 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:31.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:139046 5.b 5:da0d2336:::benchmark_data_smithi112_23632_object6942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:31.008273+0000", 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0031307800000000001, 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003154755, 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 139046 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.019 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.008273+0000", 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.008273+0000", 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.008274+0000", 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8299999999999995e-07 2024-09-20T21:02:31.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.008279+0000", 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7099999999999998e-06 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.008289+0000", 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0456e-05 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.008296+0000", 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8310000000000003e-06 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.008353+0000", 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6988999999999999e-05 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.008483+0000", 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012955200000000001 2024-09-20T21:02:31.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.008611+0000", 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012847100000000001 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.010739+0000", 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002127341 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:139047 5.a e52/21 5:501ef464:::benchmark_data_smithi112_23632_object6943:head v 52'8713, mlcod=52'8710)", 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:31.010601+0000", 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00080281199999999997, 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00090956399999999997, 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.010601+0000", 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.010601+0000", 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.010602+0000", 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.61e-07 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.010607+0000", 2024-09-20T21:02:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.242e-06 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.010617+0000", 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6670000000000008e-06 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.010645+0000", 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.811e-05 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.010689+0000", 2024-09-20T21:02:31.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3661000000000001e-05 2024-09-20T21:02:31.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.010700+0000", 2024-09-20T21:02:31.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1075e-05 2024-09-20T21:02:31.027 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:139030 5.b e52/21 ondisk, result = 0)", 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:31.011382+0000", 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 2.2648000000000001e-05, 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017715100000000001, 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.011382+0000", 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.011382+0000", 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.011382+0000", 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4999999999999998e-07 2024-09-20T21:02:31.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.011385+0000", 2024-09-20T21:02:31.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.9500000000000001e-06 2024-09-20T21:02:31.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.011392+0000", 2024-09-20T21:02:31.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1980000000000004e-06 2024-09-20T21:02:31.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.011397+0000", 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4309999999999996e-06 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.011439+0000", 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2772000000000003e-05 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.011447+0000", 2024-09-20T21:02:31.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.277e-06 2024-09-20T21:02:31.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:31.011559+0000", 2024-09-20T21:02:31.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000112073 2024-09-20T21:02:31.032 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.032 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.032 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.032 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.032 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:31.033 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 3 2024-09-20T21:02:31.033 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:31.033 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:02:31.035 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:31.078 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:31.077+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:31.161 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:31.156+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:31.192 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:31.192 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:31.192 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:31.192 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:31.192 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:31.211 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:31.262 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:31.256+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:31.363 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:31.361+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:31.405 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:31.405 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:31.405 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:31.405 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:31.405 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.405 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:31.405 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:31.405 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.207199454000005, 2024-09-20T21:02:31.405 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:31.405 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.406 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:31.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:31.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:31.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.207109418000002, 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:31.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:31.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:31.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:31.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:31.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:31.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.415 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:31.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:31.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:31.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:31.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.418 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.207023065000001, 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:31.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:31.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:31.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:31.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:31.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:31.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.422 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:31.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:31.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:31.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:31.424 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.424 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.424 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.424 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:31.424 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:31.424 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.424 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.424 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:31.424 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:31.424 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:31.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.426 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:31.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:31.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.426 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:31.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:31.426 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.206954256000003, 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.427 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:31.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:31.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.433 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.434 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:31.434 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:31.434 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.206921395999998, 2024-09-20T21:02:31.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:31.434 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.434 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.434 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:31.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:31.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.440 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.206879379, 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:31.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.442 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.442 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:31.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.442 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.442 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:31.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:31.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:31.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:31.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:31.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.447 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.206754273000001, 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:31.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:31.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:31.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.454 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.455 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.455 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:31.455 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:31.455 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.206661924000002, 2024-09-20T21:02:31.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:31.455 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.455 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.455 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.459 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.206577551999999, 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:31.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:31.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 40.441118095999997, 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:31.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.466 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:31.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:31.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:31.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:31.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:31.471 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.471 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.471 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.471 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 40.440566089999997, 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:31.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:31.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:31.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:31.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 40.439938509000001, 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.478 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:31.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:31.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:31.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:31.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:31.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:31.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:31.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:31.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:31.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:31.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:31.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:31.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:31.486 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.486 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.486 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.486 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:31.486 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:31.487 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 40.4398275, 2024-09-20T21:02:31.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:31.487 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.487 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.487 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.487 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.487 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.488 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.488 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:31.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.488 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:31.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:31.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:31.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:31.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.493 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 40.436160987999997, 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.494 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:31.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:31.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:31.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:31.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:31.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:31.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:31.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:31.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:31.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:31.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:31.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:31.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:31.501 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 40.435846654000002, 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:31.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.507 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 40.435664535999997, 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.508 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:31.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:31.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:31.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:31.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:31.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 19.690204612999999, 2024-09-20T21:02:31.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:31.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:31.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:31.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:31.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:31.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 19.685853688000002, 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:31.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:31.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:31.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:31.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.527 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 19.677611617, 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.528 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:31.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:31.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:127649 5.b 5:df1d496f:::benchmark_data_smithi112_23632_object127648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 6.2356766810000002, 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023813432999999998, 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:31.534 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 127649 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167595+0000", 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167688+0000", 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2756000000000004e-05 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167703+0000", 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5048999999999999e-05 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167710+0000", 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0099999999999998e-06 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:31.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167758+0000", 2024-09-20T21:02:31.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8479000000000001e-05 2024-09-20T21:02:31.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:31.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167873+0000", 2024-09-20T21:02:31.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114753 2024-09-20T21:02:31.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:31.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167985+0000", 2024-09-20T21:02:31.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011221 2024-09-20T21:02:31.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:31.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.171532+0000", 2024-09-20T21:02:31.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035466080000000001 2024-09-20T21:02:31.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:31.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191348+0000", 2024-09-20T21:02:31.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019815856 2024-09-20T21:02:31.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.540 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:31.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191382+0000", 2024-09-20T21:02:31.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4156999999999998e-05 2024-09-20T21:02:31.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:31.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:31.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:31.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191408+0000", 2024-09-20T21:02:31.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5788000000000001e-05 2024-09-20T21:02:31.541 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.541 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.541 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.541 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:31.541 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:31.542 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:31.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:31.543 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-20T21:02:31.554 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:31.541+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:31.554 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:31.644 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:31.640+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:31.653 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-09-20T21:02:31.653 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-09-20T21:02:31.708 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:31.708 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:31.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.708 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140839 5.3 5:c3a08d85:::benchmark_data_smithi112_23632_object8735:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.708 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.702105+0000", 2024-09-20T21:02:31.708 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001886923, 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019115779999999999, 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140839 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702105+0000", 2024-09-20T21:02:31.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702105+0000", 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702106+0000", 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1299999999999998e-07 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702112+0000", 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3729999999999998e-06 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702132+0000", 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0051000000000002e-05 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702141+0000", 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7800000000000006e-06 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.703727+0000", 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015861060000000001 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.703806+0000", 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9435000000000001e-05 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.712 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140840 5.3 5.c599ee43 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.702705+0000", 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001286241, 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001390336, 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140840 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.713 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702705+0000", 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702705+0000", 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702706+0000", 2024-09-20T21:02:31.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.37e-07 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702709+0000", 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8320000000000002e-06 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702714+0000", 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.643e-06 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702718+0000", 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9199999999999997e-06 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140822 5.4 5:2a5755b7:::benchmark_data_smithi112_23632_object8718:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.695284+0000", 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0087081980000000003, 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0088686830000000005, 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:31.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140822 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.695284+0000", 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.695284+0000", 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.695284+0000", 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1099999999999995e-07 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.695288+0000", 2024-09-20T21:02:31.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9759999999999997e-06 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.695298+0000", 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7229999999999999e-06 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.695304+0000", 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2689999999999996e-06 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697422+0000", 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021179189999999998 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697514+0000", 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1636000000000002e-05 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:31.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697574+0000", 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0356000000000003e-05 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140826 5.8 5:1b1b8c72:::benchmark_data_smithi112_23632_object8722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.697460+0000", 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0065314400000000003, 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0067615740000000002, 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.721 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140826 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697460+0000", 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697460+0000", 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697461+0000", 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0279999999999999e-06 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697466+0000", 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8840000000000002e-06 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697475+0000", 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0140000000000004e-06 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697484+0000", 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5920000000000001e-06 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697535+0000", 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1150000000000003e-05 2024-09-20T21:02:31.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697652+0000", 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117427 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697758+0000", 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105424 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.704157+0000", 2024-09-20T21:02:31.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063990610000000002 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140827 5.1 5:8de79681:::benchmark_data_smithi112_23632_object8723:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.697795+0000", 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0061963290000000004, 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065018879999999999, 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:31.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140827 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697795+0000", 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697795+0000", 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697796+0000", 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7700000000000004e-07 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697799+0000", 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0400000000000001e-06 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697807+0000", 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8539999999999997e-06 2024-09-20T21:02:31.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697813+0000", 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6400000000000002e-06 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697858+0000", 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5266999999999999e-05 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.697970+0000", 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112033 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140828 5.8 5:12b52c9e:::benchmark_data_smithi112_23632_object8724:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.698990+0000", 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0050017409999999997, 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053715689999999996, 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.730 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140828 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.698990+0000", 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.698990+0000", 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.698991+0000", 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7400000000000003e-07 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.698994+0000", 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2509999999999999e-06 2024-09-20T21:02:31.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699002+0000", 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0430000000000008e-06 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699007+0000", 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7310000000000001e-06 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699554+0000", 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00054697999999999997 2024-09-20T21:02:31.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699668+0000", 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011451300000000001 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699779+0000", 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110921 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140829 5.4 5:2188a901:::benchmark_data_smithi112_23632_object8725:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.699017+0000", 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0049747300000000001, 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054128270000000003, 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140829 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699017+0000", 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699017+0000", 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699017+0000", 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6100000000000002e-07 2024-09-20T21:02:31.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699020+0000", 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.92e-06 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699028+0000", 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1650000000000006e-06 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699034+0000", 2024-09-20T21:02:31.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2950000000000001e-06 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701265+0000", 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022310020000000002 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701408+0000", 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014294399999999999 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701525+0000", 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011712700000000001 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140830 5.3 5:c04d5fee:::benchmark_data_smithi112_23632_object8726:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.699043+0000", 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0049489900000000003, 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054574970000000004, 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.739 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140830 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699043+0000", 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699043+0000", 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699043+0000", 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9999999999999998e-07 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699046+0000", 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4719999999999998e-06 2024-09-20T21:02:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699051+0000", 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0860000000000001e-06 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699054+0000", 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9639999999999999e-06 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699094+0000", 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9913000000000002e-05 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699214+0000", 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012086700000000001 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:140831 5.b e52/21 5:d4413b67:::benchmark_data_smithi112_23632_object8727:head v 52'8976, mlcod=52'8974)", 2024-09-20T21:02:31.743 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.699625+0000", 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0043670660000000002, 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049369180000000002, 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699625+0000", 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699625+0000", 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699625+0000", 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4700000000000001e-07 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699634+0000", 2024-09-20T21:02:31.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1060000000000006e-06 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699643+0000", 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.507e-06 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699650+0000", 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9129999999999997e-06 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699720+0000", 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0257000000000002e-05 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699739+0000", 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9334000000000002e-05 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140832 5.4 5:25d77a26:::benchmark_data_smithi112_23632_object8728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.699676+0000", 2024-09-20T21:02:31.747 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0043158500000000004, 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049420590000000004, 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140832 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699676+0000", 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699676+0000", 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699676+0000", 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7299999999999996e-07 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699679+0000", 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9189999999999999e-06 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699685+0000", 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6289999999999998e-06 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699689+0000", 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2030000000000002e-06 2024-09-20T21:02:31.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702757+0000", 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030681839999999998 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702877+0000", 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011941499999999999 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:31.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702996+0000", 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119286 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140834 5.3 5:c6e6ee64:::benchmark_data_smithi112_23632_object8730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.699818+0000", 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0041736880000000001, 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004872688, 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:31.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140834 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699818+0000", 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699818+0000", 2024-09-20T21:02:31.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699819+0000", 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699821+0000", 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6749999999999998e-06 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699829+0000", 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6380000000000004e-06 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.699835+0000", 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8300000000000001e-06 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701029+0000", 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001194187 2024-09-20T21:02:31.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701095+0000", 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6130999999999994e-05 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140835 5.c 5:3eec2f1a:::benchmark_data_smithi112_23632_object8731:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.701206+0000", 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002785423, 2024-09-20T21:02:31.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035553220000000001, 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140835 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701206+0000", 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701206+0000", 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701207+0000", 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5799999999999998e-07 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701211+0000", 2024-09-20T21:02:31.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2819999999999998e-06 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701220+0000", 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7600000000000008e-06 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701226+0000", 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1550000000000004e-06 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702741+0000", 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001514528 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702808+0000", 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7453000000000006e-05 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:140838 5.3 5:c016aa63:::benchmark_data_smithi112_23632_object8734:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:31.701795+0000", 2024-09-20T21:02:31.760 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0021971220000000001, 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00303638, 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140838 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701795+0000", 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701795+0000", 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701795+0000", 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9100000000000003e-07 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701800+0000", 2024-09-20T21:02:31.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3309999999999997e-06 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701812+0000", 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2291e-05 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.701820+0000", 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3559999999999993e-06 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:31.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702169+0000", 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034912499999999999 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:31.702304+0000", 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000134406 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 13 2024-09-20T21:02:31.764 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:31.765 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:31.766 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:31.766 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:31.766 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:31.767 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:31.768 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:31.768 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:31.768 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:31.768 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:31.761+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:31.866 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:31.865+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:31.961 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:31.962 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:31.967 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:31.965+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:31.984 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:32.068 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:32.065+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:32.139 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:32.140 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:32.159 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:32.206 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:32.205+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:32.269 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:32.265+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:32.305 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:32.305 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:32.325 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:32.369 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:32.364+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:32.470 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:32.469+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:32.512 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:32.513 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:32.534 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:32.578 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:32.577+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:32.672 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:32.668+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:32.728 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:32.728 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:32.748 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:32.792 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:32.788+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:32.874 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:32.869+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:32.904 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:32.905 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:32.925 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:33.017 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:33.012+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:33.035 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:02:33.075 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:33.068+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:33.124 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:33.124 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:33.145 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:33.189 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:33.184+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:33.276 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:33.273+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:33.339 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:33.339 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:33.358 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:33.400 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:33.396+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:33.477 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:33.473+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:33.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-09-20T21:02:33.512 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:33.512 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:33.532 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:33.622 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:33.621+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:33.680 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:33.676+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:33.721 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:33.721 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:33.740 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:33.769 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:33.780 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:33.776+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:33.881 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:33.877+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:33.926 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:33.926 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:33.927 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:33.928 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:33.928 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:33.945 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:33.945 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:33.947 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:33.948 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:33.949 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:33.991 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:02:33.996 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:33.992+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:34.083 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:34.081+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:34.099 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:34.099 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:34.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.099 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146967 5.8 5:1ca8e52c:::benchmark_data_smithi112_23632_object14863:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.099 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.094916+0000", 2024-09-20T21:02:34.099 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0028983759999999998, 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029153450000000002, 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146967 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094916+0000", 2024-09-20T21:02:34.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094916+0000", 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094916+0000", 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9500000000000002e-07 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094919+0000", 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7609999999999999e-06 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094925+0000", 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1800000000000001e-06 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094929+0000", 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4759999999999998e-06 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094965+0000", 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6170000000000001e-05 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095073+0000", 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108145 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095170+0000", 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6773000000000003e-05 2024-09-20T21:02:34.103 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:146963 5.0 e53/21 5:085c9231:::benchmark_data_smithi112_23632_object14859:head v 53'9167, mlcod=53'9165)", 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.094944+0000", 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0028696350000000002, 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029683330000000001, 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.104 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094944+0000", 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094944+0000", 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094945+0000", 2024-09-20T21:02:34.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4200000000000002e-07 2024-09-20T21:02:34.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094950+0000", 2024-09-20T21:02:34.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0710000000000002e-06 2024-09-20T21:02:34.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094957+0000", 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.776e-06 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094961+0000", 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7539999999999997e-06 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095052+0000", 2024-09-20T21:02:34.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0927000000000005e-05 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095063+0000", 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0321e-05 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:146965 5.e e53/21 5:7fb03255:::benchmark_data_smithi112_23632_object14861:head v 53'9129, mlcod=53'9127)", 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.094979+0000", 2024-09-20T21:02:34.108 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0028350340000000002, 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029835019999999999, 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094979+0000", 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094979+0000", 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094979+0000", 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9400000000000001e-07 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094986+0000", 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2940000000000002e-06 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094993+0000", 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6920000000000002e-06 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094998+0000", 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095044+0000", 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5484e-05 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095061+0000", 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7221999999999999e-05 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146968 5.4 5:237f18e1:::benchmark_data_smithi112_23632_object14864:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.095214+0000", 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002600247, 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027815029999999998, 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.112 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146968 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095214+0000", 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095214+0000", 2024-09-20T21:02:34.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095215+0000", 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2699999999999999e-07 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095218+0000", 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5039999999999998e-06 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095227+0000", 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7930000000000003e-06 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095233+0000", 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1539999999999999e-06 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095283+0000", 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9691000000000002e-05 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095384+0000", 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100896 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095476+0000", 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2027999999999994e-05 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146969 5.7 5:e20102bb:::benchmark_data_smithi112_23632_object14865:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.096032+0000", 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0017819159999999999, 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0020030960000000002, 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146969 2024-09-20T21:02:34.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096032+0000", 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096032+0000", 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096033+0000", 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8599999999999997e-07 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096052+0000", 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9474e-05 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096062+0000", 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0018e-05 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096069+0000", 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5220000000000004e-06 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096139+0000", 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0277999999999994e-05 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096250+0000", 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111023 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146971 5.2 5:4078529a:::benchmark_data_smithi112_23632_object14867:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.096835+0000", 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00097939500000000009, 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012346060000000001, 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146971 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.121 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096835+0000", 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096835+0000", 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096836+0000", 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4099999999999997e-07 2024-09-20T21:02:34.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096840+0000", 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3449999999999999e-06 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096851+0000", 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0888e-05 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096857+0000", 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5209999999999999e-06 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097290+0000", 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043257000000000001 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097408+0000", 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011780199999999999 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146972 5.8 5:11dfaeac:::benchmark_data_smithi112_23632_object14868:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.097735+0000", 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 7.9509000000000001e-05, 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038659399999999998, 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146972 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097735+0000", 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097735+0000", 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097736+0000", 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3200000000000003e-07 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097739+0000", 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7390000000000001e-06 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097749+0000", 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2900000000000008e-06 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097756+0000", 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3769999999999998e-06 2024-09-20T21:02:34.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097809+0000", 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2592000000000001e-05 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097923+0000", 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114925 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.098043+0000", 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011995800000000001 2024-09-20T21:02:34.128 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146973 5.1 5:810515d6:::benchmark_data_smithi112_23632_object14869:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.097877+0000", 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9999375, 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029925399999999999, 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.129 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146973 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097877+0000", 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097877+0000", 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097878+0000", 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7899999999999997e-07 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097881+0000", 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6519999999999999e-06 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097891+0000", 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0227000000000001e-05 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097898+0000", 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7229999999999998e-06 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.097948+0000", 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0204000000000002e-05 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.098074+0000", 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012548299999999999 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.132 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146949 5.5 5:a58fa68c:::benchmark_data_smithi112_23632_object14845:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.088740+0000", 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0090742870000000003, 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094732889999999993, 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.133 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146949 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.088740+0000", 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.088740+0000", 2024-09-20T21:02:34.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.088741+0000", 2024-09-20T21:02:34.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0999999999999998e-07 2024-09-20T21:02:34.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.088744+0000", 2024-09-20T21:02:34.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7799999999999998e-06 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.088754+0000", 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5389999999999996e-06 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.088761+0000", 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7700000000000004e-06 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.089997+0000", 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001236109 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090100+0000", 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010325199999999999 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.098097+0000", 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079974629999999998 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.098144+0000", 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6989e-05 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146950 5.5 5:a6ec529b:::benchmark_data_smithi112_23632_object14846:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.089059+0000", 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0087555399999999992, 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0092253890000000005, 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.138 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146950 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.089059+0000", 2024-09-20T21:02:34.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.089059+0000", 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.089059+0000", 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.089063+0000", 2024-09-20T21:02:34.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8149999999999999e-06 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.089072+0000", 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7430000000000008e-06 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.089078+0000", 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5749999999999997e-06 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.091422+0000", 2024-09-20T21:02:34.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023435499999999998 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.091558+0000", 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000135981 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.098285+0000", 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0067271969999999999 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146952 5.5 5:a0dc132f:::benchmark_data_smithi112_23632_object14848:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.090582+0000", 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0072325999999999996, 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077422560000000003, 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146952 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.143 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090582+0000", 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090582+0000", 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090582+0000", 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1999999999999998e-07 2024-09-20T21:02:34.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090596+0000", 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.325e-05 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090608+0000", 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2278e-05 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090616+0000", 2024-09-20T21:02:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.559e-06 2024-09-20T21:02:34.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.093109+0000", 2024-09-20T21:02:34.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0024933329999999999 2024-09-20T21:02:34.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.093230+0000", 2024-09-20T21:02:34.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121014 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146953 5.5 5:a169e8f4:::benchmark_data_smithi112_23632_object14849:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.090630+0000", 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00718404, 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077428849999999997, 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.147 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146953 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090630+0000", 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090630+0000", 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090631+0000", 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9999999999999997e-07 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090633+0000", 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7829999999999999e-06 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090641+0000", 2024-09-20T21:02:34.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5889999999999997e-06 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090647+0000", 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.835e-06 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094847+0000", 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0042000600000000003 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094980+0000", 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133058 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146955 5.5 5:a54169ed:::benchmark_data_smithi112_23632_object14851:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.090730+0000", 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0070843520000000004, 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0076898599999999998, 2024-09-20T21:02:34.151 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146955 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090730+0000", 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090730+0000", 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090730+0000", 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2799999999999996e-07 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090734+0000", 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5999999999999998e-06 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090744+0000", 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8139999999999995e-06 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.090753+0000", 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8929999999999994e-06 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096515+0000", 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.005761927 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.096632+0000", 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117446 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146960 5.2 5:437545b7:::benchmark_data_smithi112_23632_object14856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.092840+0000", 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0049738450000000002, 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056285090000000003, 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146960 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.156 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.092840+0000", 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.092840+0000", 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.092841+0000", 2024-09-20T21:02:34.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2600000000000001e-07 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.092845+0000", 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9539999999999998e-06 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.092857+0000", 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1759999999999999e-05 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.092864+0000", 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4200000000000001e-06 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.093179+0000", 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031425600000000001 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.093254+0000", 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5077e-05 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.159 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:146966 5.3 5:ce1382db:::benchmark_data_smithi112_23632_object14862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:34.094874+0000", 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002939924, 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0036341640000000001, 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.160 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 146966 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094874+0000", 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094874+0000", 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094875+0000", 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7100000000000001e-07 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094879+0000", 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.941e-06 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094886+0000", 2024-09-20T21:02:34.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.094892+0000", 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9660000000000001e-06 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095653+0000", 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00076053799999999995 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:34.095755+0000", 2024-09-20T21:02:34.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102666 2024-09-20T21:02:34.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.164 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.164 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:34.164 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 15 2024-09-20T21:02:34.164 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:34.165 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:34.184 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:34.181+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:34.284 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:34.281+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:34.352 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:34.352 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:34.373 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:34.384 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:34.381+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:34.485 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:34.481+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:34.531 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.334121139000004, 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.333986940000003, 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.333881934000004, 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.333762409000002, 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.333692401999997, 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.333617349999997, 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.333530323999994, 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.333461550999999, 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.815714887999999, 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.812879245000001, 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.812429439999999, 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.812326275, 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.812238289, 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.811425785000001, 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.809657225999999, 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.809192707000001, 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.808996835999999, 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.808514973000001, 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.806366913000002, 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.803235629, 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:34.643 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:34.645 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:34.645 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:34.640+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:34.745 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:34.741+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:34.796 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:34.796 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:34.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.796 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:148713 5.b 5:d87a215c:::benchmark_data_smithi112_23632_object16609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.796 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:34.787255+0000", 2024-09-20T21:02:34.796 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0087136939999999993, 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0087345749999999996, 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 148713 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.787255+0000", 2024-09-20T21:02:34.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.787255+0000", 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.787256+0000", 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4899999999999995e-07 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:34.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.787263+0000", 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.934e-06 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.787273+0000", 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.043e-05 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.787281+0000", 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.790508+0000", 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0032272490000000002 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.790679+0000", 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017087100000000001 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.790825+0000", 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014585100000000001 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795884+0000", 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050587999999999996 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:148718 5.f 5:ffda1bbd:::benchmark_data_smithi112_23632_object16614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:34.788902+0000", 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.007066915, 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0071797839999999998, 2024-09-20T21:02:34.801 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:34.802 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:34.802 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:34.802 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:34.802 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:34.802 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.802 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 148718 2024-09-20T21:02:34.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.788902+0000", 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.788902+0000", 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.788903+0000", 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4499999999999996e-07 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.788906+0000", 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6009999999999999e-06 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.788918+0000", 2024-09-20T21:02:34.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1473e-05 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.788926+0000", 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0099999999999995e-06 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.788980+0000", 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4035e-05 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:34.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.789104+0000", 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012437400000000001 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.796056+0000", 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0069522589999999997 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:148720 5.f 5:fe5f2bef:::benchmark_data_smithi112_23632_object16616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:34.792830+0000", 2024-09-20T21:02:34.806 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0031390979999999999, 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0033456879999999999, 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 148720 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.792830+0000", 2024-09-20T21:02:34.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.792830+0000", 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.792830+0000", 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.85e-07 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.792834+0000", 2024-09-20T21:02:34.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0799999999999999e-06 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.792846+0000", 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1079e-05 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.792852+0000", 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4139999999999999e-06 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:34.809 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.792901+0000", 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8705999999999998e-05 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.793035+0000", 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013455300000000001 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:148724 5.a e53/21 5:5771c553:::benchmark_data_smithi112_23632_object16620:head v 53'9361, mlcod=53'9359)", 2024-09-20T21:02:34.810 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:34.794555+0000", 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001413798, 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001665971, 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.794555+0000", 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:34.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.794555+0000", 2024-09-20T21:02:34.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:34.812 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.794556+0000", 2024-09-20T21:02:34.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4899999999999995e-07 2024-09-20T21:02:34.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:34.812 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.794560+0000", 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6739999999999996e-06 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.794574+0000", 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3338e-05 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.794578+0000", 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8879999999999996e-06 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.813 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.794629+0000", 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0584999999999998e-05 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.794662+0000", 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2629000000000002e-05 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:148728 5.e 5:73edda36:::benchmark_data_smithi112_23632_object16624:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:34.795132+0000", 2024-09-20T21:02:34.814 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000836431, 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0011244029999999999, 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 148728 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795132+0000", 2024-09-20T21:02:34.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795132+0000", 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795133+0000", 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8999999999999995e-07 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795138+0000", 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6569999999999996e-06 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795150+0000", 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2166e-05 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795156+0000", 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.127e-06 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.817 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795208+0000", 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1458000000000001e-05 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795290+0000", 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2514000000000003e-05 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795356+0000", 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5594999999999998e-05 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.818 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:148729 5.e 5.3dabf9de (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:34.795171+0000", 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00079795400000000002, 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001124695, 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:34.819 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 148729 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795171+0000", 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795171+0000", 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795171+0000", 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3500000000000002e-07 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795173+0000", 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8700000000000001e-06 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795177+0000", 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4769999999999997e-06 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.795181+0000", 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.117e-06 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:148725 5.a e53/21)", 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:34.796124+0000", 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9998446, 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000200287, 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:34.822 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.796124+0000", 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.796124+0000", 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.796125+0000", 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0699999999999996e-07 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.796131+0000", 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1800000000000001e-06 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.796141+0000", 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0137e-05 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:34.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:34.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:34.825 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:34.796149+0000", 2024-09-20T21:02:34.825 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0380000000000002e-06 2024-09-20T21:02:34.825 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.825 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:34.825 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.825 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:34.825 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:34.825 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 7 2024-09-20T21:02:34.825 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:34.826 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:34.846 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:34.840+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:34.946 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:34.940+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:35.018 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:35.018 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:35.018 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:35.018 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:35.019 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:35.038 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:35.047 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:35.040+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:35.148 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:35.145+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:35.188 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:35.188 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.990120343000001, 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:35.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:35.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:35.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.990030306999998, 2024-09-20T21:02:35.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:35.196 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.196 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.196 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.196 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:35.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.989943953999997, 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.202 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:35.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:35.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:35.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:35.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:35.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.989875144999999, 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:35.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:35.214 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.989842284999995, 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:35.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:35.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:35.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.222 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.989800267999996, 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:35.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:35.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:35.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:35.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:35.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:35.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:35.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:35.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:35.229 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.229 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.229 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.230 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.230 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:35.230 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.989675161999997, 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:35.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:35.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.989582812999998, 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.241 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.989498440999995, 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.242 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 44.224038985, 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.246 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:35.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:35.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 44.223486979, 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.252 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:35.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:35.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:35.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 44.222859397999997, 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.258 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:35.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:35.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 44.222748389000003, 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.264 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:35.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:35.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.269 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 44.219081877000001, 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:35.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 44.218767542999998, 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:35.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.281 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 44.218585425000001, 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:35.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:35.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.473125501999998, 2024-09-20T21:02:35.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:35.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.468774577000001, 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.293 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:35.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.460532506, 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.299 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:35.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.304 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:127649 5.b 5:df1d496f:::benchmark_data_smithi112_23632_object127648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 10.018597570000001, 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023813432999999998, 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 127649 2024-09-20T21:02:35.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:35.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167595+0000", 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167688+0000", 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2756000000000004e-05 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167703+0000", 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5048999999999999e-05 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167710+0000", 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0099999999999998e-06 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167758+0000", 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8479000000000001e-05 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167873+0000", 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114753 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167985+0000", 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011221 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.171532+0000", 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035466080000000001 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191348+0000", 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019815856 2024-09-20T21:02:35.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191382+0000", 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4156999999999998e-05 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191408+0000", 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5788000000000001e-05 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:35.310 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:35.311 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:35.312 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:35.309+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:35.312 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:35.412 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:35.409+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:150433 5.3 5:c1f98b9e:::benchmark_data_smithi112_23632_object18329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:35.455740+0000", 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0022880909999999999, 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023121159999999999, 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 150433 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455740+0000", 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455740+0000", 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455740+0000", 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.75e-07 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455744+0000", 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.687e-06 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455753+0000", 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7569999999999993e-06 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455759+0000", 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7800000000000003e-06 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455818+0000", 2024-09-20T21:02:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8989000000000001e-05 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.456019+0000", 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020018100000000001 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:150435 5.8 5:18f3e04c:::benchmark_data_smithi112_23632_object18331:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:35.455797+0000", 2024-09-20T21:02:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0022310490000000001, 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002329298, 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 150435 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455797+0000", 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455797+0000", 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455797+0000", 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1600000000000001e-07 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455803+0000", 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1970000000000001e-06 2024-09-20T21:02:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455812+0000", 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7250000000000003e-06 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455818+0000", 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0279999999999997e-06 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455866+0000", 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8093999999999997e-05 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455978+0000", 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111934 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.456087+0000", 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108675 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:150437 5.1 5:8b013888:::benchmark_data_smithi112_23632_object18333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:35.455834+0000", 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00219374, 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023592840000000001, 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 150437 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455834+0000", 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455834+0000", 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455834+0000", 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999997e-07 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455837+0000", 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4030000000000001e-06 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455845+0000", 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5860000000000005e-06 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455851+0000", 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0020000000000003e-06 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455901+0000", 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9740000000000001e-05 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.456052+0000", 2024-09-20T21:02:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150884 2024-09-20T21:02:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:150438 5.7 5:eddf4093:::benchmark_data_smithi112_23632_object18334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:35.457442+0000", 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00058538999999999998, 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00081154199999999995, 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 150438 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457442+0000", 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457442+0000", 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457443+0000", 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6099999999999999e-07 2024-09-20T21:02:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457448+0000", 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2510000000000002e-06 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457459+0000", 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0437e-05 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457465+0000", 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5640000000000002e-06 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457531+0000", 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5197000000000006e-05 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457648+0000", 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117314 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:150436 5.e e53/21 5:7f0f0609:::benchmark_data_smithi112_23632_object18332:head v 53'9321, mlcod=53'9319)", 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:35.457734+0000", 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00029324800000000002, 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058059599999999996, 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457734+0000", 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457734+0000", 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457735+0000", 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3099999999999996e-07 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457741+0000", 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.643e-06 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457748+0000", 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8920000000000003e-06 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457753+0000", 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.797e-06 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457927+0000", 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017430200000000001 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.457950+0000", 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2816e-05 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:150425 5.5 5:ac04205e:::benchmark_data_smithi112_23632_object18321:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:35.451996+0000", 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0060314080000000003, 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063749490000000004, 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 150425 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.451996+0000", 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.451996+0000", 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.451997+0000", 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8599999999999998e-07 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.452000+0000", 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.931e-06 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.452010+0000", 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0682e-05 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.452016+0000", 2024-09-20T21:02:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9460000000000003e-06 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.453921+0000", 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019043269999999999 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.454073+0000", 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000151819 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:150427 5.2 5:4ff78fdd:::benchmark_data_smithi112_23632_object18323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:35.452092+0000", 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0059358329999999997, 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063407819999999997, 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 150427 2024-09-20T21:02:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.452092+0000", 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.452092+0000", 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.452092+0000", 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6100000000000001e-07 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.452095+0000", 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9620000000000002e-06 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.452106+0000", 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0234999999999999e-05 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.452113+0000", 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6629999999999993e-06 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.454030+0000", 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019165269999999999 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.454159+0000", 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012894499999999999 2024-09-20T21:02:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:150429 5.7 5:e7326e0e:::benchmark_data_smithi112_23632_object18325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:35.455216+0000", 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0028116119999999998, 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032791679999999998, 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 150429 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455216+0000", 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455216+0000", 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455217+0000", 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.125e-06 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455222+0000", 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3210000000000004e-06 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455232+0000", 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.73e-06 2024-09-20T21:02:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455240+0000", 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2730000000000002e-06 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455321+0000", 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0525000000000006e-05 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455406+0000", 2024-09-20T21:02:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5069999999999997e-05 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:150430 5.2 5:4f4c0882:::benchmark_data_smithi112_23632_object18326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:35.455257+0000", 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002770705, 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032978579999999999, 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 150430 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455257+0000", 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455257+0000", 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455257+0000", 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8800000000000003e-07 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455260+0000", 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7879999999999998e-06 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455267+0000", 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1799999999999999e-06 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455273+0000", 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2599999999999996e-06 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455738+0000", 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046567000000000001 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455840+0000", 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101269 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:150432 5.6 5:6c10683e:::benchmark_data_smithi112_23632_object18328:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:35.455282+0000", 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0027457250000000001, 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033325859999999998, 2024-09-20T21:02:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 150432 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455282+0000", 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455282+0000", 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455282+0000", 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6100000000000001e-07 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455285+0000", 2024-09-20T21:02:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5629999999999999e-06 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455292+0000", 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7020000000000004e-06 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455297+0000", 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4029999999999998e-06 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455345+0000", 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7945000000000003e-05 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:35.455434+0000", 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9287000000000001e-05 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 10 2024-09-20T21:02:35.502 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:35.503 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:35.548 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:35.544+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:35.615 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:35.608+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:35.652 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:35.652 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:35.671 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:35.716 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:35.713+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:35.818 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:35.812+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:35.861 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:35.861 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:35.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:35.861 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 83.664384061999996, 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:35.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:35.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:35.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:35.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 83.664249862999995, 2024-09-20T21:02:35.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:35.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:35.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.874 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 83.664144856999997, 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:35.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:35.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:35.880 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 83.664025331999994, 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:35.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:35.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:35.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 83.663955325000003, 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:35.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:35.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:35.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 83.663880273000004, 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:35.895 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:35.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:35.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:35.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:35.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 83.663793247000001, 2024-09-20T21:02:35.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:35.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.906 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 83.663724474000006, 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:35.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:35.911 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.145977811000002, 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:35.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.916 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.143142168000001, 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:35.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:35.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:35.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:35.922 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.142692362999998, 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:35.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:35.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:35.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.142589198, 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:35.928 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:35.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:35.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.142501211999999, 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.934 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:35.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:35.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.141688708, 2024-09-20T21:02:35.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:35.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:35.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:35.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:35.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.139920149000002, 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.13945563, 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.951 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:35.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:35.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:35.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.139259759000002, 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:35.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:35.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.138777896000001, 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.963 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:35.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.968 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.136629836000001, 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:35.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:35.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:35.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.974 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.133498551999999, 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:35.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:35.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:35.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:35.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:35.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:35.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:35.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.979 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:35.979 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:35.979 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:35.980 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:35.981 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:35.977+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:35.981 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:36.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:02:36.082 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:36.077+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:36.137 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:36.137 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:36.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.137 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:152131 5.8 e53/38 5:16e6d081:::benchmark_data_smithi112_23632_object20027:head v 53'9550, mlcod=53'9548)", 2024-09-20T21:02:36.137 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:36.132915+0000", 2024-09-20T21:02:36.137 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0035360220000000002, 2024-09-20T21:02:36.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035592559999999998, 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.132915+0000", 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:36.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.132915+0000", 2024-09-20T21:02:36.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:36.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.132916+0000", 2024-09-20T21:02:36.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1999999999999998e-07 2024-09-20T21:02:36.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.132923+0000", 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.562e-06 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.132936+0000", 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3402e-05 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.132944+0000", 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4909999999999999e-06 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.133002+0000", 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8449000000000002e-05 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.133024+0000", 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1708e-05 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:152133 5.9 5:9e9cd1e0:::benchmark_data_smithi112_23632_object20029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:36.141 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:36.133194+0000", 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.003257369, 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0033457700000000001, 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 152133 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:36.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.133194+0000", 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.133194+0000", 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.133195+0000", 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2099999999999995e-07 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:36.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.133200+0000", 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7879999999999997e-06 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.133211+0000", 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1224e-05 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.133218+0000", 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.793e-06 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.133283+0000", 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5388000000000005e-05 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.133412+0000", 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000128388 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:152135 5.d 5:b21380df:::benchmark_data_smithi112_23632_object20031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:36.145 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:36.134705+0000", 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0017464379999999999, 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019022380000000001, 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 152135 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:36.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134705+0000", 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134705+0000", 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134706+0000", 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.37e-07 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134710+0000", 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7050000000000001e-06 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134718+0000", 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3219999999999993e-06 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134723+0000", 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9799999999999998e-06 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135049+0000", 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032587700000000002 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135132+0000", 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3524999999999997e-05 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:152134 5.8 e53/38 5:160a8dcf:::benchmark_data_smithi112_23632_object20030:head v 53'9551, mlcod=53'9548)", 2024-09-20T21:02:36.149 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:36.134858+0000", 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001593735, 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018117459999999999, 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134858+0000", 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:36.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134858+0000", 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134858+0000", 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1299999999999999e-07 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134865+0000", 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5930000000000002e-06 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134876+0000", 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0496000000000001e-05 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134882+0000", 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7939999999999997e-06 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134941+0000", 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8832999999999997e-05 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:36.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.134960+0000", 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8964999999999999e-05 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:152137 5.9 5:97e4e1c3:::benchmark_data_smithi112_23632_object20033:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:36.135445+0000", 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001006685, 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001282329, 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:36.153 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 152137 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135445+0000", 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135445+0000", 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135446+0000", 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.71e-07 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135450+0000", 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4299999999999999e-06 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135460+0000", 2024-09-20T21:02:36.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0095000000000001e-05 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135467+0000", 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9650000000000002e-06 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135603+0000", 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000136043 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135732+0000", 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012874699999999999 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:152139 5.d 5:bc56d28c:::benchmark_data_smithi112_23632_object20035:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:36.135518+0000", 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000933054, 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001270513, 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:36.157 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 152139 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135518+0000", 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:36.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135518+0000", 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135519+0000", 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2699999999999999e-07 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135534+0000", 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5349000000000002e-05 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135545+0000", 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0591000000000001e-05 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135551+0000", 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9349999999999999e-06 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.136508+0000", 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00095655600000000001 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.136655+0000", 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000147863 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:152141 5.f 5:fec1c9c5:::benchmark_data_smithi112_23632_object20037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:36.135564+0000", 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00088773400000000005, 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001288394, 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:36.161 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 152141 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135564+0000", 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135564+0000", 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135564+0000", 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5900000000000002e-07 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135567+0000", 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.9040000000000001e-06 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135573+0000", 2024-09-20T21:02:36.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3119999999999999e-06 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135578+0000", 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9350000000000002e-06 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135633+0000", 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4731999999999997e-05 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135748+0000", 2024-09-20T21:02:36.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000115346 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:152138 5.4 e53/38 5:20c10490:::benchmark_data_smithi112_23632_object20034:head v 53'9577, mlcod=53'9575)", 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:36.135810+0000", 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00064138300000000004, 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001104589, 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:36.165 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135810+0000", 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135810+0000", 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135811+0000", 2024-09-20T21:02:36.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3099999999999998e-07 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135816+0000", 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.626e-06 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135825+0000", 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6319999999999997e-06 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135831+0000", 2024-09-20T21:02:36.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5209999999999999e-06 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135879+0000", 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7682999999999997e-05 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135895+0000", 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6203000000000001e-05 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:152142 5.e 5:7b468527:::benchmark_data_smithi112_23632_object20038:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:36.135891+0000", 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00056037600000000002, 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001078461, 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 152142 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.169 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135891+0000", 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135891+0000", 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135892+0000", 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8200000000000008e-07 2024-09-20T21:02:36.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135896+0000", 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2849999999999996e-06 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135907+0000", 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0117e-05 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135914+0000", 2024-09-20T21:02:36.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.007e-06 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.135968+0000", 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4218000000000002e-05 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.136102+0000", 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000134599 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.136217+0000", 2024-09-20T21:02:36.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000115104 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:152140 5.8 e53/38)", 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:36.136608+0000", 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9998436, 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000426186, 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.136608+0000", 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.136608+0000", 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.136608+0000", 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0500000000000003e-07 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.136614+0000", 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6119999999999998e-06 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.136623+0000", 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8759999999999994e-06 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:36.136630+0000", 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6290000000000004e-06 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.175 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:36.176 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.176 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:36.176 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:36.176 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 10 2024-09-20T21:02:36.176 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:36.176 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:36.177 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:36.177 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:36.178 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:36.178 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:36.179 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:36.179 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:36.179 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:36.182 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:36.176+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:36.283 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:36.280+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:36.376 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:36.377 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:36.385 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:36.380+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:36.397 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:36.485 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:36.480+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:36.552 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:36.552 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:36.573 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:36.586 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:36.585+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:36.687 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:36.685+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:36.730 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:36.731 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:36.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:36.766 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-09-20T21:02:36.766 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:02:36.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:02:36.787 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:36.785+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:36.888 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:36.884+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:36.905 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:36.905 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:36.925 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:36.989 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:36.985+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:37.023 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:02:37.090 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:37.089+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:37.094 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:02:37.097 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:02:37.110 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-20T21:02:37.018988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7530744757,"num_objects":114928,"num_object_clones":0,"num_object_copies":229856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":71537,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114928,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":149552,"num_write_kb":8457941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60074,"ondisk_log_size":60074,"up":161,"acting":161,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1415828,"kb_used_data":939052,"kb_used_omap":4,"kb_used_meta":476667,"kb_avail":281699692,"statfs":{"total":289910292480,"available":288460484608,"internally_reserved":0,"allocated":961589248,"data_stored":15357867810,"data_compressed":73645910,"data_compressed_allocated":959836160,"data_compressed_original":15357214720,"omap_allocated":4788,"internal_metadata":488107340},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-842399744,"num_objects":-12854,"num_object_clones":0,"num_object_copies":-25708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-8091,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12854,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.137290"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.007587+0000","last_change":"2024-09-20T21:02:06.428072+0000","last_active":"2024-09-20T21:02:34.007587+0000","last_peered":"2024-09-20T21:02:34.007587+0000","last_clean":"2024-09-20T21:02:34.007587+0000","last_became_active":"2024-09-20T21:02:06.427340+0000","last_became_peered":"2024-09-20T21:02:06.427340+0000","last_unstale":"2024-09-20T21:02:34.007587+0000","last_undegraded":"2024-09-20T21:02:34.007587+0000","last_fullsized":"2024-09-20T21:02:34.007587+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:07.692487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.002365+0000","last_change":"2024-09-20T21:02:06.426971+0000","last_active":"2024-09-20T21:02:34.002365+0000","last_peered":"2024-09-20T21:02:34.002365+0000","last_clean":"2024-09-20T21:02:34.002365+0000","last_became_active":"2024-09-20T21:02:06.426643+0000","last_became_peered":"2024-09-20T21:02:06.426643+0000","last_unstale":"2024-09-20T21:02:34.002365+0000","last_undegraded":"2024-09-20T21:02:34.002365+0000","last_fullsized":"2024-09-20T21:02:34.002365+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:12:01.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997616+0000","last_change":"2024-09-20T21:02:24.553073+0000","last_active":"2024-09-20T21:02:33.997616+0000","last_peered":"2024-09-20T21:02:33.997616+0000","last_clean":"2024-09-20T21:02:22.536068+0000","last_became_active":"2024-09-20T21:02:24.553073+0000","last_became_peered":"2024-09-20T21:02:24.553073+0000","last_unstale":"2024-09-20T21:02:33.997616+0000","last_undegraded":"2024-09-20T21:02:33.997616+0000","last_fullsized":"2024-09-20T21:02:24.549034+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:20.421394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002405+0000","last_change":"2024-09-20T21:02:24.571758+0000","last_active":"2024-09-20T21:02:34.002405+0000","last_peered":"2024-09-20T21:02:34.002405+0000","last_clean":"2024-09-20T21:02:22.530877+0000","last_became_active":"2024-09-20T21:02:24.571758+0000","last_became_peered":"2024-09-20T21:02:24.571758+0000","last_unstale":"2024-09-20T21:02:34.002405+0000","last_undegraded":"2024-09-20T21:02:34.002405+0000","last_fullsized":"2024-09-20T21:02:24.545572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.181299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.002937+0000","last_change":"2024-09-20T21:02:06.422301+0000","last_active":"2024-09-20T21:02:34.002937+0000","last_peered":"2024-09-20T21:02:34.002937+0000","last_clean":"2024-09-20T21:02:34.002937+0000","last_became_active":"2024-09-20T21:02:06.421576+0000","last_became_peered":"2024-09-20T21:02:06.421576+0000","last_unstale":"2024-09-20T21:02:34.002937+0000","last_undegraded":"2024-09-20T21:02:34.002937+0000","last_fullsized":"2024-09-20T21:02:34.002937+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:14.175466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002094+0000","last_change":"2024-09-20T21:02:24.551832+0000","last_active":"2024-09-20T21:02:34.002094+0000","last_peered":"2024-09-20T21:02:34.002094+0000","last_clean":"2024-09-20T21:02:22.532763+0000","last_became_active":"2024-09-20T21:02:24.551832+0000","last_became_peered":"2024-09-20T21:02:24.551832+0000","last_unstale":"2024-09-20T21:02:34.002094+0000","last_undegraded":"2024-09-20T21:02:34.002094+0000","last_fullsized":"2024-09-20T21:02:24.542990+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:15.924831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003441+0000","last_change":"2024-09-20T21:02:24.548304+0000","last_active":"2024-09-20T21:02:34.003441+0000","last_peered":"2024-09-20T21:02:34.003441+0000","last_clean":"2024-09-20T21:02:22.529880+0000","last_became_active":"2024-09-20T21:02:24.548304+0000","last_became_peered":"2024-09-20T21:02:24.548304+0000","last_unstale":"2024-09-20T21:02:34.003441+0000","last_undegraded":"2024-09-20T21:02:34.003441+0000","last_fullsized":"2024-09-20T21:02:24.542468+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:58.734864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002166+0000","last_change":"2024-09-20T21:02:24.550354+0000","last_active":"2024-09-20T21:02:34.002166+0000","last_peered":"2024-09-20T21:02:34.002166+0000","last_clean":"2024-09-20T21:02:22.529807+0000","last_became_active":"2024-09-20T21:02:24.550354+0000","last_became_peered":"2024-09-20T21:02:24.550354+0000","last_unstale":"2024-09-20T21:02:34.002166+0000","last_undegraded":"2024-09-20T21:02:34.002166+0000","last_fullsized":"2024-09-20T21:02:24.542489+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:43:41.497540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.004028+0000","last_change":"2024-09-20T21:01:12.228717+0000","last_active":"2024-09-20T21:02:34.004028+0000","last_peered":"2024-09-20T21:02:34.004028+0000","last_clean":"2024-09-20T21:02:34.004028+0000","last_became_active":"2024-09-20T21:01:12.227944+0000","last_became_peered":"2024-09-20T21:01:12.227944+0000","last_unstale":"2024-09-20T21:02:34.004028+0000","last_undegraded":"2024-09-20T21:02:34.004028+0000","last_fullsized":"2024-09-20T21:02:34.004028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:40:11.915669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.002490+0000","last_change":"2024-09-20T21:02:06.427547+0000","last_active":"2024-09-20T21:02:34.002490+0000","last_peered":"2024-09-20T21:02:34.002490+0000","last_clean":"2024-09-20T21:02:34.002490+0000","last_became_active":"2024-09-20T21:02:06.427270+0000","last_became_peered":"2024-09-20T21:02:06.427270+0000","last_unstale":"2024-09-20T21:02:34.002490+0000","last_undegraded":"2024-09-20T21:02:34.002490+0000","last_fullsized":"2024-09-20T21:02:34.002490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:07.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002151+0000","last_change":"2024-09-20T21:02:24.560862+0000","last_active":"2024-09-20T21:02:34.002151+0000","last_peered":"2024-09-20T21:02:34.002151+0000","last_clean":"2024-09-20T21:02:22.530557+0000","last_became_active":"2024-09-20T21:02:24.560862+0000","last_became_peered":"2024-09-20T21:02:24.560862+0000","last_unstale":"2024-09-20T21:02:34.002151+0000","last_undegraded":"2024-09-20T21:02:34.002151+0000","last_fullsized":"2024-09-20T21:02:24.544028+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:55.191200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997580+0000","last_change":"2024-09-20T21:02:24.553106+0000","last_active":"2024-09-20T21:02:33.997580+0000","last_peered":"2024-09-20T21:02:33.997580+0000","last_clean":"2024-09-20T21:02:22.534647+0000","last_became_active":"2024-09-20T21:02:24.553106+0000","last_became_peered":"2024-09-20T21:02:24.553106+0000","last_unstale":"2024-09-20T21:02:33.997580+0000","last_undegraded":"2024-09-20T21:02:33.997580+0000","last_fullsized":"2024-09-20T21:02:24.549242+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:07.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.003170+0000","last_change":"2024-09-20T21:02:06.422473+0000","last_active":"2024-09-20T21:02:34.003170+0000","last_peered":"2024-09-20T21:02:34.003170+0000","last_clean":"2024-09-20T21:02:34.003170+0000","last_became_active":"2024-09-20T21:02:06.421735+0000","last_became_peered":"2024-09-20T21:02:06.421735+0000","last_unstale":"2024-09-20T21:02:34.003170+0000","last_undegraded":"2024-09-20T21:02:34.003170+0000","last_fullsized":"2024-09-20T21:02:34.003170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:36.002640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997196+0000","last_change":"2024-09-20T21:02:24.551073+0000","last_active":"2024-09-20T21:02:33.997196+0000","last_peered":"2024-09-20T21:02:33.997196+0000","last_clean":"2024-09-20T21:01:11.169670+0000","last_became_active":"2024-09-20T21:02:24.551073+0000","last_became_peered":"2024-09-20T21:02:24.551073+0000","last_unstale":"2024-09-20T21:02:33.997196+0000","last_undegraded":"2024-09-20T21:02:33.997196+0000","last_fullsized":"2024-09-20T21:02:24.547437+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:49.838567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.996588+0000","last_change":"2024-09-20T21:02:24.548488+0000","last_active":"2024-09-20T21:02:33.996588+0000","last_peered":"2024-09-20T21:02:33.996588+0000","last_clean":"2024-09-20T21:01:11.169670+0000","last_became_active":"2024-09-20T21:02:24.548488+0000","last_became_peered":"2024-09-20T21:02:24.548488+0000","last_unstale":"2024-09-20T21:02:33.996588+0000","last_undegraded":"2024-09-20T21:02:33.996588+0000","last_fullsized":"2024-09-20T21:02:24.547209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:37.997011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003445+0000","last_change":"2024-09-20T21:02:24.549248+0000","last_active":"2024-09-20T21:02:34.003445+0000","last_peered":"2024-09-20T21:02:34.003445+0000","last_clean":"2024-09-20T21:02:22.530012+0000","last_became_active":"2024-09-20T21:02:24.549248+0000","last_became_peered":"2024-09-20T21:02:24.549248+0000","last_unstale":"2024-09-20T21:02:34.003445+0000","last_undegraded":"2024-09-20T21:02:34.003445+0000","last_fullsized":"2024-09-20T21:02:24.542853+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:10.520461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.007786+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:02:34.007786+0000","last_peered":"2024-09-20T21:02:34.007786+0000","last_clean":"2024-09-20T21:02:34.007786+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:02:34.007786+0000","last_undegraded":"2024-09-20T21:02:34.007786+0000","last_fullsized":"2024-09-20T21:02:34.007786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:33.998618+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:02:33.998618+0000","last_peered":"2024-09-20T21:02:33.998618+0000","last_clean":"2024-09-20T21:02:33.998618+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:02:33.998618+0000","last_undegraded":"2024-09-20T21:02:33.998618+0000","last_fullsized":"2024-09-20T21:02:33.998618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.002485+0000","last_change":"2024-09-20T21:01:12.224153+0000","last_active":"2024-09-20T21:02:34.002485+0000","last_peered":"2024-09-20T21:02:34.002485+0000","last_clean":"2024-09-20T21:02:34.002485+0000","last_became_active":"2024-09-20T21:01:12.222771+0000","last_became_peered":"2024-09-20T21:01:12.222771+0000","last_unstale":"2024-09-20T21:02:34.002485+0000","last_undegraded":"2024-09-20T21:02:34.002485+0000","last_fullsized":"2024-09-20T21:02:34.002485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:16:40.831308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002987+0000","last_change":"2024-09-20T21:02:24.571215+0000","last_active":"2024-09-20T21:02:34.002987+0000","last_peered":"2024-09-20T21:02:34.002987+0000","last_clean":"2024-09-20T21:02:22.531062+0000","last_became_active":"2024-09-20T21:02:24.571215+0000","last_became_peered":"2024-09-20T21:02:24.571215+0000","last_unstale":"2024-09-20T21:02:34.002987+0000","last_undegraded":"2024-09-20T21:02:34.002987+0000","last_fullsized":"2024-09-20T21:02:24.546784+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:20:50.799154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.004568+0000","last_change":"2024-09-20T21:02:24.581318+0000","last_active":"2024-09-20T21:02:34.004568+0000","last_peered":"2024-09-20T21:02:34.004568+0000","last_clean":"2024-09-20T21:02:22.531462+0000","last_became_active":"2024-09-20T21:02:24.581318+0000","last_became_peered":"2024-09-20T21:02:24.581318+0000","last_unstale":"2024-09-20T21:02:34.004568+0000","last_undegraded":"2024-09-20T21:02:34.004568+0000","last_fullsized":"2024-09-20T21:02:24.548009+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:37.800532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997425+0000","last_change":"2024-09-20T21:02:24.551305+0000","last_active":"2024-09-20T21:02:33.997425+0000","last_peered":"2024-09-20T21:02:33.997425+0000","last_clean":"2024-09-20T21:02:22.534616+0000","last_became_active":"2024-09-20T21:02:24.551305+0000","last_became_peered":"2024-09-20T21:02:24.551305+0000","last_unstale":"2024-09-20T21:02:33.997425+0000","last_undegraded":"2024-09-20T21:02:33.997425+0000","last_fullsized":"2024-09-20T21:02:24.547535+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:20.216860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003665+0000","last_change":"2024-09-20T21:02:24.562418+0000","last_active":"2024-09-20T21:02:34.003665+0000","last_peered":"2024-09-20T21:02:34.003665+0000","last_clean":"2024-09-20T21:02:22.530300+0000","last_became_active":"2024-09-20T21:02:24.562418+0000","last_became_peered":"2024-09-20T21:02:24.562418+0000","last_unstale":"2024-09-20T21:02:34.003665+0000","last_undegraded":"2024-09-20T21:02:34.003665+0000","last_fullsized":"2024-09-20T21:02:24.543270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:51.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.001617+0000","last_change":"2024-09-20T21:02:06.422977+0000","last_active":"2024-09-20T21:02:34.001617+0000","last_peered":"2024-09-20T21:02:34.001617+0000","last_clean":"2024-09-20T21:02:34.001617+0000","last_became_active":"2024-09-20T21:02:06.421686+0000","last_became_peered":"2024-09-20T21:02:06.421686+0000","last_unstale":"2024-09-20T21:02:34.001617+0000","last_undegraded":"2024-09-20T21:02:34.001617+0000","last_fullsized":"2024-09-20T21:02:34.001617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:21.668945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.998654+0000","last_change":"2024-09-20T21:02:24.559193+0000","last_active":"2024-09-20T21:02:33.998654+0000","last_peered":"2024-09-20T21:02:33.998654+0000","last_clean":"2024-09-20T21:02:22.535732+0000","last_became_active":"2024-09-20T21:02:24.559193+0000","last_became_peered":"2024-09-20T21:02:24.559193+0000","last_unstale":"2024-09-20T21:02:33.998654+0000","last_undegraded":"2024-09-20T21:02:33.998654+0000","last_fullsized":"2024-09-20T21:02:24.550913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:43:41.497540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002849+0000","last_change":"2024-09-20T21:02:24.555502+0000","last_active":"2024-09-20T21:02:34.002849+0000","last_peered":"2024-09-20T21:02:34.002849+0000","last_clean":"2024-09-20T21:02:22.532065+0000","last_became_active":"2024-09-20T21:02:24.555502+0000","last_became_peered":"2024-09-20T21:02:24.555502+0000","last_unstale":"2024-09-20T21:02:34.002849+0000","last_undegraded":"2024-09-20T21:02:34.002849+0000","last_fullsized":"2024-09-20T21:02:24.545174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:00.146794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.998651+0000","last_change":"2024-09-20T21:02:24.559406+0000","last_active":"2024-09-20T21:02:33.998651+0000","last_peered":"2024-09-20T21:02:33.998651+0000","last_clean":"2024-09-20T21:01:11.169670+0000","last_became_active":"2024-09-20T21:02:24.559406+0000","last_became_peered":"2024-09-20T21:02:24.559406+0000","last_unstale":"2024-09-20T21:02:33.998651+0000","last_undegraded":"2024-09-20T21:02:33.998651+0000","last_fullsized":"2024-09-20T21:02:24.550883+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:44.800800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997413+0000","last_change":"2024-09-20T21:02:24.552659+0000","last_active":"2024-09-20T21:02:33.997413+0000","last_peered":"2024-09-20T21:02:33.997413+0000","last_clean":"2024-09-20T21:02:22.534836+0000","last_became_active":"2024-09-20T21:02:24.552659+0000","last_became_peered":"2024-09-20T21:02:24.552659+0000","last_unstale":"2024-09-20T21:02:33.997413+0000","last_undegraded":"2024-09-20T21:02:33.997413+0000","last_fullsized":"2024-09-20T21:02:24.549373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:31.679896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.004272+0000","last_change":"2024-09-20T21:01:12.228247+0000","last_active":"2024-09-20T21:02:34.004272+0000","last_peered":"2024-09-20T21:02:34.004272+0000","last_clean":"2024-09-20T21:02:34.004272+0000","last_became_active":"2024-09-20T21:01:12.225905+0000","last_became_peered":"2024-09-20T21:01:12.225905+0000","last_unstale":"2024-09-20T21:02:34.004272+0000","last_undegraded":"2024-09-20T21:02:34.004272+0000","last_fullsized":"2024-09-20T21:02:34.004272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:36:05.292491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997608+0000","last_change":"2024-09-20T21:02:24.552340+0000","last_active":"2024-09-20T21:02:33.997608+0000","last_peered":"2024-09-20T21:02:33.997608+0000","last_clean":"2024-09-20T21:02:22.534791+0000","last_became_active":"2024-09-20T21:02:24.552340+0000","last_became_peered":"2024-09-20T21:02:24.552340+0000","last_unstale":"2024-09-20T21:02:33.997608+0000","last_undegraded":"2024-09-20T21:02:33.997608+0000","last_fullsized":"2024-09-20T21:02:24.547941+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:49.304016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.003649+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:02:34.003649+0000","last_peered":"2024-09-20T21:02:34.003649+0000","last_clean":"2024-09-20T21:02:34.003649+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:02:34.003649+0000","last_undegraded":"2024-09-20T21:02:34.003649+0000","last_fullsized":"2024-09-20T21:02:34.003649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003682+0000","last_change":"2024-09-20T21:02:24.551015+0000","last_active":"2024-09-20T21:02:34.003682+0000","last_peered":"2024-09-20T21:02:34.003682+0000","last_clean":"2024-09-20T21:02:22.530091+0000","last_became_active":"2024-09-20T21:02:24.551015+0000","last_became_peered":"2024-09-20T21:02:24.551015+0000","last_unstale":"2024-09-20T21:02:34.003682+0000","last_undegraded":"2024-09-20T21:02:34.003682+0000","last_fullsized":"2024-09-20T21:02:24.544725+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:33.319474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.001996+0000","last_change":"2024-09-20T21:02:06.424569+0000","last_active":"2024-09-20T21:02:34.001996+0000","last_peered":"2024-09-20T21:02:34.001996+0000","last_clean":"2024-09-20T21:02:34.001996+0000","last_became_active":"2024-09-20T21:02:06.423852+0000","last_became_peered":"2024-09-20T21:02:06.423852+0000","last_unstale":"2024-09-20T21:02:34.001996+0000","last_undegraded":"2024-09-20T21:02:34.001996+0000","last_fullsized":"2024-09-20T21:02:34.001996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:49.304016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":85,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:34.003264+0000","last_change":"2024-09-20T21:02:24.557026+0000","last_active":"2024-09-20T21:02:34.003264+0000","last_peered":"2024-09-20T21:02:34.003264+0000","last_clean":"2024-09-20T21:02:22.530408+0000","last_became_active":"2024-09-20T21:02:24.557026+0000","last_became_peered":"2024-09-20T21:02:24.557026+0000","last_unstale":"2024-09-20T21:02:34.003264+0000","last_undegraded":"2024-09-20T21:02:24.545443+0000","last_fullsized":"2024-09-20T21:02:24.545256+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:08.182067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.002058+0000","last_change":"2024-09-20T21:02:06.429730+0000","last_active":"2024-09-20T21:02:34.002058+0000","last_peered":"2024-09-20T21:02:34.002058+0000","last_clean":"2024-09-20T21:02:34.002058+0000","last_became_active":"2024-09-20T21:02:06.428246+0000","last_became_peered":"2024-09-20T21:02:06.428246+0000","last_unstale":"2024-09-20T21:02:34.002058+0000","last_undegraded":"2024-09-20T21:02:34.002058+0000","last_fullsized":"2024-09-20T21:02:34.002058+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:03.230251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002897+0000","last_change":"2024-09-20T21:02:24.562835+0000","last_active":"2024-09-20T21:02:34.002897+0000","last_peered":"2024-09-20T21:02:34.002897+0000","last_clean":"2024-09-20T21:02:22.533095+0000","last_became_active":"2024-09-20T21:02:24.562835+0000","last_became_peered":"2024-09-20T21:02:24.562835+0000","last_unstale":"2024-09-20T21:02:34.002897+0000","last_undegraded":"2024-09-20T21:02:34.002897+0000","last_fullsized":"2024-09-20T21:02:24.545918+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:27.998898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003583+0000","last_change":"2024-09-20T21:02:24.556034+0000","last_active":"2024-09-20T21:02:34.003583+0000","last_peered":"2024-09-20T21:02:34.003583+0000","last_clean":"2024-09-20T21:02:22.532269+0000","last_became_active":"2024-09-20T21:02:24.556034+0000","last_became_peered":"2024-09-20T21:02:24.556034+0000","last_unstale":"2024-09-20T21:02:34.003583+0000","last_undegraded":"2024-09-20T21:02:34.003583+0000","last_fullsized":"2024-09-20T21:02:24.546331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:41.795024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.996893+0000","last_change":"2024-09-20T21:02:24.555621+0000","last_active":"2024-09-20T21:02:33.996893+0000","last_peered":"2024-09-20T21:02:33.996893+0000","last_clean":"2024-09-20T21:02:22.534593+0000","last_became_active":"2024-09-20T21:02:24.555621+0000","last_became_peered":"2024-09-20T21:02:24.555621+0000","last_unstale":"2024-09-20T21:02:33.996893+0000","last_undegraded":"2024-09-20T21:02:33.996893+0000","last_fullsized":"2024-09-20T21:02:24.548100+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:47.171358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.004349+0000","last_change":"2024-09-20T21:02:24.558620+0000","last_active":"2024-09-20T21:02:34.004349+0000","last_peered":"2024-09-20T21:02:34.004349+0000","last_clean":"2024-09-20T21:02:22.530766+0000","last_became_active":"2024-09-20T21:02:24.558620+0000","last_became_peered":"2024-09-20T21:02:24.558620+0000","last_unstale":"2024-09-20T21:02:34.004349+0000","last_undegraded":"2024-09-20T21:02:34.004349+0000","last_fullsized":"2024-09-20T21:02:24.547793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:05:51.713996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":65,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:33.996457+0000","last_change":"2024-09-20T21:02:24.551296+0000","last_active":"2024-09-20T21:02:33.996457+0000","last_peered":"2024-09-20T21:02:33.996457+0000","last_clean":"2024-09-20T21:02:04.398088+0000","last_became_active":"2024-09-20T21:02:24.551296+0000","last_became_peered":"2024-09-20T21:02:24.551296+0000","last_unstale":"2024-09-20T21:02:33.996457+0000","last_undegraded":"2024-09-20T21:02:24.547346+0000","last_fullsized":"2024-09-20T21:02:24.547199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:34.990744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"53'9238","reported_seq":9316,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:35.002268+0000","last_change":"2024-09-20T21:02:24.548503+0000","last_active":"2024-09-20T21:02:35.002268+0000","last_peered":"2024-09-20T21:02:35.002268+0000","last_clean":"2024-09-20T21:02:23.522482+0000","last_became_active":"2024-09-20T21:02:24.548503+0000","last_became_peered":"2024-09-20T21:02:24.548503+0000","last_unstale":"2024-09-20T21:02:35.002268+0000","last_undegraded":"2024-09-20T21:02:24.547366+0000","last_fullsized":"2024-09-20T21:02:24.547197+0000","mapping_epoch":48,"log_start":"36'5287","ondisk_log_start":"36'5287","created":21,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:17.207518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462553088,"num_objects":7058,"num_object_clones":0,"num_object_copies":14116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7058,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7058,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9238,"num_write_kb":521472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":7058}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":85,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:33.997937+0000","last_change":"2024-09-20T21:02:24.559188+0000","last_active":"2024-09-20T21:02:33.997937+0000","last_peered":"2024-09-20T21:02:33.997937+0000","last_clean":"2024-09-20T21:02:22.535461+0000","last_became_active":"2024-09-20T21:02:24.559188+0000","last_became_peered":"2024-09-20T21:02:24.559188+0000","last_unstale":"2024-09-20T21:02:33.997937+0000","last_undegraded":"2024-09-20T21:02:24.550166+0000","last_fullsized":"2024-09-20T21:02:24.549943+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:57.722967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.996651+0000","last_change":"2024-09-20T21:02:24.554604+0000","last_active":"2024-09-20T21:02:33.996651+0000","last_peered":"2024-09-20T21:02:33.996651+0000","last_clean":"2024-09-20T21:02:22.536291+0000","last_became_active":"2024-09-20T21:02:24.554604+0000","last_became_peered":"2024-09-20T21:02:24.554604+0000","last_unstale":"2024-09-20T21:02:33.996651+0000","last_undegraded":"2024-09-20T21:02:33.996651+0000","last_fullsized":"2024-09-20T21:02:24.547793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:16.623791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"53'9362","reported_seq":9438,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:35.011968+0000","last_change":"2024-09-20T21:02:06.441673+0000","last_active":"2024-09-20T21:02:35.011968+0000","last_peered":"2024-09-20T21:02:35.011968+0000","last_clean":"2024-09-20T21:02:35.011968+0000","last_became_active":"2024-09-20T21:02:06.427751+0000","last_became_peered":"2024-09-20T21:02:06.427751+0000","last_unstale":"2024-09-20T21:02:35.011968+0000","last_undegraded":"2024-09-20T21:02:35.011968+0000","last_fullsized":"2024-09-20T21:02:35.011968+0000","mapping_epoch":38,"log_start":"37'5740","ondisk_log_start":"37'5740","created":21,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3622,"log_dups_size":0,"ondisk_log_size":3622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:36.928079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471990272,"num_objects":7202,"num_object_clones":0,"num_object_copies":14404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9362,"num_write_kb":530048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":86,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:33.998724+0000","last_change":"2024-09-20T21:02:24.554071+0000","last_active":"2024-09-20T21:02:33.998724+0000","last_peered":"2024-09-20T21:02:33.998724+0000","last_clean":"2024-09-20T21:02:22.535434+0000","last_became_active":"2024-09-20T21:02:24.554071+0000","last_became_peered":"2024-09-20T21:02:24.554071+0000","last_unstale":"2024-09-20T21:02:33.998724+0000","last_undegraded":"2024-09-20T21:02:24.550029+0000","last_fullsized":"2024-09-20T21:02:24.549964+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:47.411649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.004291+0000","last_change":"2024-09-20T21:02:06.424582+0000","last_active":"2024-09-20T21:02:34.004291+0000","last_peered":"2024-09-20T21:02:34.004291+0000","last_clean":"2024-09-20T21:02:34.004291+0000","last_became_active":"2024-09-20T21:02:06.421448+0000","last_became_peered":"2024-09-20T21:02:06.421448+0000","last_unstale":"2024-09-20T21:02:34.004291+0000","last_undegraded":"2024-09-20T21:02:34.004291+0000","last_fullsized":"2024-09-20T21:02:34.004291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:42.804478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"53'9514","reported_seq":9586,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:35.008155+0000","last_change":"2024-09-20T21:01:26.189622+0000","last_active":"2024-09-20T21:02:35.008155+0000","last_peered":"2024-09-20T21:02:35.008155+0000","last_clean":"2024-09-20T21:02:35.008155+0000","last_became_active":"2024-09-20T21:01:26.186385+0000","last_became_peered":"2024-09-20T21:01:26.186385+0000","last_unstale":"2024-09-20T21:02:35.008155+0000","last_undegraded":"2024-09-20T21:02:35.008155+0000","last_fullsized":"2024-09-20T21:02:35.008155+0000","mapping_epoch":21,"log_start":"36'5500","ondisk_log_start":"36'5500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4014,"log_dups_size":0,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:50.339650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482213888,"num_objects":7358,"num_object_clones":0,"num_object_copies":14716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9514,"num_write_kb":539904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":65,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:33.997292+0000","last_change":"2024-09-20T21:02:24.558293+0000","last_active":"2024-09-20T21:02:33.997292+0000","last_peered":"2024-09-20T21:02:33.997292+0000","last_clean":"2024-09-20T21:02:04.399053+0000","last_became_active":"2024-09-20T21:02:24.558293+0000","last_became_peered":"2024-09-20T21:02:24.558293+0000","last_unstale":"2024-09-20T21:02:33.997292+0000","last_undegraded":"2024-09-20T21:02:24.549862+0000","last_fullsized":"2024-09-20T21:02:24.549750+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:32.307577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003042+0000","last_change":"2024-09-20T21:02:24.564843+0000","last_active":"2024-09-20T21:02:34.003042+0000","last_peered":"2024-09-20T21:02:34.003042+0000","last_clean":"2024-09-20T21:02:22.535522+0000","last_became_active":"2024-09-20T21:02:24.564843+0000","last_became_peered":"2024-09-20T21:02:24.564843+0000","last_unstale":"2024-09-20T21:02:34.003042+0000","last_undegraded":"2024-09-20T21:02:34.003042+0000","last_fullsized":"2024-09-20T21:02:24.546119+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:29.298600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"53'9397","reported_seq":9469,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:35.016562+0000","last_change":"2024-09-20T21:01:26.189804+0000","last_active":"2024-09-20T21:02:35.016562+0000","last_peered":"2024-09-20T21:02:35.016562+0000","last_clean":"2024-09-20T21:02:35.016562+0000","last_became_active":"2024-09-20T21:01:26.187924+0000","last_became_peered":"2024-09-20T21:01:26.187924+0000","last_unstale":"2024-09-20T21:02:35.016562+0000","last_undegraded":"2024-09-20T21:02:35.016562+0000","last_fullsized":"2024-09-20T21:02:35.016562+0000","mapping_epoch":21,"log_start":"39'5800","ondisk_log_start":"39'5800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:35:44.867498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470220800,"num_objects":7175,"num_object_clones":0,"num_object_copies":14350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9397,"num_write_kb":530304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003257+0000","last_change":"2024-09-20T21:02:24.572768+0000","last_active":"2024-09-20T21:02:34.003257+0000","last_peered":"2024-09-20T21:02:34.003257+0000","last_clean":"2024-09-20T21:02:22.531224+0000","last_became_active":"2024-09-20T21:02:24.572768+0000","last_became_peered":"2024-09-20T21:02:24.572768+0000","last_unstale":"2024-09-20T21:02:34.003257+0000","last_undegraded":"2024-09-20T21:02:34.003257+0000","last_fullsized":"2024-09-20T21:02:24.549044+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:02.420162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003862+0000","last_change":"2024-09-20T21:02:24.583867+0000","last_active":"2024-09-20T21:02:34.003862+0000","last_peered":"2024-09-20T21:02:34.003862+0000","last_clean":"2024-09-20T21:02:22.530704+0000","last_became_active":"2024-09-20T21:02:24.583867+0000","last_became_peered":"2024-09-20T21:02:24.583867+0000","last_unstale":"2024-09-20T21:02:34.003862+0000","last_undegraded":"2024-09-20T21:02:34.003862+0000","last_fullsized":"2024-09-20T21:02:24.545874+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:46.324080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"53'9225","reported_seq":9299,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:34.997660+0000","last_change":"2024-09-20T21:02:24.554884+0000","last_active":"2024-09-20T21:02:34.997660+0000","last_peered":"2024-09-20T21:02:34.997660+0000","last_clean":"2024-09-20T21:02:23.519363+0000","last_became_active":"2024-09-20T21:02:24.554884+0000","last_became_peered":"2024-09-20T21:02:24.554884+0000","last_unstale":"2024-09-20T21:02:34.997660+0000","last_undegraded":"2024-09-20T21:02:24.549527+0000","last_fullsized":"2024-09-20T21:02:24.549451+0000","mapping_epoch":48,"log_start":"36'5200","ondisk_log_start":"36'5200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:27:31.584223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473038872,"num_objects":7219,"num_object_clones":0,"num_object_copies":14438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7219,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7219,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9225,"num_write_kb":526145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":7219}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":86,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:34.004722+0000","last_change":"2024-09-20T21:02:24.583110+0000","last_active":"2024-09-20T21:02:34.004722+0000","last_peered":"2024-09-20T21:02:34.004722+0000","last_clean":"2024-09-20T21:02:22.530884+0000","last_became_active":"2024-09-20T21:02:24.583110+0000","last_became_peered":"2024-09-20T21:02:24.583110+0000","last_unstale":"2024-09-20T21:02:34.004722+0000","last_undegraded":"2024-09-20T21:02:24.549001+0000","last_fullsized":"2024-09-20T21:02:24.548709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.536839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003229+0000","last_change":"2024-09-20T21:02:24.572266+0000","last_active":"2024-09-20T21:02:34.003229+0000","last_peered":"2024-09-20T21:02:34.003229+0000","last_clean":"2024-09-20T21:02:22.531139+0000","last_became_active":"2024-09-20T21:02:24.572266+0000","last_became_peered":"2024-09-20T21:02:24.572266+0000","last_unstale":"2024-09-20T21:02:34.003229+0000","last_undegraded":"2024-09-20T21:02:34.003229+0000","last_fullsized":"2024-09-20T21:02:24.548094+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:44.292273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"53'9144","reported_seq":9217,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:35.018168+0000","last_change":"2024-09-20T21:02:24.551406+0000","last_active":"2024-09-20T21:02:35.018168+0000","last_peered":"2024-09-20T21:02:35.018168+0000","last_clean":"2024-09-20T21:02:23.525780+0000","last_became_active":"2024-09-20T21:02:24.551406+0000","last_became_peered":"2024-09-20T21:02:24.551406+0000","last_unstale":"2024-09-20T21:02:35.018168+0000","last_undegraded":"2024-09-20T21:02:24.544609+0000","last_fullsized":"2024-09-20T21:02:24.544439+0000","mapping_epoch":48,"log_start":"37'5600","ondisk_log_start":"37'5600","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:58.778066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462553088,"num_objects":7058,"num_object_clones":0,"num_object_copies":14116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7058,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7058,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9144,"num_write_kb":518464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":7058}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002339+0000","last_change":"2024-09-20T21:02:24.554218+0000","last_active":"2024-09-20T21:02:34.002339+0000","last_peered":"2024-09-20T21:02:34.002339+0000","last_clean":"2024-09-20T21:02:22.532961+0000","last_became_active":"2024-09-20T21:02:24.554218+0000","last_became_peered":"2024-09-20T21:02:24.554218+0000","last_unstale":"2024-09-20T21:02:34.002339+0000","last_undegraded":"2024-09-20T21:02:34.002339+0000","last_fullsized":"2024-09-20T21:02:24.543940+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:21.044726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.998056+0000","last_change":"2024-09-20T21:02:24.559168+0000","last_active":"2024-09-20T21:02:33.998056+0000","last_peered":"2024-09-20T21:02:33.998056+0000","last_clean":"2024-09-20T21:01:11.169670+0000","last_became_active":"2024-09-20T21:02:24.559168+0000","last_became_peered":"2024-09-20T21:02:24.559168+0000","last_unstale":"2024-09-20T21:02:33.998056+0000","last_undegraded":"2024-09-20T21:02:33.998056+0000","last_fullsized":"2024-09-20T21:02:24.550149+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:00.146794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"53'9363","reported_seq":9437,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:35.000858+0000","last_change":"2024-09-20T21:02:24.553053+0000","last_active":"2024-09-20T21:02:35.000858+0000","last_peered":"2024-09-20T21:02:35.000858+0000","last_clean":"2024-09-20T21:02:23.518345+0000","last_became_active":"2024-09-20T21:02:24.553053+0000","last_became_peered":"2024-09-20T21:02:24.553053+0000","last_unstale":"2024-09-20T21:02:35.000858+0000","last_undegraded":"2024-09-20T21:02:24.549474+0000","last_fullsized":"2024-09-20T21:02:24.549368+0000","mapping_epoch":48,"log_start":"36'5400","ondisk_log_start":"36'5400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3963,"log_dups_size":0,"ondisk_log_size":3963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:41:23.880135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466157568,"num_objects":7113,"num_object_clones":0,"num_object_copies":14226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7113,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9363,"num_write_kb":527232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":7113}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.996949+0000","last_change":"2024-09-20T21:02:24.555409+0000","last_active":"2024-09-20T21:02:33.996949+0000","last_peered":"2024-09-20T21:02:33.996949+0000","last_clean":"2024-09-20T21:02:22.534702+0000","last_became_active":"2024-09-20T21:02:24.555409+0000","last_became_peered":"2024-09-20T21:02:24.555409+0000","last_unstale":"2024-09-20T21:02:33.996949+0000","last_undegraded":"2024-09-20T21:02:33.996949+0000","last_fullsized":"2024-09-20T21:02:24.548123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:28.672472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997868+0000","last_change":"2024-09-20T21:02:24.552757+0000","last_active":"2024-09-20T21:02:33.997868+0000","last_peered":"2024-09-20T21:02:33.997868+0000","last_clean":"2024-09-20T21:02:22.534890+0000","last_became_active":"2024-09-20T21:02:24.552757+0000","last_became_peered":"2024-09-20T21:02:24.552757+0000","last_unstale":"2024-09-20T21:02:33.997868+0000","last_undegraded":"2024-09-20T21:02:33.997868+0000","last_fullsized":"2024-09-20T21:02:24.549193+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:25:05.037879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"53'9258","reported_seq":9330,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:35.000510+0000","last_change":"2024-09-20T21:01:26.192961+0000","last_active":"2024-09-20T21:02:35.000510+0000","last_peered":"2024-09-20T21:02:35.000510+0000","last_clean":"2024-09-20T21:02:35.000510+0000","last_became_active":"2024-09-20T21:01:26.192159+0000","last_became_peered":"2024-09-20T21:01:26.192159+0000","last_unstale":"2024-09-20T21:02:35.000510+0000","last_undegraded":"2024-09-20T21:02:35.000510+0000","last_fullsized":"2024-09-20T21:02:35.000510+0000","mapping_epoch":21,"log_start":"36'5300","ondisk_log_start":"36'5300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3958,"log_dups_size":0,"ondisk_log_size":3958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:50.672763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":469630976,"num_objects":7166,"num_object_clones":0,"num_object_copies":14332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9258,"num_write_kb":525568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.003933+0000","last_change":"2024-09-20T21:02:06.423082+0000","last_active":"2024-09-20T21:02:34.003933+0000","last_peered":"2024-09-20T21:02:34.003933+0000","last_clean":"2024-09-20T21:02:34.003933+0000","last_became_active":"2024-09-20T21:02:06.422272+0000","last_became_peered":"2024-09-20T21:02:06.422272+0000","last_unstale":"2024-09-20T21:02:34.003933+0000","last_undegraded":"2024-09-20T21:02:34.003933+0000","last_fullsized":"2024-09-20T21:02:34.003933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:30.668000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.006689+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:02:34.006689+0000","last_peered":"2024-09-20T21:02:34.006689+0000","last_clean":"2024-09-20T21:02:34.006689+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:02:34.006689+0000","last_undegraded":"2024-09-20T21:02:34.006689+0000","last_fullsized":"2024-09-20T21:02:34.006689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"53'9425","reported_seq":9502,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:35.004967+0000","last_change":"2024-09-20T21:02:06.435625+0000","last_active":"2024-09-20T21:02:35.004967+0000","last_peered":"2024-09-20T21:02:35.004967+0000","last_clean":"2024-09-20T21:02:35.004967+0000","last_became_active":"2024-09-20T21:02:06.427061+0000","last_became_peered":"2024-09-20T21:02:06.427061+0000","last_unstale":"2024-09-20T21:02:35.004967+0000","last_undegraded":"2024-09-20T21:02:35.004967+0000","last_fullsized":"2024-09-20T21:02:35.004967+0000","mapping_epoch":38,"log_start":"37'5800","ondisk_log_start":"37'5800","created":21,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:30.601057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478871552,"num_objects":7307,"num_object_clones":0,"num_object_copies":14614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9425,"num_write_kb":535424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":260,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:33.997241+0000","last_change":"2024-09-20T21:02:24.554931+0000","last_active":"2024-09-20T21:02:33.997241+0000","last_peered":"2024-09-20T21:02:33.997241+0000","last_clean":"2024-09-20T21:02:04.399196+0000","last_became_active":"2024-09-20T21:02:24.554931+0000","last_became_peered":"2024-09-20T21:02:24.554931+0000","last_unstale":"2024-09-20T21:02:33.997241+0000","last_undegraded":"2024-09-20T21:02:24.548878+0000","last_fullsized":"2024-09-20T21:02:24.548753+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:12.723759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":79,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:34.004972+0000","last_change":"2024-09-20T21:02:24.583734+0000","last_active":"2024-09-20T21:02:34.004972+0000","last_peered":"2024-09-20T21:02:34.004972+0000","last_clean":"2024-09-20T21:02:22.531041+0000","last_became_active":"2024-09-20T21:02:24.583734+0000","last_became_peered":"2024-09-20T21:02:24.583734+0000","last_unstale":"2024-09-20T21:02:34.004972+0000","last_undegraded":"2024-09-20T21:02:24.552007+0000","last_fullsized":"2024-09-20T21:02:24.550762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:08:38.910249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.003176+0000","last_change":"2024-09-20T21:01:11.210376+0000","last_active":"2024-09-20T21:02:34.003176+0000","last_peered":"2024-09-20T21:02:34.003176+0000","last_clean":"2024-09-20T21:02:34.003176+0000","last_became_active":"2024-09-20T21:01:11.209492+0000","last_became_peered":"2024-09-20T21:01:11.209492+0000","last_unstale":"2024-09-20T21:02:34.003176+0000","last_undegraded":"2024-09-20T21:02:34.003176+0000","last_fullsized":"2024-09-20T21:02:34.003176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997090+0000","last_change":"2024-09-20T21:02:24.554630+0000","last_active":"2024-09-20T21:02:33.997090+0000","last_peered":"2024-09-20T21:02:33.997090+0000","last_clean":"2024-09-20T21:01:11.169670+0000","last_became_active":"2024-09-20T21:02:24.554630+0000","last_became_peered":"2024-09-20T21:02:24.554630+0000","last_unstale":"2024-09-20T21:02:33.997090+0000","last_undegraded":"2024-09-20T21:02:33.997090+0000","last_fullsized":"2024-09-20T21:02:24.549336+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:13:18.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"53'9279","reported_seq":9352,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:34.996040+0000","last_change":"2024-09-20T21:02:24.564570+0000","last_active":"2024-09-20T21:02:34.996040+0000","last_peered":"2024-09-20T21:02:34.996040+0000","last_clean":"2024-09-20T21:02:23.537854+0000","last_became_active":"2024-09-20T21:02:24.564570+0000","last_became_peered":"2024-09-20T21:02:24.564570+0000","last_unstale":"2024-09-20T21:02:34.996040+0000","last_undegraded":"2024-09-20T21:02:24.554208+0000","last_fullsized":"2024-09-20T21:02:24.550370+0000","mapping_epoch":48,"log_start":"37'5700","ondisk_log_start":"37'5700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3579,"log_dups_size":0,"ondisk_log_size":3579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:10.704325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472842240,"num_objects":7215,"num_object_clones":0,"num_object_copies":14430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7215,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9279,"num_write_kb":527808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":7215}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997065+0000","last_change":"2024-09-20T21:02:24.554728+0000","last_active":"2024-09-20T21:02:33.997065+0000","last_peered":"2024-09-20T21:02:33.997065+0000","last_clean":"2024-09-20T21:01:05.975597+0000","last_became_active":"2024-09-20T21:02:24.554728+0000","last_became_peered":"2024-09-20T21:02:24.554728+0000","last_unstale":"2024-09-20T21:02:33.997065+0000","last_undegraded":"2024-09-20T21:02:33.997065+0000","last_fullsized":"2024-09-20T21:02:24.548335+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:28.024220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.004500+0000","last_change":"2024-09-20T21:02:24.562636+0000","last_active":"2024-09-20T21:02:34.004500+0000","last_peered":"2024-09-20T21:02:34.004500+0000","last_clean":"2024-09-20T21:02:22.530551+0000","last_became_active":"2024-09-20T21:02:24.562636+0000","last_became_peered":"2024-09-20T21:02:24.562636+0000","last_unstale":"2024-09-20T21:02:34.004500+0000","last_undegraded":"2024-09-20T21:02:34.004500+0000","last_fullsized":"2024-09-20T21:02:24.546029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:16.135589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:33.998610+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:02:33.998610+0000","last_peered":"2024-09-20T21:02:33.998610+0000","last_clean":"2024-09-20T21:02:33.998610+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:02:33.998610+0000","last_undegraded":"2024-09-20T21:02:33.998610+0000","last_fullsized":"2024-09-20T21:02:33.998610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"53'9412","reported_seq":9485,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:35.014381+0000","last_change":"2024-09-20T21:02:24.558864+0000","last_active":"2024-09-20T21:02:35.014381+0000","last_peered":"2024-09-20T21:02:35.014381+0000","last_clean":"2024-09-20T21:02:23.522848+0000","last_became_active":"2024-09-20T21:02:24.558864+0000","last_became_peered":"2024-09-20T21:02:24.558864+0000","last_unstale":"2024-09-20T21:02:35.014381+0000","last_undegraded":"2024-09-20T21:02:24.547846+0000","last_fullsized":"2024-09-20T21:02:24.547627+0000","mapping_epoch":48,"log_start":"39'5800","ondisk_log_start":"39'5800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3612,"log_dups_size":0,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:54:28.894873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471072768,"num_objects":7188,"num_object_clones":0,"num_object_copies":14376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9412,"num_write_kb":531200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":7188}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.004627+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:02:34.004627+0000","last_peered":"2024-09-20T21:02:34.004627+0000","last_clean":"2024-09-20T21:02:34.004627+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:02:34.004627+0000","last_undegraded":"2024-09-20T21:02:34.004627+0000","last_fullsized":"2024-09-20T21:02:34.004627+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997038+0000","last_change":"2024-09-20T21:02:24.553625+0000","last_active":"2024-09-20T21:02:33.997038+0000","last_peered":"2024-09-20T21:02:33.997038+0000","last_clean":"2024-09-20T21:02:22.536392+0000","last_became_active":"2024-09-20T21:02:24.553625+0000","last_became_peered":"2024-09-20T21:02:24.553625+0000","last_unstale":"2024-09-20T21:02:33.997038+0000","last_undegraded":"2024-09-20T21:02:33.997038+0000","last_fullsized":"2024-09-20T21:02:24.548043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:06.680590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.007198+0000","last_change":"2024-09-20T21:01:12.227542+0000","last_active":"2024-09-20T21:02:34.007198+0000","last_peered":"2024-09-20T21:02:34.007198+0000","last_clean":"2024-09-20T21:02:34.007198+0000","last_became_active":"2024-09-20T21:01:12.225786+0000","last_became_peered":"2024-09-20T21:01:12.225786+0000","last_unstale":"2024-09-20T21:02:34.007198+0000","last_undegraded":"2024-09-20T21:02:34.007198+0000","last_fullsized":"2024-09-20T21:02:34.007198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:38.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"53'9316","reported_seq":9389,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:35.018886+0000","last_change":"2024-09-20T21:02:24.549206+0000","last_active":"2024-09-20T21:02:35.018886+0000","last_peered":"2024-09-20T21:02:35.018886+0000","last_clean":"2024-09-20T21:02:23.487750+0000","last_became_active":"2024-09-20T21:02:24.549206+0000","last_became_peered":"2024-09-20T21:02:24.549206+0000","last_unstale":"2024-09-20T21:02:35.018886+0000","last_undegraded":"2024-09-20T21:02:24.543537+0000","last_fullsized":"2024-09-20T21:02:24.543316+0000","mapping_epoch":48,"log_start":"37'5700","ondisk_log_start":"37'5700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3616,"log_dups_size":0,"ondisk_log_size":3616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:33.670486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":469368832,"num_objects":7162,"num_object_clones":0,"num_object_copies":14324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7162,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9316,"num_write_kb":527296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":7162}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":90,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:34.003263+0000","last_change":"2024-09-20T21:02:24.565393+0000","last_active":"2024-09-20T21:02:34.003263+0000","last_peered":"2024-09-20T21:02:34.003263+0000","last_clean":"2024-09-20T21:02:22.533251+0000","last_became_active":"2024-09-20T21:02:24.565393+0000","last_became_peered":"2024-09-20T21:02:24.565393+0000","last_unstale":"2024-09-20T21:02:34.003263+0000","last_undegraded":"2024-09-20T21:02:24.546759+0000","last_fullsized":"2024-09-20T21:02:24.546602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:22.549940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003946+0000","last_change":"2024-09-20T21:02:24.558501+0000","last_active":"2024-09-20T21:02:34.003946+0000","last_peered":"2024-09-20T21:02:34.003946+0000","last_clean":"2024-09-20T21:02:22.530658+0000","last_became_active":"2024-09-20T21:02:24.558501+0000","last_became_peered":"2024-09-20T21:02:24.558501+0000","last_unstale":"2024-09-20T21:02:34.003946+0000","last_undegraded":"2024-09-20T21:02:34.003946+0000","last_fullsized":"2024-09-20T21:02:24.546569+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:42.910380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.003431+0000","last_change":"2024-09-20T21:01:12.227184+0000","last_active":"2024-09-20T21:02:34.003431+0000","last_peered":"2024-09-20T21:02:34.003431+0000","last_clean":"2024-09-20T21:02:34.003431+0000","last_became_active":"2024-09-20T21:01:12.224538+0000","last_became_peered":"2024-09-20T21:01:12.224538+0000","last_unstale":"2024-09-20T21:02:34.003431+0000","last_undegraded":"2024-09-20T21:02:34.003431+0000","last_fullsized":"2024-09-20T21:02:34.003431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.361211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"53'9342","reported_seq":9412,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:35.013118+0000","last_change":"2024-09-20T21:02:24.555882+0000","last_active":"2024-09-20T21:02:35.013118+0000","last_peered":"2024-09-20T21:02:35.013118+0000","last_clean":"2024-09-20T21:02:23.511988+0000","last_became_active":"2024-09-20T21:02:24.555882+0000","last_became_peered":"2024-09-20T21:02:24.555882+0000","last_unstale":"2024-09-20T21:02:35.013118+0000","last_undegraded":"2024-09-20T21:02:24.543182+0000","last_fullsized":"2024-09-20T21:02:24.542942+0000","mapping_epoch":48,"log_start":"39'5800","ondisk_log_start":"39'5800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3542,"log_dups_size":0,"ondisk_log_size":3542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:25.328982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466354176,"num_objects":7116,"num_object_clones":0,"num_object_copies":14232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9342,"num_write_kb":526656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":7116}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002314+0000","last_change":"2024-09-20T21:02:24.562033+0000","last_active":"2024-09-20T21:02:34.002314+0000","last_peered":"2024-09-20T21:02:34.002314+0000","last_clean":"2024-09-20T21:02:22.530630+0000","last_became_active":"2024-09-20T21:02:24.562033+0000","last_became_peered":"2024-09-20T21:02:24.562033+0000","last_unstale":"2024-09-20T21:02:34.002314+0000","last_undegraded":"2024-09-20T21:02:34.002314+0000","last_fullsized":"2024-09-20T21:02:24.544084+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:21.173278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.003604+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:02:34.003604+0000","last_peered":"2024-09-20T21:02:34.003604+0000","last_clean":"2024-09-20T21:02:34.003604+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:02:34.003604+0000","last_undegraded":"2024-09-20T21:02:34.003604+0000","last_fullsized":"2024-09-20T21:02:34.003604+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997434+0000","last_change":"2024-09-20T21:02:24.551514+0000","last_active":"2024-09-20T21:02:33.997434+0000","last_peered":"2024-09-20T21:02:33.997434+0000","last_clean":"2024-09-20T21:02:22.534700+0000","last_became_active":"2024-09-20T21:02:24.551514+0000","last_became_peered":"2024-09-20T21:02:24.551514+0000","last_unstale":"2024-09-20T21:02:33.997434+0000","last_undegraded":"2024-09-20T21:02:33.997434+0000","last_fullsized":"2024-09-20T21:02:24.547738+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:14.175466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"53'9293","reported_seq":9367,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:35.010830+0000","last_change":"2024-09-20T21:02:24.554907+0000","last_active":"2024-09-20T21:02:35.010830+0000","last_peered":"2024-09-20T21:02:35.010830+0000","last_clean":"2024-09-20T21:02:23.506918+0000","last_became_active":"2024-09-20T21:02:24.554907+0000","last_became_peered":"2024-09-20T21:02:24.554907+0000","last_unstale":"2024-09-20T21:02:35.010830+0000","last_undegraded":"2024-09-20T21:02:24.544088+0000","last_fullsized":"2024-09-20T21:02:24.542698+0000","mapping_epoch":48,"log_start":"37'5700","ondisk_log_start":"37'5700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:40.376475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":469434368,"num_objects":7163,"num_object_clones":0,"num_object_copies":14326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7163,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7163,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9293,"num_write_kb":526592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":7163}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.003534+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:02:34.003534+0000","last_peered":"2024-09-20T21:02:34.003534+0000","last_clean":"2024-09-20T21:02:34.003534+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:02:34.003534+0000","last_undegraded":"2024-09-20T21:02:34.003534+0000","last_fullsized":"2024-09-20T21:02:34.003534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.002573+0000","last_change":"2024-09-20T21:02:06.430321+0000","last_active":"2024-09-20T21:02:34.002573+0000","last_peered":"2024-09-20T21:02:34.002573+0000","last_clean":"2024-09-20T21:02:34.002573+0000","last_became_active":"2024-09-20T21:02:06.429077+0000","last_became_peered":"2024-09-20T21:02:06.429077+0000","last_unstale":"2024-09-20T21:02:34.002573+0000","last_undegraded":"2024-09-20T21:02:34.002573+0000","last_fullsized":"2024-09-20T21:02:34.002573+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:28.024220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997043+0000","last_change":"2024-09-20T21:02:24.552569+0000","last_active":"2024-09-20T21:02:33.997043+0000","last_peered":"2024-09-20T21:02:33.997043+0000","last_clean":"2024-09-20T21:02:22.535728+0000","last_became_active":"2024-09-20T21:02:24.552569+0000","last_became_peered":"2024-09-20T21:02:24.552569+0000","last_unstale":"2024-09-20T21:02:33.997043+0000","last_undegraded":"2024-09-20T21:02:33.997043+0000","last_fullsized":"2024-09-20T21:02:24.548035+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:12:01.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"53'9418","reported_seq":9487,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:35.010349+0000","last_change":"2024-09-20T21:02:24.549138+0000","last_active":"2024-09-20T21:02:35.010349+0000","last_peered":"2024-09-20T21:02:35.010349+0000","last_clean":"2024-09-20T21:02:23.529567+0000","last_became_active":"2024-09-20T21:02:24.549138+0000","last_became_peered":"2024-09-20T21:02:24.549138+0000","last_unstale":"2024-09-20T21:02:35.010349+0000","last_undegraded":"2024-09-20T21:02:24.542689+0000","last_fullsized":"2024-09-20T21:02:24.542452+0000","mapping_epoch":48,"log_start":"37'5800","ondisk_log_start":"37'5800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":3618,"log_dups_size":0,"ondisk_log_size":3618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:05.305293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473169920,"num_objects":7220,"num_object_clones":0,"num_object_copies":14440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7220,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9418,"num_write_kb":532416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":7220}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.007860+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:02:34.007860+0000","last_peered":"2024-09-20T21:02:34.007860+0000","last_clean":"2024-09-20T21:02:34.007860+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:02:34.007860+0000","last_undegraded":"2024-09-20T21:02:34.007860+0000","last_fullsized":"2024-09-20T21:02:34.007860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.004118+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:02:34.004118+0000","last_peered":"2024-09-20T21:02:34.004118+0000","last_clean":"2024-09-20T21:02:34.004118+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:02:34.004118+0000","last_undegraded":"2024-09-20T21:02:34.004118+0000","last_fullsized":"2024-09-20T21:02:34.004118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.004286+0000","last_change":"2024-09-20T21:02:24.554982+0000","last_active":"2024-09-20T21:02:34.004286+0000","last_peered":"2024-09-20T21:02:34.004286+0000","last_clean":"2024-09-20T21:02:22.530413+0000","last_became_active":"2024-09-20T21:02:24.554982+0000","last_became_peered":"2024-09-20T21:02:24.554982+0000","last_unstale":"2024-09-20T21:02:34.004286+0000","last_undegraded":"2024-09-20T21:02:34.004286+0000","last_fullsized":"2024-09-20T21:02:24.546462+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:40.216088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"53'9316","reported_seq":9387,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:35.014126+0000","last_change":"2024-09-20T21:01:26.199069+0000","last_active":"2024-09-20T21:02:35.014126+0000","last_peered":"2024-09-20T21:02:35.014126+0000","last_clean":"2024-09-20T21:02:35.014126+0000","last_became_active":"2024-09-20T21:01:26.198393+0000","last_became_peered":"2024-09-20T21:01:26.198393+0000","last_unstale":"2024-09-20T21:02:35.014126+0000","last_undegraded":"2024-09-20T21:02:35.014126+0000","last_fullsized":"2024-09-20T21:02:35.014126+0000","mapping_epoch":21,"log_start":"36'5300","ondisk_log_start":"36'5300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:25.146937+0000","last_clean_scrub_stamp":"2024-09-20T21:01:25.146937+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:31.789539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470679552,"num_objects":7182,"num_object_clones":0,"num_object_copies":14364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7182,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9316,"num_write_kb":527936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":85,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:34.003715+0000","last_change":"2024-09-20T21:02:24.560381+0000","last_active":"2024-09-20T21:02:34.003715+0000","last_peered":"2024-09-20T21:02:34.003715+0000","last_clean":"2024-09-20T21:02:22.532355+0000","last_became_active":"2024-09-20T21:02:24.560381+0000","last_became_peered":"2024-09-20T21:02:24.560381+0000","last_unstale":"2024-09-20T21:02:34.003715+0000","last_undegraded":"2024-09-20T21:02:24.547883+0000","last_fullsized":"2024-09-20T21:02:24.547665+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:04.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.998914+0000","last_change":"2024-09-20T21:02:24.559584+0000","last_active":"2024-09-20T21:02:33.998914+0000","last_peered":"2024-09-20T21:02:33.998914+0000","last_clean":"2024-09-20T21:01:05.975597+0000","last_became_active":"2024-09-20T21:02:24.559584+0000","last_became_peered":"2024-09-20T21:02:24.559584+0000","last_unstale":"2024-09-20T21:02:33.998914+0000","last_undegraded":"2024-09-20T21:02:33.998914+0000","last_fullsized":"2024-09-20T21:02:24.551624+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:51:13.895254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.996752+0000","last_change":"2024-09-20T21:02:24.555190+0000","last_active":"2024-09-20T21:02:33.996752+0000","last_peered":"2024-09-20T21:02:33.996752+0000","last_clean":"2024-09-20T21:02:22.534499+0000","last_became_active":"2024-09-20T21:02:24.555190+0000","last_became_peered":"2024-09-20T21:02:24.555190+0000","last_unstale":"2024-09-20T21:02:33.996752+0000","last_undegraded":"2024-09-20T21:02:33.996752+0000","last_fullsized":"2024-09-20T21:02:24.547743+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:19.592226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.996741+0000","last_change":"2024-09-20T21:02:24.551121+0000","last_active":"2024-09-20T21:02:33.996741+0000","last_peered":"2024-09-20T21:02:33.996741+0000","last_clean":"2024-09-20T21:01:11.169670+0000","last_became_active":"2024-09-20T21:02:24.551121+0000","last_became_peered":"2024-09-20T21:02:24.551121+0000","last_unstale":"2024-09-20T21:02:33.996741+0000","last_undegraded":"2024-09-20T21:02:33.996741+0000","last_fullsized":"2024-09-20T21:02:24.547669+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:54.229810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":70,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:33.996811+0000","last_change":"2024-09-20T21:02:24.552388+0000","last_active":"2024-09-20T21:02:33.996811+0000","last_peered":"2024-09-20T21:02:33.996811+0000","last_clean":"2024-09-20T21:02:04.398394+0000","last_became_active":"2024-09-20T21:02:24.552388+0000","last_became_peered":"2024-09-20T21:02:24.552388+0000","last_unstale":"2024-09-20T21:02:33.996811+0000","last_undegraded":"2024-09-20T21:02:24.548996+0000","last_fullsized":"2024-09-20T21:02:24.548885+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:20.657049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.002563+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:02:34.002563+0000","last_peered":"2024-09-20T21:02:34.002563+0000","last_clean":"2024-09-20T21:02:34.002563+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:02:34.002563+0000","last_undegraded":"2024-09-20T21:02:34.002563+0000","last_fullsized":"2024-09-20T21:02:34.002563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":87,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:33.998519+0000","last_change":"2024-09-20T21:02:24.559325+0000","last_active":"2024-09-20T21:02:33.998519+0000","last_peered":"2024-09-20T21:02:33.998519+0000","last_clean":"2024-09-20T21:02:22.536390+0000","last_became_active":"2024-09-20T21:02:24.559325+0000","last_became_peered":"2024-09-20T21:02:24.559325+0000","last_unstale":"2024-09-20T21:02:33.998519+0000","last_undegraded":"2024-09-20T21:02:24.550768+0000","last_fullsized":"2024-09-20T21:02:24.550690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:08.182067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002701+0000","last_change":"2024-09-20T21:02:24.554268+0000","last_active":"2024-09-20T21:02:34.002701+0000","last_peered":"2024-09-20T21:02:34.002701+0000","last_clean":"2024-09-20T21:02:22.532010+0000","last_became_active":"2024-09-20T21:02:24.554268+0000","last_became_peered":"2024-09-20T21:02:24.554268+0000","last_unstale":"2024-09-20T21:02:34.002701+0000","last_undegraded":"2024-09-20T21:02:34.002701+0000","last_fullsized":"2024-09-20T21:02:24.545139+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:39.408553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003752+0000","last_change":"2024-09-20T21:02:24.561298+0000","last_active":"2024-09-20T21:02:34.003752+0000","last_peered":"2024-09-20T21:02:34.003752+0000","last_clean":"2024-09-20T21:02:22.530269+0000","last_became_active":"2024-09-20T21:02:24.561298+0000","last_became_peered":"2024-09-20T21:02:24.561298+0000","last_unstale":"2024-09-20T21:02:34.003752+0000","last_undegraded":"2024-09-20T21:02:34.003752+0000","last_fullsized":"2024-09-20T21:02:24.543702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:48.155527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.007662+0000","last_change":"2024-09-20T21:02:24.559700+0000","last_active":"2024-09-20T21:02:34.007662+0000","last_peered":"2024-09-20T21:02:34.007662+0000","last_clean":"2024-09-20T21:02:22.531300+0000","last_became_active":"2024-09-20T21:02:24.559700+0000","last_became_peered":"2024-09-20T21:02:24.559700+0000","last_unstale":"2024-09-20T21:02:34.007662+0000","last_undegraded":"2024-09-20T21:02:34.007662+0000","last_fullsized":"2024-09-20T21:02:24.551254+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:51:12.750702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.004136+0000","last_change":"2024-09-20T21:01:12.227325+0000","last_active":"2024-09-20T21:02:34.004136+0000","last_peered":"2024-09-20T21:02:34.004136+0000","last_clean":"2024-09-20T21:02:34.004136+0000","last_became_active":"2024-09-20T21:01:12.224581+0000","last_became_peered":"2024-09-20T21:01:12.224581+0000","last_unstale":"2024-09-20T21:02:34.004136+0000","last_undegraded":"2024-09-20T21:02:34.004136+0000","last_fullsized":"2024-09-20T21:02:34.004136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:40.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.998720+0000","last_change":"2024-09-20T21:02:24.559436+0000","last_active":"2024-09-20T21:02:33.998720+0000","last_peered":"2024-09-20T21:02:33.998720+0000","last_clean":"2024-09-20T21:02:22.535828+0000","last_became_active":"2024-09-20T21:02:24.559436+0000","last_became_peered":"2024-09-20T21:02:24.559436+0000","last_unstale":"2024-09-20T21:02:33.998720+0000","last_undegraded":"2024-09-20T21:02:33.998720+0000","last_fullsized":"2024-09-20T21:02:24.551082+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:41.795024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.004412+0000","last_change":"2024-09-20T21:01:11.211342+0000","last_active":"2024-09-20T21:02:34.004412+0000","last_peered":"2024-09-20T21:02:34.004412+0000","last_clean":"2024-09-20T21:02:34.004412+0000","last_became_active":"2024-09-20T21:01:11.210623+0000","last_became_peered":"2024-09-20T21:01:11.210623+0000","last_unstale":"2024-09-20T21:02:34.004412+0000","last_undegraded":"2024-09-20T21:02:34.004412+0000","last_fullsized":"2024-09-20T21:02:34.004412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:10.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002565+0000","last_change":"2024-09-20T21:02:24.550707+0000","last_active":"2024-09-20T21:02:34.002565+0000","last_peered":"2024-09-20T21:02:34.002565+0000","last_clean":"2024-09-20T21:02:22.531974+0000","last_became_active":"2024-09-20T21:02:24.550707+0000","last_became_peered":"2024-09-20T21:02:24.550707+0000","last_unstale":"2024-09-20T21:02:34.002565+0000","last_undegraded":"2024-09-20T21:02:34.002565+0000","last_fullsized":"2024-09-20T21:02:24.544533+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:41:09.902869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.004381+0000","last_change":"2024-09-20T21:02:24.561965+0000","last_active":"2024-09-20T21:02:34.004381+0000","last_peered":"2024-09-20T21:02:34.004381+0000","last_clean":"2024-09-20T21:02:22.530396+0000","last_became_active":"2024-09-20T21:02:24.561965+0000","last_became_peered":"2024-09-20T21:02:24.561965+0000","last_unstale":"2024-09-20T21:02:34.004381+0000","last_undegraded":"2024-09-20T21:02:34.004381+0000","last_fullsized":"2024-09-20T21:02:24.545371+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:57.620911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997483+0000","last_change":"2024-09-20T21:02:24.557911+0000","last_active":"2024-09-20T21:02:33.997483+0000","last_peered":"2024-09-20T21:02:33.997483+0000","last_clean":"2024-09-20T21:02:22.536184+0000","last_became_active":"2024-09-20T21:02:24.557911+0000","last_became_peered":"2024-09-20T21:02:24.557911+0000","last_unstale":"2024-09-20T21:02:33.997483+0000","last_undegraded":"2024-09-20T21:02:33.997483+0000","last_fullsized":"2024-09-20T21:02:24.549733+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:10.520461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.002248+0000","last_change":"2024-09-20T21:02:06.421747+0000","last_active":"2024-09-20T21:02:34.002248+0000","last_peered":"2024-09-20T21:02:34.002248+0000","last_clean":"2024-09-20T21:02:34.002248+0000","last_became_active":"2024-09-20T21:02:06.421099+0000","last_became_peered":"2024-09-20T21:02:06.421099+0000","last_unstale":"2024-09-20T21:02:34.002248+0000","last_undegraded":"2024-09-20T21:02:34.002248+0000","last_fullsized":"2024-09-20T21:02:34.002248+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:19.204963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.002084+0000","last_change":"2024-09-20T21:02:06.429129+0000","last_active":"2024-09-20T21:02:34.002084+0000","last_peered":"2024-09-20T21:02:34.002084+0000","last_clean":"2024-09-20T21:02:34.002084+0000","last_became_active":"2024-09-20T21:02:06.426810+0000","last_became_peered":"2024-09-20T21:02:06.426810+0000","last_unstale":"2024-09-20T21:02:34.002084+0000","last_undegraded":"2024-09-20T21:02:34.002084+0000","last_fullsized":"2024-09-20T21:02:34.002084+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:48.423546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":85,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:33.997308+0000","last_change":"2024-09-20T21:02:24.552596+0000","last_active":"2024-09-20T21:02:33.997308+0000","last_peered":"2024-09-20T21:02:33.997308+0000","last_clean":"2024-09-20T21:02:22.535791+0000","last_became_active":"2024-09-20T21:02:24.552596+0000","last_became_peered":"2024-09-20T21:02:24.552596+0000","last_unstale":"2024-09-20T21:02:33.997308+0000","last_undegraded":"2024-09-20T21:02:33.997308+0000","last_fullsized":"2024-09-20T21:02:24.548706+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:41.792581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.003029+0000","last_change":"2024-09-20T21:02:24.556399+0000","last_active":"2024-09-20T21:02:34.003029+0000","last_peered":"2024-09-20T21:02:34.003029+0000","last_clean":"2024-09-20T21:02:22.530518+0000","last_became_active":"2024-09-20T21:02:24.556399+0000","last_became_peered":"2024-09-20T21:02:24.556399+0000","last_unstale":"2024-09-20T21:02:34.003029+0000","last_undegraded":"2024-09-20T21:02:34.003029+0000","last_fullsized":"2024-09-20T21:02:24.544870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:51:19.089327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":85,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:34.003412+0000","last_change":"2024-09-20T21:02:24.573259+0000","last_active":"2024-09-20T21:02:34.003412+0000","last_peered":"2024-09-20T21:02:34.003412+0000","last_clean":"2024-09-20T21:02:22.531305+0000","last_became_active":"2024-09-20T21:02:24.573259+0000","last_became_peered":"2024-09-20T21:02:24.573259+0000","last_unstale":"2024-09-20T21:02:34.003412+0000","last_undegraded":"2024-09-20T21:02:24.550576+0000","last_fullsized":"2024-09-20T21:02:24.550333+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:16:38.764361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.002645+0000","last_change":"2024-09-20T21:02:24.562203+0000","last_active":"2024-09-20T21:02:34.002645+0000","last_peered":"2024-09-20T21:02:34.002645+0000","last_clean":"2024-09-20T21:02:22.533084+0000","last_became_active":"2024-09-20T21:02:24.562203+0000","last_became_peered":"2024-09-20T21:02:24.562203+0000","last_unstale":"2024-09-20T21:02:34.002645+0000","last_undegraded":"2024-09-20T21:02:34.002645+0000","last_fullsized":"2024-09-20T21:02:24.544528+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:28.649371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":86,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:33.997861+0000","last_change":"2024-09-20T21:02:24.558705+0000","last_active":"2024-09-20T21:02:33.997861+0000","last_peered":"2024-09-20T21:02:33.997861+0000","last_clean":"2024-09-20T21:02:22.536295+0000","last_became_active":"2024-09-20T21:02:24.558705+0000","last_became_peered":"2024-09-20T21:02:24.558705+0000","last_unstale":"2024-09-20T21:02:33.997861+0000","last_undegraded":"2024-09-20T21:02:24.550114+0000","last_fullsized":"2024-09-20T21:02:24.550044+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:39.408553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.004546+0000","last_change":"2024-09-20T21:02:06.427461+0000","last_active":"2024-09-20T21:02:34.004546+0000","last_peered":"2024-09-20T21:02:34.004546+0000","last_clean":"2024-09-20T21:02:34.004546+0000","last_became_active":"2024-09-20T21:02:06.426709+0000","last_became_peered":"2024-09-20T21:02:06.426709+0000","last_unstale":"2024-09-20T21:02:34.004546+0000","last_undegraded":"2024-09-20T21:02:34.004546+0000","last_fullsized":"2024-09-20T21:02:34.004546+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:25:05.037879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-20T21:02:34.003202+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:02:34.003202+0000","last_peered":"2024-09-20T21:02:34.003202+0000","last_clean":"2024-09-20T21:02:34.003202+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:02:34.003202+0000","last_undegraded":"2024-09-20T21:02:34.003202+0000","last_fullsized":"2024-09-20T21:02:34.003202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":75,"reported_epoch":53,"state":"active+undersized","last_fresh":"2024-09-20T21:02:34.004055+0000","last_change":"2024-09-20T21:02:24.550928+0000","last_active":"2024-09-20T21:02:34.004055+0000","last_peered":"2024-09-20T21:02:34.004055+0000","last_clean":"2024-09-20T21:02:22.530309+0000","last_became_active":"2024-09-20T21:02:24.550928+0000","last_became_peered":"2024-09-20T21:02:24.550928+0000","last_unstale":"2024-09-20T21:02:34.004055+0000","last_undegraded":"2024-09-20T21:02:34.004055+0000","last_fullsized":"2024-09-20T21:02:24.544354+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:27:17.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":88,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2024-09-20T21:02:34.007439+0000","last_change":"2024-09-20T21:02:24.559051+0000","last_active":"2024-09-20T21:02:34.007439+0000","last_peered":"2024-09-20T21:02:34.007439+0000","last_clean":"2024-09-20T21:02:22.531138+0000","last_became_active":"2024-09-20T21:02:24.559051+0000","last_became_peered":"2024-09-20T21:02:24.559051+0000","last_unstale":"2024-09-20T21:02:34.007439+0000","last_undegraded":"2024-09-20T21:02:24.550496+0000","last_fullsized":"2024-09-20T21:02:24.549103+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:39:52.166790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7530151960,"num_objects":114902,"num_object_clones":0,"num_object_copies":229804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":71512,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114902,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":149302,"num_write_kb":8454465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":953253888,"data_stored":15251996696,"data_compressed":73125734,"data_compressed_allocated":953249792,"data_compressed_original":15251996672,"omap_allocated":0,"internal_metadata":0},"log_size":59875,"ondisk_log_size":59875,"up":22,"acting":22,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":87,"acting":87,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738391,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407148,"kb_used_data":263496,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":93964692,"statfs":{"total":96636764160,"available":96219844608,"internally_reserved":0,"allocated":269819904,"data_stored":4307245895,"data_compressed":20662552,"data_compressed_allocated":269193216,"data_compressed_original":4307009536,"omap_allocated":1596,"internal_metadata":147061188},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398440,"kb_used_data":295052,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":93973400,"statfs":{"total":96636764160,"available":96228761600,"internally_reserved":0,"allocated":302133248,"data_stored":4825663315,"data_compressed":23132861,"data_compressed_allocated":301596672,"data_compressed_original":4825464832,"omap_allocated":1596,"internal_metadata":105839044},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":610240,"kb_used_data":380504,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93761600,"statfs":{"total":96636764160,"available":96011878400,"internally_reserved":0,"allocated":389636096,"data_stored":6224958600,"data_compressed":29850497,"data_compressed_allocated":389046272,"data_compressed_original":6224740352,"omap_allocated":1596,"internal_metadata":235207108},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":383000576,"data_stored":6128009216,"data_compressed":29387033,"data_compressed_allocated":383000576,"data_compressed_original":6128009216,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":304930816,"data_stored":4878893056,"data_compressed":23381237,"data_compressed_allocated":304930816,"data_compressed_original":4878893056,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":265322496,"data_stored":4245094424,"data_compressed":20357464,"data_compressed_allocated":265318400,"data_compressed_original":4245094400,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:02:37.124 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:37.124 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:37.145 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:37.191 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:37.184+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:37.292 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:37.288+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:37.296 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:37.296 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:37.317 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:37.392 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:37.389+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:37.465 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:37.465 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:37.484 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:37.496 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:37.488+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:37.595 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:37.593+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:37.671 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:37.671 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:37.687 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:37.730 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:37.729+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:37.798 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:37.793+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:37.835 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:37.835 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:37.856 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:37.899 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:37.897+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:37.999 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:37.996+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:38.007 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:38.007 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:38.026 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:38.101 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:38.097+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:38.180 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:38.201 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:38.197+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:38.217 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:38.217 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:38.238 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:38.307 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:38.301+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:38.346 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:38.346 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:38.364 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:38.364 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:38.367 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:38.367 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:38.392 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:38.392 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:157881 5.f 5:f9012195:::benchmark_data_smithi112_23632_object25777:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:38.388927+0000", 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0036708489999999999, 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003688532, 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 157881 2024-09-20T21:02:38.393 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388927+0000", 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388927+0000", 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.394 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388928+0000", 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3200000000000003e-07 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388932+0000", 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4689999999999999e-06 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388943+0000", 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1336e-05 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.395 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388951+0000", 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4529999999999996e-06 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.390700+0000", 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017491550000000001 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.390855+0000", 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015464999999999999 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.396 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:157882 5.4 e54/38 5:240188d1:::benchmark_data_smithi112_23632_object25778:head v 54'9925, mlcod=54'9923)", 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:38.389505+0000", 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0030921379999999999, 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0031550200000000001, 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.397 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.389505+0000", 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.389505+0000", 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.389506+0000", 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2699999999999999e-07 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.398 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.389512+0000", 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8889999999999999e-06 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.389522+0000", 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6579999999999997e-06 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.389528+0000", 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1970000000000001e-06 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.399 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.389580+0000", 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1984999999999998e-05 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.389598+0000", 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8542999999999998e-05 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:157888 5.4 e54/38 5:2a4bb6dc:::benchmark_data_smithi112_23632_object25784:head v 54'9926, mlcod=54'9923)", 2024-09-20T21:02:38.400 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:38.391750+0000", 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00084705999999999996, 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00094223799999999997, 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391750+0000", 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391750+0000", 2024-09-20T21:02:38.401 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391751+0000", 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1699999999999998e-07 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391761+0000", 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0366999999999999e-05 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.402 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391775+0000", 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3954000000000001e-05 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391784+0000", 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6989999999999992e-06 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391839+0000", 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5083000000000001e-05 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.403 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391858+0000", 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8890999999999999e-05 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:157890 5.b 5:d5f0fb6b:::benchmark_data_smithi112_23632_object25786:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:38.391760+0000", 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00083736699999999999, 2024-09-20T21:02:38.404 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00096565099999999999, 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 157890 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391760+0000", 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.405 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391760+0000", 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391761+0000", 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5499999999999997e-07 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391764+0000", 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2169999999999999e-06 2024-09-20T21:02:38.406 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391778+0000", 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4191e-05 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391784+0000", 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7470000000000002e-06 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391835+0000", 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1155000000000001e-05 2024-09-20T21:02:38.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391923+0000", 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8199e-05 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.391990+0000", 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6812999999999999e-05 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:157875 5.9 5:9a0f7c8c:::benchmark_data_smithi112_23632_object25771:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:38.387722+0000", 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0048754410000000003, 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.005044677, 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 157875 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.387722+0000", 2024-09-20T21:02:38.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.387722+0000", 2024-09-20T21:02:38.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.387723+0000", 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6000000000000003e-07 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.387727+0000", 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7409999999999998e-06 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.387735+0000", 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6819999999999992e-06 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.387741+0000", 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5609999999999998e-06 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.387788+0000", 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7039000000000001e-05 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.387927+0000", 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139114 2024-09-20T21:02:38.412 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:157877 5.f 5:fd9eb94c:::benchmark_data_smithi112_23632_object25773:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:38.388479+0000", 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.004118455, 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0043512179999999996, 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.413 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 157877 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388479+0000", 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388479+0000", 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388480+0000", 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9100000000000004e-07 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388482+0000", 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.864e-06 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388490+0000", 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9459999999999998e-06 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.415 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388494+0000", 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9929999999999997e-06 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388537+0000", 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2914000000000003e-05 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:38.388704+0000", 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016692500000000001 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.416 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.417 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.417 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.417 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:38.417 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 6 2024-09-20T21:02:38.417 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:38.418 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:38.418 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:38.413+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:38.518 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:38.512+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:38.612 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:38.613 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:38.613 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:38.613 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:38.613 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:38.620 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:38.617+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:38.632 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:38.722 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:38.721+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:38.822 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:38.817+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 86.629660819999998, 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.828 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:38.830 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:38.831 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.832 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:38.833 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.834 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 86.629570783999995, 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:38.835 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.838 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.840 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 86.629484430999995, 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:38.846 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 86.629415621999996, 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:38.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:38.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.851 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 86.629382762000006, 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.853 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:38.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 86.629340744999993, 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.859 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:38.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:38.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 86.629215638999995, 2024-09-20T21:02:38.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:38.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:38.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:38.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:38.871 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 86.629123289999995, 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:38.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:38.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 86.629038918000006, 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:38.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.880 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 47.863579461999997, 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.881 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.886 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 47.863027455999998, 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:38.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:38.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 47.862399875000001, 2024-09-20T21:02:38.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:38.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:38.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:38.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 47.862288866, 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.898 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:38.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:38.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:38.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 47.858622353999998, 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.904 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:38.909 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 47.858308020000003, 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.910 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:38.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 47.858125901999998, 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.916 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:38.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:38.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 27.112665978999999, 2024-09-20T21:02:38.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:38.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 27.108315053999998, 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.927 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:38.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 27.100072983, 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.933 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:38.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.938 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:127649 5.b 5:df1d496f:::benchmark_data_smithi112_23632_object127648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.658138047, 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023813432999999998, 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:38.939 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 127649 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167595+0000", 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167688+0000", 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2756000000000004e-05 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167703+0000", 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5048999999999999e-05 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167710+0000", 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0099999999999998e-06 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167758+0000", 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8479000000000001e-05 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167873+0000", 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114753 2024-09-20T21:02:38.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167985+0000", 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011221 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.171532+0000", 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035466080000000001 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191348+0000", 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019815856 2024-09-20T21:02:38.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191382+0000", 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4156999999999998e-05 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191408+0000", 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5788000000000001e-05 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:38.944 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:38.945 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:38.946 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:38.947 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:38.940+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:39.042 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T21:02:39.046 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:39.045+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159673 5.c 5:37148dff:::benchmark_data_smithi112_23632_object27569:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:39.105614+0000", 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0045120450000000001, 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0045297330000000002, 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:39.111 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159673 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.105614+0000", 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.105614+0000", 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.105614+0000", 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8999999999999995e-07 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.105619+0000", 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2590000000000002e-06 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.105631+0000", 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2084e-05 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.105638+0000", 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8859999999999998e-06 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.105688+0000", 2024-09-20T21:02:39.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0801999999999999e-05 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.105800+0000", 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111562 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159674 5.8 5:1024cd20:::benchmark_data_smithi112_23632_object27570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:39.107030+0000", 2024-09-20T21:02:39.115 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003095455, 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031592619999999999, 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159674 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.107030+0000", 2024-09-20T21:02:39.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.107030+0000", 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.107031+0000", 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.99e-07 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.107034+0000", 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2490000000000001e-06 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.107043+0000", 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6889999999999993e-06 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.107047+0000", 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4660000000000001e-06 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.107092+0000", 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5331999999999999e-05 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.107208+0000", 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115771 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.107315+0000", 2024-09-20T21:02:39.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106505 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.110022+0000", 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00270726 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159678 5.2 5:41f30f1b:::benchmark_data_smithi112_23632_object27574:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:39.108385+0000", 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0017402170000000001, 2024-09-20T21:02:39.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0018464480000000001, 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159678 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108385+0000", 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108385+0000", 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108386+0000", 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8199999999999999e-07 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108389+0000", 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.236e-06 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108398+0000", 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2959999999999999e-06 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108402+0000", 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.634e-06 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108449+0000", 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752999999999998e-05 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108544+0000", 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5390999999999995e-05 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159680 5.2 5.76223432 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.124 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:39.108455+0000", 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0016707340000000001, 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001810512, 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159680 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108455+0000", 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108455+0000", 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108455+0000", 2024-09-20T21:02:39.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.96e-07 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108458+0000", 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4830000000000002e-06 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108463+0000", 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.87e-06 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108466+0000", 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2370000000000001e-06 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159681 5.4 5:2bb38d6c:::benchmark_data_smithi112_23632_object27577:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:39.108484+0000", 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001641705, 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001813839, 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.128 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159681 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108484+0000", 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108484+0000", 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108484+0000", 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5499999999999999e-07 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108486+0000", 2024-09-20T21:02:39.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.615e-06 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108490+0000", 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1659999999999996e-06 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108493+0000", 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3139999999999999e-06 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108525+0000", 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1956999999999999e-05 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108594+0000", 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8856999999999995e-05 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108657+0000", 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2411999999999998e-05 2024-09-20T21:02:39.132 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:159679 5.e e54/21 5:7a99ad83:::benchmark_data_smithi112_23632_object27575:head v 54'9943, mlcod=54'9940)", 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:39.108853+0000", 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001272982, 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001511545, 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108853+0000", 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108853+0000", 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108853+0000", 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6599999999999996e-07 2024-09-20T21:02:39.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108859+0000", 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4179999999999996e-06 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108869+0000", 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0049e-05 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108875+0000", 2024-09-20T21:02:39.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.562e-06 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108922+0000", 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6458999999999997e-05 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.108939+0000", 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7214000000000002e-05 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.136 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:159683 5.6 5.22701d6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:39.109404+0000", 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000721884, 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001017656, 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 159683 2024-09-20T21:02:39.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109404+0000", 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109404+0000", 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109404+0000", 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5499999999999997e-07 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109408+0000", 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.084e-06 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109417+0000", 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8060000000000006e-06 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109423+0000", 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.959e-06 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:159677 5.0 e54/21 5:0fff3ab9:::benchmark_data_smithi112_23632_object27573:head v 54'9942, mlcod=54'9939)", 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:39.109444+0000", 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00068132499999999999, 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010363740000000001, 2024-09-20T21:02:39.140 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109444+0000", 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109444+0000", 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109445+0000", 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1500000000000005e-07 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109449+0000", 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2679999999999996e-06 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109457+0000", 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7230000000000004e-06 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109461+0000", 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.437e-06 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109500+0000", 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9125000000000002e-05 2024-09-20T21:02:39.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:39.109516+0000", 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5965e-05 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 8 2024-09-20T21:02:39.144 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:39.145 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:39.147 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:39.140+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:39.250 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:39.244+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:39.292 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:39.292 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:39.292 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:39.292 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:39.292 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:39.312 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:39.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-09-20T21:02:39.356 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:39.352+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:39.450 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:39.444+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:39.508 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:39.508 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.312222715999994, 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:39.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:39.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:39.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.312088517000007, 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.515 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:39.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:39.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.311983510999994, 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.521 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:39.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:39.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.311863986000006, 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:39.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:39.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:39.533 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.311793979000001, 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:39.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:39.539 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.311718927000001, 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:39.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.311631900999998, 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:39.546 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:39.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.550 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.311563128000003, 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:39.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.555 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.793816464999999, 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.559 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.560 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.560 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:39.561 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:39.561 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.790980822000002, 2024-09-20T21:02:39.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:39.561 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.561 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.561 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.561 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:39.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:39.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.790531016999999, 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:39.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:39.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.790427852000001, 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:39.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:39.578 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.790339866, 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:39.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.789527362000001, 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.584 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:39.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:39.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.787758802999999, 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:39.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:39.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:39.594 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.787294284000001, 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:39.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:39.600 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.787098412999999, 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:39.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:39.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:39.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:39.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:39.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.786616550000002, 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:39.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.612 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.784468489999998, 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:39.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:39.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.618 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:39.619 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:39.619 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.781337206, 2024-09-20T21:02:39.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:39.619 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:39.619 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:39.619 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:39.619 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:39.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:39.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:39.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:39.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:39.623 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:39.625 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:39.625 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:39.620+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:39.725 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:39.721+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:39.781 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:39.781 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:39.781 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.781 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:161331 5.e 5:73228935:::benchmark_data_smithi112_23632_object29227:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.781 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:39.776411+0000", 2024-09-20T21:02:39.781 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.003904425, 2024-09-20T21:02:39.781 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0039302859999999998, 2024-09-20T21:02:39.781 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:39.781 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:39.781 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 161331 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.776411+0000", 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.782 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.776411+0000", 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.776412+0000", 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.066e-06 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.776417+0000", 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.057e-06 2024-09-20T21:02:39.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.776429+0000", 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2072000000000001e-05 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.776437+0000", 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6020000000000002e-06 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777268+0000", 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00083153700000000003 2024-09-20T21:02:39.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777369+0000", 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000101257 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777624+0000", 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025429499999999998 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:161332 5.d 5:bf0629ee:::benchmark_data_smithi112_23632_object29228:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:39.777247+0000", 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0030684050000000002, 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0031566440000000001, 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 161332 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:39.786 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777247+0000", 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777247+0000", 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777248+0000", 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3399999999999998e-07 2024-09-20T21:02:39.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777251+0000", 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777261+0000", 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6690000000000001e-06 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777268+0000", 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6470000000000001e-06 2024-09-20T21:02:39.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777324+0000", 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.643e-05 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777453+0000", 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012884499999999999 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.789 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:161333 5.0 5:0c01a5a1:::benchmark_data_smithi112_23632_object29229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:39.777287+0000", 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0030280319999999999, 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0031571350000000001, 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 161333 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.790 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:39.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777287+0000", 2024-09-20T21:02:39.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:39.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777287+0000", 2024-09-20T21:02:39.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:39.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777288+0000", 2024-09-20T21:02:39.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2300000000000001e-07 2024-09-20T21:02:39.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777291+0000", 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.9569999999999998e-06 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777298+0000", 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6520000000000006e-06 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777305+0000", 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0870000000000003e-06 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777435+0000", 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013069000000000001 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777560+0000", 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012480600000000001 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777676+0000", 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000115977 2024-09-20T21:02:39.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780321+0000", 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026453119999999999 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:161335 5.b 5:dd47b449:::benchmark_data_smithi112_23632_object29231:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:39.777313+0000", 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0030022180000000001, 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0031821029999999999, 2024-09-20T21:02:39.795 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 161335 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777313+0000", 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777313+0000", 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777313+0000", 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2800000000000002e-07 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777316+0000", 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5849999999999998e-06 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777324+0000", 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2230000000000007e-06 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777329+0000", 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1159999999999998e-06 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777377+0000", 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7305999999999997e-05 2024-09-20T21:02:39.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777495+0000", 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000117961 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777593+0000", 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8759999999999996e-05 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780284+0000", 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026910129999999999 2024-09-20T21:02:39.799 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:161336 5.d 5:bd11bfc1:::benchmark_data_smithi112_23632_object29232:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:39.777340+0000", 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0029750950000000001, 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0032431040000000001, 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:39.800 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 161336 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777340+0000", 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:39.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777340+0000", 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777341+0000", 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0800000000000004e-07 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777343+0000", 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4660000000000002e-06 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777350+0000", 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7190000000000004e-06 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777355+0000", 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8679999999999998e-06 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.779685+0000", 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023305909999999999 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.779830+0000", 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014503199999999999 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:161339 5.e 5:70a68554:::benchmark_data_smithi112_23632_object29235:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:39.777708+0000", 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0026072819999999998, 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029499420000000001, 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 161339 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777708+0000", 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:39.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777708+0000", 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777709+0000", 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9299999999999996e-07 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777714+0000", 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0089999999999998e-06 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.806 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777725+0000", 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0781999999999999e-05 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.777733+0000", 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9149999999999996e-06 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.779566+0000", 2024-09-20T21:02:39.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018333170000000001 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.779682+0000", 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000115812 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.779788+0000", 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106147 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:39.808 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.809 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:161343 5.0 5:0731147a:::benchmark_data_smithi112_23632_object29239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.809 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:39.780475+0000", 2024-09-20T21:02:39.809 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9998403, 2024-09-20T21:02:39.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026452499999999999, 2024-09-20T21:02:39.809 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:39.809 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:39.809 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:39.809 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 161343 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780475+0000", 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:39.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780475+0000", 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780476+0000", 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.218e-06 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780481+0000", 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.101e-06 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780493+0000", 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.207e-05 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780500+0000", 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6880000000000002e-06 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780553+0000", 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3550000000000001e-05 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780675+0000", 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012136199999999999 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:161345 5.9 5:92d4e2a2:::benchmark_data_smithi112_23632_object29241:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:39.780531+0000", 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9997845, 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00028497700000000001, 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:39.813 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 161345 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780531+0000", 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:39.814 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780531+0000", 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780531+0000", 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5199999999999997e-07 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780534+0000", 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.067e-06 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780546+0000", 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2174999999999999e-05 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780552+0000", 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4700000000000001e-06 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780605+0000", 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2737e-05 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780723+0000", 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118764 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:161346 5.f 5:f60eeb28:::benchmark_data_smithi112_23632_object29242:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:39.780663+0000", 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9996519, 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000224916, 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:39.817 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 161346 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780663+0000", 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780663+0000", 2024-09-20T21:02:39.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780664+0000", 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2500000000000005e-07 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780667+0000", 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.416e-06 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780676+0000", 2024-09-20T21:02:39.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8240000000000006e-06 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780682+0000", 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0850000000000002e-06 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780732+0000", 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9338000000000001e-05 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:39.820 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780843+0000", 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011168899999999999 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:161347 5.0 5.1a956860 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:39.780704+0000", 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9996109, 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025613799999999999, 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:39.821 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 161347 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780704+0000", 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780704+0000", 2024-09-20T21:02:39.822 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780705+0000", 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7700000000000004e-07 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780707+0000", 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.3889999999999999e-06 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780714+0000", 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2089999999999999e-06 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:39.780719+0000", 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6829999999999999e-06 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 10 2024-09-20T21:02:39.824 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:39.825 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:39.827 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:39.820+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:39.927 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:39.925+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:40.014 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:40.014 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:40.014 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:40.014 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:40.015 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:40.028 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:40.025+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:40.034 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:40.038 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-20T21:02:40.128 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:40.125+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:40.229 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:40.229 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:40.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.029497047000007, 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:40.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:40.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.029407011000004, 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:40.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:40.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:40.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:40.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:40.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:40.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:40.242 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.029320658000003, 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:40.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:40.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:40.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.029251849000005, 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.249 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.029218989, 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.255 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:40.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:40.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:40.261 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.029176972000002, 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:40.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.264 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:40.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:40.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:40.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:40.267 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.267 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.029051866000003, 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.270 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.028959517000004, 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:40.274 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:40.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.278 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.028875145000001, 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:40.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 49.263415688999999, 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 49.262863682999999, 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:40.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:40.295 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 49.262236102000003, 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:40.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:40.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 49.262125093000002, 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.301 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.306 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 49.258458580999999, 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.307 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:40.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:40.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:40.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:40.313 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 49.258144246999997, 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:40.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:40.319 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 49.257962128999999, 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:40.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:40.325 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.512502206000001, 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:40.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.508151281, 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.499909209999998, 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:127649 5.b 5:df1d496f:::benchmark_data_smithi112_23632_object127648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.057974273999999, 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023813432999999998, 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 127649 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167595+0000", 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167688+0000", 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2756000000000004e-05 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167703+0000", 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5048999999999999e-05 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167710+0000", 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0099999999999998e-06 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167758+0000", 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8479000000000001e-05 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167873+0000", 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114753 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167985+0000", 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011221 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.171532+0000", 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035466080000000001 2024-09-20T21:02:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191348+0000", 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019815856 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191382+0000", 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4156999999999998e-05 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191408+0000", 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5788000000000001e-05 2024-09-20T21:02:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:40.349 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:40.349 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:40.225+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:40.350 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:40.351 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:40.344+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:40.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:40.454 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:40.448+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:40.502 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:40.502 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:40.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:163153 5.4 5:2d9314a5:::benchmark_data_smithi112_23632_object31049:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:40.490478+0000", 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.010920535, 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010937458000000001, 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 163153 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.503 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.490478+0000", 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.490478+0000", 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.490478+0000", 2024-09-20T21:02:40.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8800000000000003e-07 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.490480+0000", 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.322e-06 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.490486+0000", 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.395e-06 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.490490+0000", 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8260000000000003e-06 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.495472+0000", 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049821070000000004 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.495599+0000", 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012702199999999999 2024-09-20T21:02:40.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.495724+0000", 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012497300000000001 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499305+0000", 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035807809999999999 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:163162 5.8 5:132c78d6:::benchmark_data_smithi112_23632_object31058:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:40.493213+0000", 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0081852520000000005, 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082524590000000002, 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 163162 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.493213+0000", 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.493213+0000", 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.493213+0000", 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4900000000000001e-07 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.493216+0000", 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2560000000000001e-06 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.493222+0000", 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1829999999999999e-06 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.493226+0000", 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6e-06 2024-09-20T21:02:40.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.494669+0000", 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014426630000000001 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.494795+0000", 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012573700000000001 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:40.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.494908+0000", 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011328399999999999 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500551+0000", 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056430680000000002 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:163167 5.a 5:577ddac6:::benchmark_data_smithi112_23632_object31063:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:40.496077+0000", 2024-09-20T21:02:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0053216340000000004, 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054513060000000004, 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 163167 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496077+0000", 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496077+0000", 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496077+0000", 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4e-07 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496081+0000", 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8940000000000003e-06 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496091+0000", 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5449999999999992e-06 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496097+0000", 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4439999999999996e-06 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:40.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496149+0000", 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1873000000000003e-05 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496285+0000", 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013531200000000001 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496401+0000", 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116267 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499230+0000", 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028288480000000001 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:163166 5.0 e55/21 5:04882a4c:::benchmark_data_smithi112_23632_object31062:head v 55'10140, mlcod=55'10137)", 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:40.496523+0000", 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0048752190000000001, 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0050871379999999997, 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496523+0000", 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496523+0000", 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:40.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496523+0000", 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9800000000000004e-07 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496528+0000", 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7160000000000002e-06 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496537+0000", 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496548+0000", 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0465999999999999e-05 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496633+0000", 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399e-05 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.496650+0000", 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6514000000000001e-05 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:40.520 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:163172 5.4 5:256b3a62:::benchmark_data_smithi112_23632_object31068:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:40.497750+0000", 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003648334, 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039190079999999999, 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.521 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 163172 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497750+0000", 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497750+0000", 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497751+0000", 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.37e-07 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497754+0000", 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.27e-06 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497762+0000", 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8790000000000003e-06 2024-09-20T21:02:40.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497766+0000", 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5809999999999998e-06 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497807+0000", 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0558e-05 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:40.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497901+0000", 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4199999999999999e-05 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497959+0000", 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8177000000000002e-05 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499472+0000", 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015128520000000001 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:163173 5.8 5:19e04588:::benchmark_data_smithi112_23632_object31069:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:40.497806+0000", 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0035925459999999998, 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039445670000000004, 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 163173 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.526 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497806+0000", 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497806+0000", 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497806+0000", 2024-09-20T21:02:40.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497809+0000", 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7700000000000002e-06 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497820+0000", 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0614e-05 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.497825+0000", 2024-09-20T21:02:40.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.818e-06 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.498551+0000", 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000725864 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.498698+0000", 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000146651 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:40.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.498821+0000", 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012318499999999999 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:163171 5.0 e55/21 5:08cd6280:::benchmark_data_smithi112_23632_object31067:head v 55'10141, mlcod=55'10137)", 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:40.498528+0000", 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0028702240000000002, 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003273644, 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:40.530 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.498528+0000", 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.498528+0000", 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.498528+0000", 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.67e-07 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.498531+0000", 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.694e-06 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.498537+0000", 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4169999999999997e-06 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.498541+0000", 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6990000000000001e-06 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500468+0000", 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00192684 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500483+0000", 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5421999999999999e-05 2024-09-20T21:02:40.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:163176 5.c 5:3b73f103:::benchmark_data_smithi112_23632_object31072:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:40.499419+0000", 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0019793609999999998, 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0024378500000000001, 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:40.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 163176 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499419+0000", 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499419+0000", 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499419+0000", 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5599999999999995e-07 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499422+0000", 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5339999999999998e-06 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499429+0000", 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0820000000000001e-06 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499434+0000", 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9679999999999997e-06 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499477+0000", 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3087999999999998e-05 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.499586+0000", 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010932 2024-09-20T21:02:40.537 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.538 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:40.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.538 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:163178 5.4 5:22ec6568:::benchmark_data_smithi112_23632_object31074:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:40.538 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:40.500632+0000", 2024-09-20T21:02:40.538 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00076592399999999997, 2024-09-20T21:02:40.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001292688, 2024-09-20T21:02:40.538 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:40.539 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:40.539 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:40.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:40.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:40.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:40.539 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 163178 2024-09-20T21:02:40.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.539 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:40.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500632+0000", 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500632+0000", 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:40.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500633+0000", 2024-09-20T21:02:40.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:02:40.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:40.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500638+0000", 2024-09-20T21:02:40.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7530000000000001e-06 2024-09-20T21:02:40.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500647+0000", 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.448e-06 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500652+0000", 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8899999999999998e-06 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:40.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500711+0000", 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8866999999999997e-05 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500819+0000", 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108004 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500917+0000", 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8306000000000004e-05 2024-09-20T21:02:40.543 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:163153 5.4 e55/38)", 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:40.500962+0000", 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00043624700000000001, 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010298740000000001, 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500962+0000", 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500962+0000", 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500963+0000", 2024-09-20T21:02:40.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5600000000000005e-07 2024-09-20T21:02:40.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:40.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500970+0000", 2024-09-20T21:02:40.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5089999999999996e-06 2024-09-20T21:02:40.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:40.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500978+0000", 2024-09-20T21:02:40.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3969999999999994e-06 2024-09-20T21:02:40.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:40.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:40.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:40.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:40.500984+0000", 2024-09-20T21:02:40.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:40.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.547 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:40.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:40.548 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:40.548 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 10 2024-09-20T21:02:40.548 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:40.548 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:40.549 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:40.549 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:40.550 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:40.551 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:40.551 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:40.552 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:40.552 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:40.592 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:40.588+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:40.654 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:40.648+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:40.745 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:40.745 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:40.755 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:40.748+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:40.765 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:40.855 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:40.848+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:40.956 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:40.952+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:40.960 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:40.960 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:40.978 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:41.057 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:41.053+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:41.130 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:41.131 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:41.151 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:41.158 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:41.152+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:41.258 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:41.257+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:41.345 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:41.345 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:41.360 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:41.357+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:41.366 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:41.461 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:41.456+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:41.562 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:41.556+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:41.566 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:41.566 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:41.587 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:41.663 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:41.656+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:41.723 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:41.723 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:41.735 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:41.778 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:41.772+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:41.864 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:41.861+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:41.932 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:41.932 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:41.950 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:42.000 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:41.996+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:42.062 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:02:42.065 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:42.061+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:42.098 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:42.099 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:42.116 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-09-20T21:02:42.116 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:02:42.116 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-20T21:02:42.116 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T21:02:42.116 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T21:02:42.116 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-20T21:02:42.118 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:42.166 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:42.160+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:42.267 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:42.260+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:42.267 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:42.267 INFO:teuthology.orchestra.run.smithi203.stdout: "success": "" 2024-09-20T21:02:42.267 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:42.274 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:42.274 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:42.297 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:42.368 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:42.360+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:42.468 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:42.465+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:42.486 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:42.486 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:42.505 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:42.552 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:42.590 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:42.589+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:42.670 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:42.664+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:42.696 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:42.696 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:42.715 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:42.715 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:42.715 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:42.718 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:42.733 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:42.733 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:42.736 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:42.737 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:42.771 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:42.764+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:42.868 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:169098 5.5 5:ae16e802:::benchmark_data_smithi112_23632_object36994:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:42.863456+0000", 2024-09-20T21:02:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003728229, 2024-09-20T21:02:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037506810000000001, 2024-09-20T21:02:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 169098 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863456+0000", 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863456+0000", 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863456+0000", 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3799999999999996e-07 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863463+0000", 2024-09-20T21:02:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2190000000000001e-06 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863472+0000", 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7480000000000005e-06 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863479+0000", 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7510000000000002e-06 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863535+0000", 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6144000000000003e-05 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863646+0000", 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111094 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:169102 5.5 5:a3a82068:::benchmark_data_smithi112_23632_object36998:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:42.865335+0000", 2024-09-20T21:02:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001849432, 2024-09-20T21:02:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001943132, 2024-09-20T21:02:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 169102 2024-09-20T21:02:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865335+0000", 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865335+0000", 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865335+0000", 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865339+0000", 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.427e-06 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865346+0000", 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1069999999999999e-06 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865350+0000", 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5859999999999998e-06 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865406+0000", 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5408000000000002e-05 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865477+0000", 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1594000000000006e-05 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:169104 5.7 5:efae19fd:::benchmark_data_smithi112_23632_object37000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:42.866892+0000", 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00029176400000000002, 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00044763000000000002, 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 169104 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.866892+0000", 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.866892+0000", 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.866893+0000", 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5899999999999995e-07 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.866897+0000", 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9260000000000002e-06 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.866909+0000", 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1603000000000001e-05 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.866914+0000", 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2809999999999999e-06 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.866957+0000", 2024-09-20T21:02:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3538999999999998e-05 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.867027+0000", 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9234999999999997e-05 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:169106 5.7 5.25eb8077 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:42.867095+0000", 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.9220000000000003e-05, 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030408799999999999, 2024-09-20T21:02:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 169106 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.867095+0000", 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.867095+0000", 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.867095+0000", 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6400000000000002e-07 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.867098+0000", 2024-09-20T21:02:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1719999999999999e-06 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.867107+0000", 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9269999999999994e-06 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.867113+0000", 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0689999999999998e-06 2024-09-20T21:02:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:169090 5.6 5:64d8a994:::benchmark_data_smithi112_23632_object36986:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:42.860999+0000", 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0061848570000000002, 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064527350000000002, 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:42.885 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 169090 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.860999+0000", 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.860999+0000", 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861000+0000", 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000002e-07 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861004+0000", 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0430000000000001e-06 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861015+0000", 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0681e-05 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861021+0000", 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7290000000000003e-06 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.862777+0000", 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001755199 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.862891+0000", 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114517 2024-09-20T21:02:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:169092 5.4 5:2ae29a61:::benchmark_data_smithi112_23632_object36988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:42.861096+0000", 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0060875490000000003, 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064155510000000002, 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 169092 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861096+0000", 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861096+0000", 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861097+0000", 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3000000000000002e-07 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861098+0000", 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.694e-06 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861104+0000", 2024-09-20T21:02:42.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7309999999999998e-06 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861107+0000", 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.943e-06 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863248+0000", 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002140987 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:42.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863324+0000", 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5767999999999997e-05 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.863384+0000", 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0077000000000001e-05 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.866823+0000", 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034389210000000002 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:169094 5.4 5:268de55e:::benchmark_data_smithi112_23632_object36990:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:42.861176+0000", 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.006008032, 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064072840000000001, 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 169094 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.894 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861176+0000", 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861176+0000", 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861177+0000", 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.75e-07 2024-09-20T21:02:42.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861183+0000", 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8900000000000004e-06 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861191+0000", 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8799999999999997e-06 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861197+0000", 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.823e-06 2024-09-20T21:02:42.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865058+0000", 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038609019999999998 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865195+0000", 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013679799999999999 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.865336+0000", 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014117200000000001 2024-09-20T21:02:42.897 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:169096 5.6 5:61cb0601:::benchmark_data_smithi112_23632_object36992:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:42.861611+0000", 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0055726899999999999, 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006039076, 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:42.898 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 169096 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861611+0000", 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861611+0000", 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861612+0000", 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4499999999999996e-07 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861616+0000", 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7809999999999999e-06 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861632+0000", 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5588999999999999e-05 2024-09-20T21:02:42.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.861638+0000", 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8199999999999999e-06 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.864316+0000", 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026774730000000001 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:42.864397+0000", 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1657999999999996e-05 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.901 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:42.902 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.902 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:42.902 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:42.902 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 8 2024-09-20T21:02:42.902 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:42.903 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:42.903 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:42.896+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:43.004 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:43.000+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:43.059 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:02:43.097 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:43.097 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:43.097 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:43.097 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:43.097 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:43.105 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:43.101+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:43.116 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:43.206 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:43.205+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:43.307 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:43.300+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:43.312 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:43.312 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 91.116477896999996, 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:43.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 91.116343697999994, 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:43.319 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:43.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:43.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:43.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 91.116238691999996, 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.325 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 91.116119166999994, 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:43.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 91.116049160000003, 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 91.115974108000003, 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:43.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:43.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 91.115887082, 2024-09-20T21:02:43.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:43.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 91.115818309000005, 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:43.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:43.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:43.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.598071646000001, 2024-09-20T21:02:43.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:43.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.363 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.595236003, 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:43.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.594786198000001, 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.369 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:43.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:43.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:43.375 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.594683032999999, 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:43.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:43.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.594595046999999, 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.381 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:43.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:43.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.386 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.593782543, 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:43.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:43.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:43.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.592013984000001, 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.391 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:43.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.591549465, 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:43.397 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:43.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:43.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.591353594000001, 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:43.403 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:43.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.408 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.590871731, 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.409 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:43.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:43.414 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.588723671, 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:43.415 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:43.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:43.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:43.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.585592386999998, 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:43.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:43.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:43.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:43.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:43.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:43.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:43.425 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.425 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.425 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.425 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:43.425 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:43.425 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:43.427 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:43.427 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:43.420+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:43.527 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:43.524+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:43.578 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:43.578 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:43.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.578 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:170836 5.e 5:709da722:::benchmark_data_smithi112_23632_object38732:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:43.578 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:43.572140+0000", 2024-09-20T21:02:43.578 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0058743379999999998, 2024-09-20T21:02:43.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0058933809999999996, 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 170836 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.572140+0000", 2024-09-20T21:02:43.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.572140+0000", 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.572140+0000", 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4300000000000002e-07 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.580 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.572144+0000", 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4630000000000001e-06 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.572153+0000", 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0229999999999998e-06 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.572158+0000", 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7550000000000002e-06 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.572212+0000", 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4524000000000002e-05 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.572347+0000", 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013452900000000001 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.572466+0000", 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011978500000000001 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.576837+0000", 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0043707199999999998 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:170842 5.e 5:77bcdd22:::benchmark_data_smithi112_23632_object38738:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:43.573861+0000", 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0041530220000000001, 2024-09-20T21:02:43.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004222918, 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 170842 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.573861+0000", 2024-09-20T21:02:43.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.573861+0000", 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.573862+0000", 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.23e-07 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.573866+0000", 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1180000000000002e-06 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.573873+0000", 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4880000000000001e-06 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.573878+0000", 2024-09-20T21:02:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9060000000000001e-06 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.574678+0000", 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00079957300000000004 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.574844+0000", 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016628199999999999 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.574977+0000", 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013309699999999999 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577075+0000", 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020975109999999998 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:170852 5.e 5:7db89999:::benchmark_data_smithi112_23632_object38748:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:43.588 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:43.577328+0000", 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00068594200000000004, 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00080057200000000005, 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 170852 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:43.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577328+0000", 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577328+0000", 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577329+0000", 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.048e-06 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577334+0000", 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3460000000000001e-06 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577349+0000", 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4511999999999999e-05 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577360+0000", 2024-09-20T21:02:43.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1521e-05 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577409+0000", 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8748999999999997e-05 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577496+0000", 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6873000000000007e-05 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577562+0000", 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6360999999999997e-05 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:170855 5.9 5:98ab8bb2:::benchmark_data_smithi112_23632_object38751:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:43.577612+0000", 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00040198099999999999, 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00055586700000000004, 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 170855 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577612+0000", 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577612+0000", 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577613+0000", 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6000000000000003e-07 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577617+0000", 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1420000000000003e-06 2024-09-20T21:02:43.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577628+0000", 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0922e-05 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577635+0000", 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9580000000000001e-06 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577677+0000", 2024-09-20T21:02:43.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2583000000000002e-05 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577802+0000", 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000125003 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:170856 5.f 5:ff5be892:::benchmark_data_smithi112_23632_object38752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:43.577662+0000", 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00035164199999999999, 2024-09-20T21:02:43.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00053994000000000004, 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 170856 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.598 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577662+0000", 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577662+0000", 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577663+0000", 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6300000000000005e-07 2024-09-20T21:02:43.599 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577670+0000", 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6769999999999998e-06 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577679+0000", 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0149999999999992e-06 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.600 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577687+0000", 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9049999999999997e-06 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577752+0000", 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5611000000000006e-05 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577884+0000", 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013179899999999999 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.601 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:170850 5.4 e56/38 5:2f5c2c3e:::benchmark_data_smithi112_23632_object38746:head v 56'10781, mlcod=56'10778)", 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:43.577739+0000", 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00027495200000000002, 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00049869400000000005, 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577739+0000", 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577739+0000", 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577740+0000", 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.82e-07 2024-09-20T21:02:43.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577745+0000", 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8220000000000003e-06 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577754+0000", 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9910000000000008e-06 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577762+0000", 2024-09-20T21:02:43.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2200000000000003e-06 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577823+0000", 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1711000000000006e-05 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:43.577841+0000", 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7359000000000001e-05 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.605 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:43.606 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:43.606 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 6 2024-09-20T21:02:43.606 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:43.607 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:43.650 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:43.648+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:43.728 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:43.724+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:43.794 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:43.794 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:43.794 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:43.795 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:43.795 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:43.814 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:43.830 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:43.824+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:43.930 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:43.928+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:44.009 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:44.009 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:44.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:44.009 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:44.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.009 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.010 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:44.010 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.810983047999997, 2024-09-20T21:02:44.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:44.010 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.010 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.010 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.010 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:44.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:44.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:44.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:44.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:44.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:44.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:44.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:44.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:44.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:44.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:44.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:44.016 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:44.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:44.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:44.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:44.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:44.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:44.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:44.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:44.019 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.019 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.019 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.020 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.020 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:44.020 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.810893011999994, 2024-09-20T21:02:44.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:44.021 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.021 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.021 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.021 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:44.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:44.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:44.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:44.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:44.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:44.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:44.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:44.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:44.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:44.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:44.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:44.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:44.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:44.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:44.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:44.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:44.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:44.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:44.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:44.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:44.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:44.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:44.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:44.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:44.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:44.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:44.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:44.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:44.033 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.033 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.033 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.034 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.034 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:44.034 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.810806658999994, 2024-09-20T21:02:44.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:44.034 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.034 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.035 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.035 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:44.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:44.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:44.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:44.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:44.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.810737849999995, 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.042 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:44.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:44.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:44.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:44.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:44.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:44.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:44.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:44.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:44.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.050 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.050 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:44.050 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.810704990000005, 2024-09-20T21:02:44.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:44.050 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.050 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.051 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.051 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:44.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:44.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.053 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:44.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:44.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.054 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:44.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:44.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:44.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:44.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:44.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:44.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:44.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:44.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:44.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:44.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:44.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:44.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:44.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:44.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:44.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:44.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:44.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:44.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:44.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.061 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.061 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:44.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:44.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:44.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:44.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:44.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:44.063 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.063 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.063 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.064 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.064 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:44.064 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.810662973000007, 2024-09-20T21:02:44.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:44.064 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.064 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.064 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.065 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.066 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:44.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:44.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:44.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:44.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:44.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:44.069 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:44.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.069 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.069 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:44.069 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:44.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.069 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.070 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.070 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:44.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:44.070 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.070 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.070 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.070 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:44.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:44.071 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.071 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.071 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.071 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:44.071 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:44.071 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.071 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.071 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.071 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:44.072 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:44.072 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.072 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.072 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.072 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.072 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.072 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.072 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:44.073 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.810537866999994, 2024-09-20T21:02:44.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:44.073 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.073 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.073 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.073 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.073 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.073 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.073 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:44.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.074 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.074 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.074 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.074 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:44.074 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.074 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.074 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.074 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.075 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:44.075 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:44.075 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.075 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.075 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.075 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:44.075 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:44.075 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.075 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.076 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.077 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:44.078 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:44.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.810445517999995, 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:44.080 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:44.083 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.810361146000005, 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.085 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:44.089 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 53.044901690000003, 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.090 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:44.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:44.094 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:44.095 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 53.044349683999997, 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:44.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 53.043722103, 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:44.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:44.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:44.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.106 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.107 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 53.043611093999999, 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:44.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:44.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.113 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 53.039944581999997, 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:44.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:44.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:44.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:44.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 53.039630248000002, 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:44.120 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:44.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 53.039448129999997, 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:44.126 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 32.293988206999998, 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.132 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:44.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 32.289637282000001, 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.138 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:44.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:44.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 32.281395211000003, 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.144 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:44.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:44.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:127649 5.b 5:df1d496f:::benchmark_data_smithi112_23632_object127648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 18.839460275, 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023813432999999998, 2024-09-20T21:02:44.150 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 127649 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167595+0000", 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167688+0000", 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2756000000000004e-05 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167703+0000", 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5048999999999999e-05 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167710+0000", 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0099999999999998e-06 2024-09-20T21:02:44.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167758+0000", 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8479000000000001e-05 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167873+0000", 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114753 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167985+0000", 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011221 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.171532+0000", 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035466080000000001 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191348+0000", 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019815856 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191382+0000", 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4156999999999998e-05 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191408+0000", 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5788000000000001e-05 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.156 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.157 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.157 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:44.158 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:44.152+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:44.159 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:44.259 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:44.256+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:44.311 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:44.311 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:44.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.311 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:172736 5.0 e56/21 5:0be498a4:::benchmark_data_smithi112_23632_object40632:head v 56'10713, mlcod=56'10710)", 2024-09-20T21:02:44.311 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.307043+0000", 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0030269920000000001, 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030501489999999998, 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307043+0000", 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307043+0000", 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307044+0000", 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4900000000000004e-07 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307051+0000", 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0330000000000003e-06 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307067+0000", 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5913000000000002e-05 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307076+0000", 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307129+0000", 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3334000000000001e-05 2024-09-20T21:02:44.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307148+0000", 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9023000000000001e-05 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:172737 5.7 5:ea30f670:::benchmark_data_smithi112_23632_object40633:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.307526+0000", 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0025432739999999999, 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026299259999999999, 2024-09-20T21:02:44.315 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 172737 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307526+0000", 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307526+0000", 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307528+0000", 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.248e-06 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307532+0000", 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3610000000000003e-06 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307542+0000", 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0210000000000001e-05 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307549+0000", 2024-09-20T21:02:44.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.849e-06 2024-09-20T21:02:44.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307613+0000", 2024-09-20T21:02:44.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4234999999999997e-05 2024-09-20T21:02:44.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307735+0000", 2024-09-20T21:02:44.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000122063 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:172738 5.1 5:8a8caca1:::benchmark_data_smithi112_23632_object40634:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.307942+0000", 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0021277900000000001, 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022797770000000002, 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.320 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 172738 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307942+0000", 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307942+0000", 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307943+0000", 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3900000000000004e-07 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307947+0000", 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0709999999999996e-06 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307956+0000", 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2949999999999999e-06 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.307963+0000", 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.308015+0000", 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2416000000000001e-05 2024-09-20T21:02:44.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.308161+0000", 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014593900000000001 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:172739 5.8 5:1c59618e:::benchmark_data_smithi112_23632_object40635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.309298+0000", 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00077120599999999997, 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098531899999999991, 2024-09-20T21:02:44.324 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 172739 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309298+0000", 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309298+0000", 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309299+0000", 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2900000000000003e-07 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309303+0000", 2024-09-20T21:02:44.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0810000000000004e-06 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309311+0000", 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3209999999999999e-06 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309315+0000", 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7350000000000004e-06 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309365+0000", 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9391999999999997e-05 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309479+0000", 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113745 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309585+0000", 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106119 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.328 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:172744 5.3 5:ca46f73f:::benchmark_data_smithi112_23632_object40640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.309596+0000", 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00047394199999999998, 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00075565400000000003, 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.329 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 172744 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309596+0000", 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309596+0000", 2024-09-20T21:02:44.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309596+0000", 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7899999999999999e-07 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309599+0000", 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.418e-06 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309607+0000", 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8609999999999998e-06 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309610+0000", 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9670000000000003e-06 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309659+0000", 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8959999999999999e-05 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309767+0000", 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107462 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:172745 5.a 5:5bf8fcd9:::benchmark_data_smithi112_23632_object40641:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.309620+0000", 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00044932400000000002, 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00079292399999999997, 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.333 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 172745 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309620+0000", 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309620+0000", 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309621+0000", 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8200000000000001e-07 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309623+0000", 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1040000000000001e-06 2024-09-20T21:02:44.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309629+0000", 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9569999999999999e-06 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309634+0000", 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7469999999999996e-06 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309674+0000", 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0027999999999997e-05 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309750+0000", 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6092000000000003e-05 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309836+0000", 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6635e-05 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.337 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:172746 5.3 5.4c870463 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.309805+0000", 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00026516000000000002, 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000672285, 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.338 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 172746 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309805+0000", 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309805+0000", 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309805+0000", 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.75e-07 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309808+0000", 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.604e-06 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309813+0000", 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2700000000000004e-06 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309816+0000", 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1590000000000002e-06 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:172740 5.e e56/21 5:7d889f6e:::benchmark_data_smithi112_23632_object40636:head v 56'10759, mlcod=56'10757)", 2024-09-20T21:02:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.309813+0000", 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00025649700000000001, 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00071531299999999997, 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309813+0000", 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309813+0000", 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309814+0000", 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4899999999999995e-07 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309819+0000", 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.242e-06 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309829+0000", 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0164e-05 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309835+0000", 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999999e-06 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309874+0000", 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8822000000000002e-05 2024-09-20T21:02:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.309887+0000", 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:172731 5.0 e56/21 5:08ebd99d:::benchmark_data_smithi112_23632_object40627:head v 56'10712, mlcod=56'10710)", 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.304564+0000", 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0055059599999999998, 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00601886, 2024-09-20T21:02:44.345 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304564+0000", 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304564+0000", 2024-09-20T21:02:44.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304565+0000", 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6899999999999996e-07 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304571+0000", 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2559999999999999e-06 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304582+0000", 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1511999999999999e-05 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304590+0000", 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.311e-06 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304636+0000", 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6118999999999997e-05 2024-09-20T21:02:44.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304655+0000", 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8940000000000002e-05 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:172732 5.c 5:3b525735:::benchmark_data_smithi112_23632_object40628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.304964+0000", 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0051055659999999998, 2024-09-20T21:02:44.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056729609999999998, 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 172732 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304964+0000", 2024-09-20T21:02:44.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304964+0000", 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304965+0000", 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7499999999999999e-07 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304969+0000", 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1269999999999996e-06 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304981+0000", 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.154e-05 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.304987+0000", 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5520000000000001e-06 2024-09-20T21:02:44.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305051+0000", 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3425999999999999e-05 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305244+0000", 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019315000000000001 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:172733 5.7 5:ea98d27e:::benchmark_data_smithi112_23632_object40629:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.305438+0000", 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0046314449999999997, 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0052595100000000002, 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 172733 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305438+0000", 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305438+0000", 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305439+0000", 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5700000000000002e-07 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305442+0000", 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305453+0000", 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0325e-05 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305460+0000", 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0280000000000003e-06 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305508+0000", 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8075999999999998e-05 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305638+0000", 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013027899999999999 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.357 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:172734 5.a 5:5fbae091:::benchmark_data_smithi112_23632_object40630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:44.305477+0000", 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0045928920000000003, 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.005281493, 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 172734 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305477+0000", 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305477+0000", 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305477+0000", 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0900000000000002e-07 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305480+0000", 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3599999999999999e-06 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305486+0000", 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1700000000000002e-06 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305490+0000", 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4819999999999996e-06 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305537+0000", 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6294000000000001e-05 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305647+0000", 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110041 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:44.305744+0000", 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7350999999999997e-05 2024-09-20T21:02:44.361 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.362 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.362 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.362 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.362 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:44.362 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 12 2024-09-20T21:02:44.362 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:44.363 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:44.364 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:44.356+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:44.464 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:44.460+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:44.559 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:44.559 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:44.559 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:44.559 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:44.559 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:44.565 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:44.560+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:44.579 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:44.667 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:44.664+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:44.728 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:44.728 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:44.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.531198238000002, 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:44.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:44.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:44.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.531064039, 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:44.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:44.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.530959033000002, 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:44.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:44.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:44.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:44.747 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.530839508, 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:44.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.530769500999995, 2024-09-20T21:02:44.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:44.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:44.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:44.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.530694448999995, 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:44.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:44.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:44.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.530607423000006, 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:44.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:44.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.771 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.530538649999997, 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:44.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:44.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.012791987, 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:44.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:44.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.009956344000003, 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:44.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:44.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.009506539, 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.787 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:44.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.792 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.009403374000001, 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:44.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.009315387999997, 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.799 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:44.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:44.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:44.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:44.804 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.008502884000002, 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.808 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.006734324999996, 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.809 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:44.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.006269805999999, 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.815 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:44.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:44.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.820 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.006073935000003, 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.005592071999999, 2024-09-20T21:02:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.003444012000003, 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.000312727999997, 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:44.842 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:44.843 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:44.844 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:44.840+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:44.845 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:44.945 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:44.940+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:44.991 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:44.991 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:174474 5.0 5:0b828124:::benchmark_data_smithi112_23632_object42370:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.984992+0000", 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0057104570000000004, 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0057304089999999997, 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 174474 2024-09-20T21:02:44.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.984992+0000", 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.984992+0000", 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.984993+0000", 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.984998+0000", 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0529999999999997e-06 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.985006+0000", 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9289999999999998e-06 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.985011+0000", 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2050000000000001e-06 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.985053+0000", 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1177000000000002e-05 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.985128+0000", 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5024999999999994e-05 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.985199+0000", 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1208e-05 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:174479 5.0 5:04bb5cee:::benchmark_data_smithi112_23632_object42375:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.985978+0000", 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0047253039999999996, 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048295619999999999, 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:44.996 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 174479 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.985978+0000", 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.985978+0000", 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.985978+0000", 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3799999999999996e-07 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.985983+0000", 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.916e-06 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.985996+0000", 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2680000000000001e-05 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986004+0000", 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7789999999999996e-06 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986892+0000", 2024-09-20T21:02:44.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00088840800000000004 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.987055+0000", 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016293500000000001 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.987208+0000", 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015282699999999999 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.000 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:174480 5.e 5:769e0691:::benchmark_data_smithi112_23632_object42376:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.986068+0000", 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0046345179999999998, 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048190200000000002, 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:45.001 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 174480 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986068+0000", 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986068+0000", 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986069+0000", 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5899999999999996e-07 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986073+0000", 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0910000000000003e-06 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986084+0000", 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1207e-05 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986090+0000", 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0850000000000002e-06 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986132+0000", 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1842999999999999e-05 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986262+0000", 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012932199999999999 2024-09-20T21:02:45.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.986346+0000", 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4375000000000004e-05 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:174483 5.0 5:0b9d63bf:::benchmark_data_smithi112_23632_object42379:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.988351+0000", 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0023515189999999998, 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026184720000000002, 2024-09-20T21:02:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 174483 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988351+0000", 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988351+0000", 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988352+0000", 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2699999999999998e-07 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988357+0000", 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5950000000000001e-06 2024-09-20T21:02:45.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988372+0000", 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4939999999999999e-05 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988380+0000", 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3829999999999992e-06 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989028+0000", 2024-09-20T21:02:45.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00064823799999999998 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989169+0000", 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000140414 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989295+0000", 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000125683 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:174485 5.0 5:005e6711:::benchmark_data_smithi112_23632_object42381:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.988406+0000", 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0022971929999999999, 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026455939999999998, 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 174485 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.010 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988406+0000", 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988406+0000", 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988406+0000", 2024-09-20T21:02:45.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988410+0000", 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4819999999999999e-06 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988421+0000", 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1252e-05 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.988428+0000", 2024-09-20T21:02:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9179999999999997e-06 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990734+0000", 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023062669999999999 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990855+0000", 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000120263 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:45.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990965+0000", 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011006300000000001 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:174490 5.e 5:72b00002:::benchmark_data_smithi112_23632_object42386:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.989097+0000", 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001606257, 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020354850000000001, 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:45.014 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 174490 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989097+0000", 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989097+0000", 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989098+0000", 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0100000000000003e-07 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989102+0000", 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0659999999999997e-06 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989113+0000", 2024-09-20T21:02:45.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1445e-05 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989120+0000", 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1629999999999999e-06 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989173+0000", 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2601e-05 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989285+0000", 2024-09-20T21:02:45.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000112124 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989384+0000", 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9158000000000002e-05 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:174480 5.e e56/21)", 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.989820+0000", 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00088326599999999996, 2024-09-20T21:02:45.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013888209999999999, 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989820+0000", 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989820+0000", 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989820+0000", 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0999999999999997e-07 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989828+0000", 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.153e-06 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989839+0000", 2024-09-20T21:02:45.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1362999999999999e-05 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989845+0000", 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5069999999999997e-06 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:174474 5.0 e56/21)", 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.989864+0000", 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00083863899999999996, 2024-09-20T21:02:45.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0013985880000000001, 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989864+0000", 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989864+0000", 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989864+0000", 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8000000000000002e-07 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989867+0000", 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.3599999999999999e-06 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989874+0000", 2024-09-20T21:02:45.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4030000000000001e-06 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989879+0000", 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5689999999999998e-06 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:174479 5.0 e56/21)", 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.989885+0000", 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00081767199999999997, 2024-09-20T21:02:45.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0014220109999999999, 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989885+0000", 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989885+0000", 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989885+0000", 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5300000000000001e-07 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989887+0000", 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5409999999999999e-06 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989893+0000", 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4400000000000002e-06 2024-09-20T21:02:45.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989897+0000", 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7929999999999999e-06 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:174489 5.a e56/21 5:52ce8ec1:::benchmark_data_smithi112_23632_object42385:head v 56'10934, mlcod=56'10932)", 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.989902+0000", 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00080062700000000004, 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001442886, 2024-09-20T21:02:45.027 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989902+0000", 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989902+0000", 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989902+0000", 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9500000000000001e-07 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989907+0000", 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1570000000000002e-06 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989913+0000", 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7129999999999999e-06 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989917+0000", 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0230000000000003e-06 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989973+0000", 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6007000000000001e-05 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.989998+0000", 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4467000000000001e-05 2024-09-20T21:02:45.030 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:174492 5.9 5:93cf1e69:::benchmark_data_smithi112_23632_object42388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.990315+0000", 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000387625, 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001088674, 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:45.031 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 174492 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990315+0000", 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990315+0000", 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990316+0000", 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.032e-06 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990321+0000", 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0769999999999998e-06 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990336+0000", 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4538e-05 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990343+0000", 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4120000000000004e-06 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990402+0000", 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9187000000000001e-05 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990542+0000", 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013999699999999999 2024-09-20T21:02:45.034 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:174482 5.8 e56/38)", 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.990338+0000", 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00036530699999999999, 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00110114, 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990338+0000", 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990338+0000", 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990338+0000", 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1999999999999998e-07 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990344+0000", 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5799999999999999e-06 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990355+0000", 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0841e-05 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990361+0000", 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3450000000000002e-06 2024-09-20T21:02:45.037 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:174493 5.9 5.3aef0749 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.990808+0000", 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9998951, 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065686900000000003, 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:45.038 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 174493 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990808+0000", 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990808+0000", 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990809+0000", 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7199999999999997e-07 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990814+0000", 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6890000000000003e-06 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990823+0000", 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9959999999999999e-06 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990829+0000", 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6100000000000002e-06 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:174494 5.d 5:b8472ae4:::benchmark_data_smithi112_23632_object42390:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:44.990917+0000", 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9997854, 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00057804000000000004, 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:45.041 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 174494 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990917+0000", 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990917+0000", 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990918+0000", 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990921+0000", 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3529999999999999e-06 2024-09-20T21:02:45.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990930+0000", 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.276e-06 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990935+0000", 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8119999999999996e-06 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.990985+0000", 2024-09-20T21:02:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9243999999999998e-05 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:44.991097+0000", 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011263400000000001 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 14 2024-09-20T21:02:45.045 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:45.046 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:45.047 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:45.048 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:45.048 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:45.044+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:45.049 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:45.049 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:45.049 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:45.083 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:02:45.147 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:45.140+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:45.244 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:45.244 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:45.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-09-20T21:02:45.248 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:45.244+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:45.264 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:45.349 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:45.344+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:45.450 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:45.448+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:45.459 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:45.459 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:45.478 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:45.551 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:45.548+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:45.630 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:45.630 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:45.650 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:45.652 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:45.648+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:45.752 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:45.748+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:45.801 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:45.802 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:45.820 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:45.854 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:45.848+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:45.954 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:45.948+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:46.020 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:46.020 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:46.041 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:46.068 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:02:46.088 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:46.084+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:46.156 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:46.152+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:46.189 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:46.189 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:46.210 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:46.256 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:46.252+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:46.357 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:46.352+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:46.368 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:46.369 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:46.389 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:46.474 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:46.472+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:46.559 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:46.556+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:46.586 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:46.586 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:46.603 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:46.660 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:46.656+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:46.755 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:46.755 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:46.761 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:46.756+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:46.775 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:46.862 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:46.856+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:46.909 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:46.909 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:46.930 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:46.962 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:46.960+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:47.050 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:47.063 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:47.056+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:47.119 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:47.119 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:47.140 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:47.186 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:47.184+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:47.210 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:47.210 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:47.210 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:47.228 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:47.228 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:47.231 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:47.231 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:47.265 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:47.260+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:47.287 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-09-20T21:02:47.287 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:02:47.287 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-20T21:02:47.287 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.839324 2024-09-20T21:02:47.288 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.8393237715177372 2024-09-20T21:02:47.295 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:47.295 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:47.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.295 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:180210 5.f 5:f6e1931d:::benchmark_data_smithi112_23632_object48106:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:47.295 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.290827+0000", 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0034765640000000001, 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034935000000000001, 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 180210 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290827+0000", 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290827+0000", 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290829+0000", 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0580000000000001e-06 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290833+0000", 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9169999999999997e-06 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290847+0000", 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3414999999999999e-05 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290856+0000", 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0880000000000001e-06 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292892+0000", 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002036029 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293020+0000", 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012819599999999999 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:180211 5.8 e57/38 5:1370764d:::benchmark_data_smithi112_23632_object48107:head v 57'11295, mlcod=57'11292)", 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.291543+0000", 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0027610540000000002, 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0028391699999999998, 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291543+0000", 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291543+0000", 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291544+0000", 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3799999999999997e-07 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291549+0000", 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4020000000000001e-06 2024-09-20T21:02:47.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291557+0000", 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2260000000000005e-06 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291563+0000", 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5280000000000003e-06 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291783+0000", 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021996299999999999 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291812+0000", 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.9725000000000001e-05 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.303 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:180213 5.d 5:b887c78d:::benchmark_data_smithi112_23632_object48109:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.291747+0000", 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002557166, 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026697880000000002, 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 180213 2024-09-20T21:02:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291747+0000", 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291747+0000", 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291748+0000", 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.54e-07 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291752+0000", 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291761+0000", 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9530000000000005e-06 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291767+0000", 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.562e-06 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291830+0000", 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2976000000000001e-05 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291968+0000", 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013741099999999999 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294273+0000", 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023057440000000002 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294329+0000", 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5606999999999998e-05 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294417+0000", 2024-09-20T21:02:47.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8536999999999996e-05 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:180214 5.e 5:76257ea1:::benchmark_data_smithi112_23632_object48110:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.291847+0000", 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0024569679999999999, 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002616827, 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.309 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 180214 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291847+0000", 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291847+0000", 2024-09-20T21:02:47.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291848+0000", 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2799999999999995e-07 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291851+0000", 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2760000000000001e-06 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291859+0000", 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291865+0000", 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8819999999999998e-06 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292000+0000", 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000135186 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292114+0000", 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113965 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292213+0000", 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9265000000000006e-05 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:180201 5.0 e57/21)", 2024-09-20T21:02:47.313 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.292514+0000", 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001789863, 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019871960000000001, 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292514+0000", 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292514+0000", 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292515+0000", 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6599999999999996e-07 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292518+0000", 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4300000000000002e-06 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292529+0000", 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0815999999999999e-05 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292535+0000", 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2639999999999997e-06 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:180216 5.a e57/21 5:51ba2ac7:::benchmark_data_smithi112_23632_object48112:head v 57'11276, mlcod=57'11274)", 2024-09-20T21:02:47.316 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.292597+0000", 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001706543, 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001929444, 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292597+0000", 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292597+0000", 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292598+0000", 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.51e-07 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292602+0000", 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.352e-06 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292612+0000", 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292617+0000", 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2290000000000002e-06 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292677+0000", 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9898999999999997e-05 2024-09-20T21:02:47.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.292696+0000", 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8635e-05 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:180217 5.e 5.87aebbe (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.293300+0000", 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001003596, 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001256556, 2024-09-20T21:02:47.320 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 180217 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293300+0000", 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293300+0000", 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293301+0000", 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0279999999999999e-06 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293306+0000", 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5029999999999999e-06 2024-09-20T21:02:47.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293317+0000", 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1087000000000001e-05 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293324+0000", 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0040000000000002e-06 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:180218 5.f 5.454f301f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.293760+0000", 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00054404300000000002, 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00082461899999999996, 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 180218 2024-09-20T21:02:47.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293760+0000", 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293760+0000", 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293761+0000", 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5499999999999998e-07 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293764+0000", 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4539999999999999e-06 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293773+0000", 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7499999999999992e-06 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.293778+0000", 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9139999999999999e-06 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:180219 5.e 5.6de74a4e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.294028+0000", 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00027611500000000001, 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00058689799999999998, 2024-09-20T21:02:47.327 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 180219 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294028+0000", 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294028+0000", 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294028+0000", 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4799999999999998e-07 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294031+0000", 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7539999999999998e-06 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294039+0000", 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3610000000000003e-06 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294043+0000", 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1980000000000003e-06 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.331 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:180208 5.0 e57/21)", 2024-09-20T21:02:47.331 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.294551+0000", 2024-09-20T21:02:47.331 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9997525, 2024-09-20T21:02:47.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0685000000000003e-05, 2024-09-20T21:02:47.331 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.331 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.331 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:47.331 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294551+0000", 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294551+0000", 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294552+0000", 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.06e-07 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294556+0000", 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5640000000000001e-06 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294565+0000", 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9839999999999996e-06 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294574+0000", 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2689999999999999e-06 2024-09-20T21:02:47.333 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:180214 5.e e57/21)", 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.294585+0000", 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9997187, 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1187999999999996e-05, 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.334 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294585+0000", 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294585+0000", 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294585+0000", 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8000000000000002e-07 2024-09-20T21:02:47.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294587+0000", 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0810000000000001e-06 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294594+0000", 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9029999999999998e-06 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.294598+0000", 2024-09-20T21:02:47.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.031e-06 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:180197 5.e 5:71dc468e:::benchmark_data_smithi112_23632_object48093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.285453+0000", 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0088513910000000001, 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0092405030000000006, 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.337 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.338 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 180197 2024-09-20T21:02:47.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.338 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285453+0000", 2024-09-20T21:02:47.338 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285453+0000", 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285454+0000", 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9399999999999993e-07 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285458+0000", 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3850000000000004e-06 2024-09-20T21:02:47.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285470+0000", 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2014999999999999e-05 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285477+0000", 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1520000000000003e-06 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.288417+0000", 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029398549999999999 2024-09-20T21:02:47.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.288489+0000", 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2094000000000005e-05 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.288552+0000", 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3287000000000006e-05 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.291205+0000", 2024-09-20T21:02:47.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026528120000000001 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:180201 5.0 5:0a1c745f:::benchmark_data_smithi112_23632_object48097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.285596+0000", 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0087081490000000001, 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0091391890000000007, 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.342 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 180201 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285596+0000", 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285596+0000", 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285597+0000", 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3399999999999998e-07 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285600+0000", 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2629999999999999e-06 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285613+0000", 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3178e-05 2024-09-20T21:02:47.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285619+0000", 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1260000000000003e-06 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285666+0000", 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7120000000000003e-05 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285752+0000", 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5339000000000004e-05 2024-09-20T21:02:47.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.285856+0000", 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000104085 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:180205 5.8 e57/38 5:14f51913:::benchmark_data_smithi112_23632_object48101:head v 57'11294, mlcod=57'11292)", 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.289479+0000", 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0048246740000000001, 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0053217109999999998, 2024-09-20T21:02:47.346 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.289479+0000", 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.289479+0000", 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.289480+0000", 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4000000000000001e-07 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.289487+0000", 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.289e-06 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.289498+0000", 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0978999999999999e-05 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.289504+0000", 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1199999999999999e-06 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.289554+0000", 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9338000000000001e-05 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.289571+0000", 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7382999999999999e-05 2024-09-20T21:02:47.349 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:180208 5.0 5:0527ce82:::benchmark_data_smithi112_23632_object48104:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.290497+0000", 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0038070140000000001, 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0043383959999999996, 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.350 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 180208 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290497+0000", 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290497+0000", 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.351 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290498+0000", 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7899999999999998e-07 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290501+0000", 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2440000000000002e-06 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290510+0000", 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6149999999999997e-06 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.352 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.353 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.353 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290514+0000", 2024-09-20T21:02:47.353 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4610000000000001e-06 2024-09-20T21:02:47.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.353 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.353 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.353 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290580+0000", 2024-09-20T21:02:47.353 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6033999999999998e-05 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290681+0000", 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010054 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290772+0000", 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1508000000000005e-05 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:180209 5.f 5:fbd3708a:::benchmark_data_smithi112_23632_object48105:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:47.290591+0000", 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.003712866, 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0043080039999999998, 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 180209 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.355 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290591+0000", 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290591+0000", 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290592+0000", 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9599999999999999e-07 2024-09-20T21:02:47.356 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290594+0000", 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.255e-06 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290602+0000", 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9200000000000004e-06 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290605+0000", 2024-09-20T21:02:47.357 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.45e-06 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290652+0000", 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6322999999999997e-05 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:47.290737+0000", 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4887000000000002e-05 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.358 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:47.359 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 16 2024-09-20T21:02:47.359 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:47.360 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:47.366 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:47.360+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:47.467 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:47.464+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:47.545 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:47.545 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:47.545 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:47.545 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:47.545 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:47.565 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:47.610 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:47.608+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:47.668 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:47.664+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:47.767 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 95.569211007999996, 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:47.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.772 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:47.773 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 95.569120971999993, 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.774 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:47.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:47.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.777 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:47.778 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:47.779 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 95.569034619000007, 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.780 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.781 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.782 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:47.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:47.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.785 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 95.568965809999995, 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.786 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:47.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:47.790 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:47.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 95.568932950000004, 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:47.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:47.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 95.568890933000006, 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.799 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:47.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:47.801 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.801 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:47.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:47.801 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.801 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:47.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:47.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.805 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 95.568765826999993, 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.806 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:47.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:47.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:47.812 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 95.568673477999994, 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.815 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.816 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:47.817 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 95.568589106000005, 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:47.819 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.820 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.821 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 56.803129650000002, 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.822 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.823 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.824 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.826 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:47.827 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 56.802577644000003, 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.828 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.829 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:47.830 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.831 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.832 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.833 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 56.801950063, 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.834 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.835 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.836 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 56.801839053999998, 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.840 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:47.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:47.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 56.798172542000003, 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.846 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 56.797858208000001, 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.852 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:47.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.857 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 56.797676090000003, 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.858 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:47.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 36.052216166999997, 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.864 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:47.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:47.869 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 36.047865242, 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.870 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:47.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:47.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:47.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 36.039623171000002, 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:47.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:47.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:127649 5.b 5:df1d496f:::benchmark_data_smithi112_23632_object127648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:47.881 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.597688235, 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023813432999999998, 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 127649 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:47.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167595+0000", 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167688+0000", 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2756000000000004e-05 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167703+0000", 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5048999999999999e-05 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167710+0000", 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0099999999999998e-06 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167758+0000", 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8479000000000001e-05 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167873+0000", 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114753 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167985+0000", 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011221 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.171532+0000", 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035466080000000001 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191348+0000", 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019815856 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191382+0000", 2024-09-20T21:02:47.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4156999999999998e-05 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191408+0000", 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5788000000000001e-05 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:47.887 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:47.889 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:47.884+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:47.889 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:47.989 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:47.984+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:48.047 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:48.047 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:182128 5.c 5:32c09c11:::benchmark_data_smithi112_23632_object50024:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.040031+0000", 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0064609330000000003, 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064875419999999998, 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 182128 2024-09-20T21:02:48.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040031+0000", 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040031+0000", 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040032+0000", 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7599999999999996e-07 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040036+0000", 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1359999999999999e-06 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040055+0000", 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9514999999999999e-05 2024-09-20T21:02:48.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040063+0000", 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0879999999999997e-06 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040109+0000", 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6230999999999998e-05 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040251+0000", 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000142669 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:182129 5.b e57/21 5:db47073e:::benchmark_data_smithi112_23632_object50025:head v 57'11658, mlcod=57'11655)", 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.040393+0000", 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0060991120000000003, 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061986410000000004, 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.052 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040393+0000", 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040393+0000", 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040394+0000", 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.68e-07 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040399+0000", 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6509999999999998e-06 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040409+0000", 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0254999999999999e-05 2024-09-20T21:02:48.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.040416+0000", 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7460000000000003e-06 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.042121+0000", 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001704969 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.042139+0000", 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8134e-05 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:182130 5.4 5:2e343e92:::benchmark_data_smithi112_23632_object50026:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.041268+0000", 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0052239449999999998, 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053662520000000002, 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.056 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 182130 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041268+0000", 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041268+0000", 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041269+0000", 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8800000000000002e-07 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041272+0000", 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5599999999999998e-06 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041281+0000", 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7290000000000006e-06 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041286+0000", 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6709999999999998e-06 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044334+0000", 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003047864 2024-09-20T21:02:48.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044469+0000", 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013537999999999999 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044586+0000", 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117545 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:182133 5.2 5:4bc9d5e7:::benchmark_data_smithi112_23632_object50029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.041296+0000", 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0051955070000000003, 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053773570000000001, 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 182133 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.061 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041296+0000", 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041296+0000", 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041297+0000", 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2300000000000002e-07 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041299+0000", 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7379999999999999e-06 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041304+0000", 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9860000000000002e-06 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041307+0000", 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.732e-06 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041346+0000", 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8918999999999998e-05 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041471+0000", 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012484599999999999 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.064 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:182134 5.2 5:408e09d0:::benchmark_data_smithi112_23632_object50030:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.041317+0000", 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0051745510000000003, 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053917699999999997, 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.065 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 182134 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041317+0000", 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041317+0000", 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041318+0000", 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4700000000000002e-07 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041320+0000", 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4059999999999999e-06 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041327+0000", 2024-09-20T21:02:48.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3319999999999997e-06 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041332+0000", 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.011e-06 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044093+0000", 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027616810000000002 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044211+0000", 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118194 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:182135 5.3 5:c12d3168:::benchmark_data_smithi112_23632_object50031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.041432+0000", 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.005059956, 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.005325074, 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.069 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 182135 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041432+0000", 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041432+0000", 2024-09-20T21:02:48.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041433+0000", 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1699999999999997e-07 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041437+0000", 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0999999999999997e-06 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041446+0000", 2024-09-20T21:02:48.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1220000000000001e-06 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041452+0000", 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2049999999999999e-06 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.042281+0000", 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00082890999999999998 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.042382+0000", 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100454 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:182136 5.1 5:89f9a7a3:::benchmark_data_smithi112_23632_object50032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.041734+0000", 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0047581170000000001, 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0050932039999999996, 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.073 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 182136 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041734+0000", 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041734+0000", 2024-09-20T21:02:48.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041735+0000", 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1999999999999998e-07 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041739+0000", 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0010000000000003e-06 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041747+0000", 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1650000000000006e-06 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041754+0000", 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5749999999999997e-06 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041807+0000", 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3942e-05 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041880+0000", 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2898999999999994e-05 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:182137 5.1 5:821d4b6f:::benchmark_data_smithi112_23632_object50033:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.041952+0000", 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0045398770000000003, 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049488939999999997, 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.077 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 182137 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041952+0000", 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041952+0000", 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041953+0000", 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5799999999999998e-07 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041957+0000", 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1269999999999996e-06 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041973+0000", 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6232999999999999e-05 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.041989+0000", 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5597999999999999e-05 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.043888+0000", 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001899146 2024-09-20T21:02:48.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044017+0000", 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000128856 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:182141 5.2 5:4eeb5de9:::benchmark_data_smithi112_23632_object50037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.044685+0000", 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00180725, 2024-09-20T21:02:48.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022866039999999998, 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 182141 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044685+0000", 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044685+0000", 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044686+0000", 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0759999999999999e-06 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044690+0000", 2024-09-20T21:02:48.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9539999999999998e-06 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044697+0000", 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2559999999999996e-06 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044702+0000", 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4870000000000004e-06 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045854+0000", 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001152667 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045945+0000", 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0543000000000004e-05 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:182139 5.b e57/21 5:d1a4c1a1:::benchmark_data_smithi112_23632_object50035:head v 57'11659, mlcod=57'11656)", 2024-09-20T21:02:48.085 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.044985+0000", 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001507221, 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0020473430000000001, 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044985+0000", 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044985+0000", 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044985+0000", 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.044990+0000", 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3019999999999996e-06 2024-09-20T21:02:48.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045001+0000", 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1355000000000001e-05 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045007+0000", 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1129999999999997e-06 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045048+0000", 2024-09-20T21:02:48.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1235000000000001e-05 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045067+0000", 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:182142 5.1 5:8c72f2fc:::benchmark_data_smithi112_23632_object50038:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:48.045851+0000", 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00064106700000000005, 2024-09-20T21:02:48.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001213647, 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 182142 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045851+0000", 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045851+0000", 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045852+0000", 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.057e-06 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045857+0000", 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0730000000000004e-06 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045872+0000", 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5139e-05 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045881+0000", 2024-09-20T21:02:48.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4870000000000002e-06 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.045929+0000", 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8272999999999997e-05 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:48.046034+0000", 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010498 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.093 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:48.094 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 11 2024-09-20T21:02:48.094 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:48.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:02:48.095 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.1 primary-affinity to 0.839324 (8550052) 2024-09-20T21:02:48.096 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:48.096 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:48.088+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:48.196 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:48.192+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:48.292 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:48.292 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:48.292 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:48.292 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:48.292 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:48.296 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:48.292+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:48.311 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:48.400 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:48.396+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:48.498 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:48.496+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.317195718999997, 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040927826, 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194232+0000", 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194234+0000", 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3199999999999998e-06 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194244+0000", 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176999999999999e-05 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194272+0000", 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7773e-05 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194313+0000", 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0565999999999998e-05 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194452+0000", 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139615 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194463+0000", 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0447e-05 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209867+0000", 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015404683000000001 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210155+0000", 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028752500000000001 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215079+0000", 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049240550000000001 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222371+0000", 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072925500000000001 2024-09-20T21:02:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234941+0000", 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012569255999999999 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235066+0000", 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125513 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235160+0000", 2024-09-20T21:02:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3345999999999997e-05 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.317061519999996, 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.316956513999997, 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032723885000000001, 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194471+0000", 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194472+0000", 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.333e-06 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194508+0000", 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6273000000000003e-05 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194527+0000", 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8124000000000001e-05 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194550+0000", 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3691999999999999e-05 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194644+0000", 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3863000000000006e-05 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194656+0000", 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1970000000000001e-05 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.210059+0000", 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015403343999999999 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211040+0000", 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098056199999999993 2024-09-20T21:02:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211312+0000", 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000271484 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216961+0000", 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056492859999999999 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.226922+0000", 2024-09-20T21:02:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099614230000000005 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227075+0000", 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015253900000000001 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227195+0000", 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119992 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.316836988999995, 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.316766982000004, 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040978094999999999, 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194660+0000", 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194662+0000", 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.203e-06 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194670+0000", 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1030000000000002e-06 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194692+0000", 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2507e-05 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194707+0000", 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4365999999999999e-05 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012321899999999999 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194842+0000", 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2126999999999999e-05 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217521+0000", 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022678744000000001 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.217837+0000", 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031607299999999999 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.218150+0000", 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031301499999999998 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227210+0000", 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0090604259999999999 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235507+0000", 2024-09-20T21:02:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0082968399999999998 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235582+0000", 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5426000000000006e-05 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235639+0000", 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6045999999999998e-05 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.316691930000005, 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039642901000000001, 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194735+0000", 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194737+0000", 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.207e-06 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3129999999999999e-06 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194764+0000", 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9123999999999999e-05 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194783+0000", 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9245999999999998e-05 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194902+0000", 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011868599999999999 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5153e-05 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.208970+0000", 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014053194 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209318+0000", 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000347621 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.209782+0000", 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046384900000000001 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.219540+0000", 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097579639999999992 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234190+0000", 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014649954 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234278+0000", 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7776999999999997e-05 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234378+0000", 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100813 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.316604904000002, 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752874000000001, 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194822+0000", 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194824+0000", 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3969999999999999e-06 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194830+0000", 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-20T21:02:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194856+0000", 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6132999999999999e-05 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194870+0000", 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.418e-05 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195003+0000", 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132886 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195011+0000", 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4669999999999998e-06 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211304+0000", 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016293166000000001 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.211605+0000", 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030069800000000001 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.234575+0000", 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022970784000000001 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.316536131000007, 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040938686000000002, 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194891+0000", 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194893+0000", 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.28e-06 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194898+0000", 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6339999999999998e-06 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194917+0000", 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194952+0000", 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4776e-05 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195072+0000", 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119826 2024-09-20T21:02:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.195083+0000", 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0896e-05 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220443+0000", 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02536037 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.220753+0000", 2024-09-20T21:02:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031010100000000002 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235830+0000", 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015076977 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102559 5.b e41/21 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head v 41'6516, mlcod=41'6514)", 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.798789468000003, 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038269992000000003, 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712638+0000", 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712639+0000", 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.68e-07 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712735+0000", 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6730000000000004e-05 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712746+0000", 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0743e-05 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.712752+0000", 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9850000000000003e-06 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716344+0000", 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035925190000000002 2024-09-20T21:02:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716371+0000", 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6160999999999999e-05 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750744+0000", 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034373130000000002 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750908+0000", 2024-09-20T21:02:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016415599999999999 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102563 5.1 5:8d86ddc3:::benchmark_data_smithi112_23632_object102562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.795953824999998, 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034632872000000002, 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102563 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715474+0000", 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715475+0000", 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4419999999999999e-06 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715570+0000", 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4510000000000001e-05 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715583+0000", 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3499000000000001e-05 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715591+0000", 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0409999999999998e-06 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715651+0000", 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9562999999999999e-05 2024-09-20T21:02:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715773+0000", 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012201600000000001 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715854+0000", 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1364000000000002e-05 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720464+0000", 2024-09-20T21:02:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046103730000000001 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750001+0000", 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029536963999999999 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750052+0000", 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0628999999999999e-05 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750106+0000", 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4471000000000001e-05 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102565 5.c 5:39119242:::benchmark_data_smithi112_23632_object102564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.795504020000003, 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.03550242, 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102565 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715923+0000", 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715924+0000", 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.47e-07 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715976+0000", 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1309e-05 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.715992+0000", 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6605000000000001e-05 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716010+0000", 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7618999999999999e-05 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716075+0000", 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5493999999999993e-05 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716201+0000", 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716334+0000", 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000133485 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749921+0000", 2024-09-20T21:02:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033587016999999997 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751346+0000", 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014245670000000001 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751391+0000", 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5163000000000001e-05 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751426+0000", 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4598999999999999e-05 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102566 5.2 5:4b0a34c8:::benchmark_data_smithi112_23632_object102565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.795400854999997, 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035613547000000002, 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102566 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716027+0000", 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5499999999999998e-07 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716076+0000", 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8421999999999998e-05 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716085+0000", 2024-09-20T21:02:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6160000000000008e-06 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716093+0000", 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7510000000000008e-06 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716131+0000", 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8455999999999999e-05 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716233+0000", 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101722 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716360+0000", 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000127195 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750504+0000", 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034143698 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751569+0000", 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065077 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751611+0000", 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1607000000000003e-05 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751640+0000", 2024-09-20T21:02:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9448e-05 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102567 5.a 5:5d2e0d3d:::benchmark_data_smithi112_23632_object102566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.795312869, 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034483353000000001, 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102567 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716115+0000", 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716149+0000", 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4020000000000003e-05 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716157+0000", 2024-09-20T21:02:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.498e-06 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716163+0000", 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7429999999999996e-06 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716211+0000", 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7185000000000003e-05 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716321+0000", 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011009 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716441+0000", 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012020500000000001 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721764+0000", 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053232940000000001 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750511+0000", 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.028746710000000002 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750557+0000", 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5871000000000002e-05 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750598+0000", 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1171999999999998e-05 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102569 5.0 e41/21 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head v 41'6409, mlcod=41'6407)", 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.794500364999998, 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038176305000000001, 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716927+0000", 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716928+0000", 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716977+0000", 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9675000000000001e-05 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716989+0000", 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1664999999999999e-05 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.716996+0000", 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6259999999999997e-06 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717061+0000", 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5350000000000003e-05 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.717078+0000", 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.732e-05 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755066+0000", 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037987485000000001 2024-09-20T21:02:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755103+0000", 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7493999999999997e-05 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102570 5.2 5:462db6de:::benchmark_data_smithi112_23632_object102569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.792731805999999, 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033052558000000003, 2024-09-20T21:02:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102570 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718696+0000", 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4200000000000005e-07 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718721+0000", 2024-09-20T21:02:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4844000000000001e-05 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718727+0000", 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.891e-06 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718731+0000", 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7309999999999999e-06 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718771+0000", 2024-09-20T21:02:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0247999999999998e-05 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.718900+0000", 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012930799999999999 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719034+0000", 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013363200000000001 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750605+0000", 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031571006999999998 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751679+0000", 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001073467 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751720+0000", 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1292999999999999e-05 2024-09-20T21:02:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751748+0000", 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8294999999999999e-05 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102572 5.2 5:464fdda5:::benchmark_data_smithi112_23632_object102571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.792267287000001, 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033708140999999997, 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102572 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719160+0000", 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719161+0000", 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719317+0000", 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015575699999999999 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719330+0000", 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3361e-05 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719339+0000", 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5589999999999994e-06 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720897+0000", 2024-09-20T21:02:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001557257 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720969+0000", 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2163999999999996e-05 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721045+0000", 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5646e-05 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752521+0000", 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031476122000000002 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752786+0000", 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026507499999999998 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752836+0000", 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0699999999999999e-05 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752868+0000", 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1810999999999997e-05 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102573 5.c 5:374cf2d2:::benchmark_data_smithi112_23632_object102572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.792071415999999, 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032169929999999999, 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.609 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102573 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719356+0000", 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719357+0000", 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6499999999999998e-07 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719396+0000", 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9666000000000003e-05 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719405+0000", 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719412+0000", 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.421e-06 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719459+0000", 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6752000000000002e-05 2024-09-20T21:02:48.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719570+0000", 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111601 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719687+0000", 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011689 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750230+0000", 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.030542983999999999 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751457+0000", 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012273 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751496+0000", 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8788999999999997e-05 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.751526+0000", 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9785e-05 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102576 5.3 5:cd39bf5f:::benchmark_data_smithi112_23632_object102575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.791589553000001, 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032616041999999998, 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.615 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102576 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719838+0000", 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719839+0000", 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.023e-06 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719918+0000", 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9078000000000004e-05 2024-09-20T21:02:48.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719930+0000", 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2044e-05 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719938+0000", 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8199999999999997e-06 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.719974+0000", 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5722999999999997e-05 2024-09-20T21:02:48.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720054+0000", 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0296999999999994e-05 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.720134+0000", 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9872999999999999e-05 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752353+0000", 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032219594999999997 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752370+0000", 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7110000000000001e-05 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752411+0000", 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0521e-05 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.752454+0000", 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2957999999999998e-05 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:102578 5.8 5:19a68774:::benchmark_data_smithi112_23632_object102577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.789441492999998, 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.035057613000000001, 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.621 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 102578 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721986+0000", 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.721987+0000", 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2410000000000001e-06 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.722101+0000", 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113495 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749421+0000", 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027320727 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749447+0000", 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5454999999999999e-05 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749877+0000", 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043011999999999998 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750011+0000", 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013442599999999999 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750159+0000", 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014768 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.755101+0000", 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049415489999999999 2024-09-20T21:02:48.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756975+0000", 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001874283 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757004+0000", 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9377999999999999e-05 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.757044+0000", 2024-09-20T21:02:48.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9258999999999998e-05 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:102581 5.e e41/21 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head v 41'6416, mlcod=41'6414)", 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 36.786310209, 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.031666453999999997, 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:48.627 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725117+0000", 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725118+0000", 2024-09-20T21:02:48.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0299999999999998e-07 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.725175+0000", 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6703999999999998e-05 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749812+0000", 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024637486 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.749841+0000", 2024-09-20T21:02:48.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8789000000000002e-05 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750201+0000", 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035993199999999998 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.750220+0000", 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9468000000000001e-05 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:48.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756748+0000", 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065279750000000001 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:11.756784+0000", 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5397e-05 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:48.631 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:48.633 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:48.633 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:48.628+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:48.733 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:48.728+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:48.783 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:48.783 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:48.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.784 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:184019 5.e 5:7f977ebb:::benchmark_data_smithi112_23632_object51915:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-20T21:02:48.784 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:48.776578+0000", 2024-09-20T21:02:48.784 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0068917190000000001, 2024-09-20T21:02:48.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0069102440000000003, 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 184019 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:48.786 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.776578+0000", 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.776578+0000", 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.776578+0000", 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2799999999999996e-07 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.776581+0000", 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.281e-06 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.776588+0000", 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9809999999999997e-06 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.776596+0000", 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7749999999999993e-06 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.776639+0000", 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3155000000000003e-05 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.776726+0000", 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.776786+0000", 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9905000000000003e-05 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.789 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.780982+0000", 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0041959420000000002 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:184023 5.e 5:74f870b0:::benchmark_data_smithi112_23632_object51919:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:48.777704+0000", 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0057649240000000003, 2024-09-20T21:02:48.790 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0058357319999999997, 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 184023 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.777704+0000", 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.777704+0000", 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.777705+0000", 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8700000000000005e-07 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.777709+0000", 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6710000000000001e-06 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.777717+0000", 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3520000000000007e-06 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.777724+0000", 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2709999999999998e-06 2024-09-20T21:02:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.778678+0000", 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00095452299999999998 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.778792+0000", 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114456 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.778893+0000", 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000100584 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.782995+0000", 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0041020650000000002 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:184032 5.9 5:9ef0f41e:::benchmark_data_smithi112_23632_object51928:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:48.780594+0000", 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0028753709999999998, 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002988503, 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 184032 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:48.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.780594+0000", 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.780594+0000", 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.780595+0000", 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.119e-06 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.780600+0000", 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9069999999999998e-06 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.780619+0000", 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8790000000000001e-05 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.780627+0000", 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1980000000000001e-06 2024-09-20T21:02:48.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.782234+0000", 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001606889 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.782316+0000", 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2269999999999997e-05 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:184034 5.e 5:78ddfe82:::benchmark_data_smithi112_23632_object51930:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:48.781375+0000", 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002093967, 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022431700000000001, 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 184034 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.800 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.781375+0000", 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.781375+0000", 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.781376+0000", 2024-09-20T21:02:48.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6099999999999999e-07 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.781381+0000", 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5770000000000004e-06 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.781395+0000", 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4148000000000001e-05 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.781403+0000", 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4529999999999996e-06 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.781446+0000", 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3887999999999997e-05 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.781531+0000", 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4860999999999999e-05 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.781598+0000", 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6904999999999997e-05 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.783474+0000", 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018759029999999999 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:184039 5.b 5.d2aa7cab (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:48.783634+0000", 2024-09-20T21:02:48.804 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9998355, 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6380000000000002e-05, 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 184039 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:48.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.783634+0000", 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.783634+0000", 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.783635+0000", 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0599999999999999e-07 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.806 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.783639+0000", 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.065e-06 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.783648+0000", 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2660000000000007e-06 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:48.783653+0000", 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2630000000000003e-06 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.807 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:48.808 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.808 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:48.808 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:48.808 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 5 2024-09-20T21:02:48.808 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:48.809 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:48.834 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:48.828+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:48.934 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:48.928+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:48.960 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:48.960 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:48.960 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:48.961 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:48.961 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:48.978 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:49.035 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:49.028+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:49.104 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:02:49.126 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:49.126 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:49.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:49.126 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:49.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.126 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 96.928443860000002, 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:49.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:49.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:49.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:49.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:49.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:49.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:49.133 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 96.928353823999998, 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:49.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:49.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 96.928267470999998, 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:49.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:49.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:49.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:49.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:49.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:49.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:49.146 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 96.928198662, 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:49.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:49.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:49.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 96.928165801999995, 2024-09-20T21:02:49.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:49.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:49.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:49.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:49.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:49.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:49.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:49.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:49.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:49.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:49.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:49.159 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 96.928123784999997, 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:49.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:49.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:49.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 96.927998678999998, 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:49.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.171 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 96.927906329999999, 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:49.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:49.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:49.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:49.176 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 96.927821957999996, 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:49.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 58.162362502000001, 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:49.181 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:49.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.184 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 58.161810496000001, 2024-09-20T21:02:49.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:49.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:49.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.190 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:49.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:49.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:49.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:49.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:49.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:49.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 58.161182914999998, 2024-09-20T21:02:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:49.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.198 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:49.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:49.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:49.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:49.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.202 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62106 5.0 5:034a2b74:::benchmark_data_smithi112_23632_object62105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 58.161071905999997, 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026866066000000001, 2024-09-20T21:02:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62106 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963443+0000", 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963444+0000", 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963480+0000", 2024-09-20T21:02:49.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5751999999999999e-05 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963493+0000", 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3599e-05 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963498+0000", 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6070000000000001e-06 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965240+0000", 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017424840000000001 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965372+0000", 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013198100000000001 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965500+0000", 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127551 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.209 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.209 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967756+0000", 2024-09-20T21:02:49.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022564199999999999 2024-09-20T21:02:49.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.209 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.209 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990262+0000", 2024-09-20T21:02:49.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022505905999999999 2024-09-20T21:02:49.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990291+0000", 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8424000000000001e-05 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990309+0000", 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8760999999999999e-05 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62114 5.e 5:7d451501:::benchmark_data_smithi112_23632_object62113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 58.157405394000001, 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026917665, 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62114 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967110+0000", 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967111+0000", 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:02:49.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967230+0000", 2024-09-20T21:02:49.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118819 2024-09-20T21:02:49.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967239+0000", 2024-09-20T21:02:49.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8409999999999995e-06 2024-09-20T21:02:49.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967249+0000", 2024-09-20T21:02:49.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1980000000000007e-06 2024-09-20T21:02:49.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967303+0000", 2024-09-20T21:02:49.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4216999999999999e-05 2024-09-20T21:02:49.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967488+0000", 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018482399999999999 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967626+0000", 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000138763 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.971454+0000", 2024-09-20T21:02:49.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0038273999999999999 2024-09-20T21:02:49.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993953+0000", 2024-09-20T21:02:49.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022499623 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993988+0000", 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4482e-05 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994028+0000", 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9677e-05 2024-09-20T21:02:49.218 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62115 5.e 5:7b81944a:::benchmark_data_smithi112_23632_object62114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 58.157091059999999, 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026706516999999999, 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.219 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.220 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.220 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.220 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.220 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62115 2024-09-20T21:02:49.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.220 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967424+0000", 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967425+0000", 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6299999999999993e-07 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967476+0000", 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1103000000000002e-05 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967487+0000", 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0652000000000001e-05 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967496+0000", 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9779999999999994e-06 2024-09-20T21:02:49.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969445+0000", 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001949398 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969605+0000", 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015973300000000001 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.969757+0000", 2024-09-20T21:02:49.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015235699999999999 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.972219+0000", 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024618610000000001 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994060+0000", 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021840352 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994099+0000", 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9773e-05 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994131+0000", 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1347000000000003e-05 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62116 5.4 5:23dbf3dd:::benchmark_data_smithi112_23632_object62115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:49.225 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 58.156908942000001, 2024-09-20T21:02:49.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.026511641999999998, 2024-09-20T21:02:49.226 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.226 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.226 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.226 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.226 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.226 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.226 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62116 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967606+0000", 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967607+0000", 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967675+0000", 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8050000000000001e-05 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967684+0000", 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3689999999999996e-06 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967691+0000", 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7390000000000002e-06 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967769+0000", 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7558000000000005e-05 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967893+0000", 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012416200000000001 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967974+0000", 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1113999999999996e-05 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.970598+0000", 2024-09-20T21:02:49.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026238730000000001 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.993936+0000", 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023337716000000001 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994042+0000", 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010618100000000001 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.994118+0000", 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6197000000000002e-05 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.411449019000003, 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.232 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:49.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:49.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:49.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:49.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:49.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:49.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:49.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:49.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:49.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:49.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:49.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:49.239 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.239 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.240 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.240 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:49.240 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:49.240 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.407098093999998, 2024-09-20T21:02:49.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:49.240 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.241 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.241 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.241 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.241 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.241 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.241 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:49.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.242 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.242 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.242 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:49.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:49.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:49.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:49.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:49.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:49.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:49.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:49.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:49.248 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 37.398856023, 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:49.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:49.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:49.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:49.255 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.255 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.255 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.255 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:127649 5.b 5:df1d496f:::benchmark_data_smithi112_23632_object127648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-20T21:02:49.255 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:49.255 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.956921087000001, 2024-09-20T21:02:49.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.023813432999999998, 2024-09-20T21:02:49.256 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:49.256 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:49.256 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:49.256 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:49.256 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:49.256 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.256 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 127649 2024-09-20T21:02:49.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.256 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:49.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:49.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:49.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:49.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167594+0000", 2024-09-20T21:02:49.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:49.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:49.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167595+0000", 2024-09-20T21:02:49.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:02:49.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:49.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167688+0000", 2024-09-20T21:02:49.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2756000000000004e-05 2024-09-20T21:02:49.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.259 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:49.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167703+0000", 2024-09-20T21:02:49.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5048999999999999e-05 2024-09-20T21:02:49.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167710+0000", 2024-09-20T21:02:49.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0099999999999998e-06 2024-09-20T21:02:49.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:49.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167758+0000", 2024-09-20T21:02:49.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8479000000000001e-05 2024-09-20T21:02:49.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:49.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167873+0000", 2024-09-20T21:02:49.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114753 2024-09-20T21:02:49.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:49.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.167985+0000", 2024-09-20T21:02:49.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011221 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.171532+0000", 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035466080000000001 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191348+0000", 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019815856 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191382+0000", 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4156999999999998e-05 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:25.191408+0000", 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5788000000000001e-05 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:49.263 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:49.264 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:49.266 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:49.266 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:49.260+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:49.365 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:49.360+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:49.419 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:49.419 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:49.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.419 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:185669 5.0 e59/21 5:0d5e269c:::benchmark_data_smithi112_23632_object53565:head v 59'11537, mlcod=59'11532)", 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.414243+0000", 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0039243200000000002, 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039527549999999996, 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.414243+0000", 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.414243+0000", 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.414244+0000", 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3300000000000001e-07 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.414249+0000", 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4079999999999997e-06 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.414262+0000", 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2989e-05 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.414269+0000", 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1509999999999998e-06 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.414553+0000", 2024-09-20T21:02:49.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028433799999999997 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.414569+0000", 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5948999999999999e-05 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:185671 5.4 5:2d0ac6ff:::benchmark_data_smithi112_23632_object53567:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.415036+0000", 2024-09-20T21:02:49.423 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0031306039999999999, 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032354839999999998, 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 185671 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.415036+0000", 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.415036+0000", 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.415037+0000", 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7100000000000002e-07 2024-09-20T21:02:49.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.415040+0000", 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0979999999999998e-06 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.415048+0000", 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3629999999999996e-06 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.415052+0000", 2024-09-20T21:02:49.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3970000000000004e-06 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.415094+0000", 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1681000000000003e-05 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.415166+0000", 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2360999999999994e-05 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.415226+0000", 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0349000000000001e-05 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:185674 5.6 5:64b8a672:::benchmark_data_smithi112_23632_object53570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.416244+0000", 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001923543, 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002113654, 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.428 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.429 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:49.429 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:49.429 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:49.429 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.429 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 185674 2024-09-20T21:02:49.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.429 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416244+0000", 2024-09-20T21:02:49.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416244+0000", 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416244+0000", 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6700000000000003e-07 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416248+0000", 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3119999999999998e-06 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416257+0000", 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1940000000000004e-06 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416262+0000", 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0769999999999998e-06 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:49.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416301+0000", 2024-09-20T21:02:49.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9279000000000001e-05 2024-09-20T21:02:49.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:49.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416377+0000", 2024-09-20T21:02:49.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.606e-05 2024-09-20T21:02:49.433 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.434 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.434 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.435 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:185676 5.4 5:279de673:::benchmark_data_smithi112_23632_object53572:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:49.435 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.416281+0000", 2024-09-20T21:02:49.435 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001885935, 2024-09-20T21:02:49.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002145152, 2024-09-20T21:02:49.435 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.436 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.436 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:49.436 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:49.436 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:49.436 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.436 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 185676 2024-09-20T21:02:49.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.437 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416281+0000", 2024-09-20T21:02:49.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416281+0000", 2024-09-20T21:02:49.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416282+0000", 2024-09-20T21:02:49.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5100000000000001e-07 2024-09-20T21:02:49.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416283+0000", 2024-09-20T21:02:49.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9420000000000002e-06 2024-09-20T21:02:49.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416288+0000", 2024-09-20T21:02:49.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.724e-06 2024-09-20T21:02:49.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416291+0000", 2024-09-20T21:02:49.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1939999999999998e-06 2024-09-20T21:02:49.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:49.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416768+0000", 2024-09-20T21:02:49.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00047674399999999997 2024-09-20T21:02:49.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:49.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416872+0000", 2024-09-20T21:02:49.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103854 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416970+0000", 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8300000000000004e-05 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:185675 5.b e59/21 5:df82a049:::benchmark_data_smithi112_23632_object53571:head v 59'11857, mlcod=59'11855)", 2024-09-20T21:02:49.444 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.416764+0000", 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0014032719999999999, 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0017312269999999999, 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416764+0000", 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416764+0000", 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416764+0000", 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8299999999999998e-07 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416767+0000", 2024-09-20T21:02:49.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.18e-06 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416772+0000", 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7530000000000001e-06 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416775+0000", 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1e-06 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416813+0000", 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8118999999999999e-05 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416831+0000", 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7263999999999999e-05 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:185677 5.0 e59/21 5:0e6ac701:::benchmark_data_smithi112_23632_object53573:head v 59'11538, mlcod=59'11534)", 2024-09-20T21:02:49.448 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.416864+0000", 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0013031749999999999, 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016908590000000001, 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416864+0000", 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416864+0000", 2024-09-20T21:02:49.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416864+0000", 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7000000000000005e-07 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416868+0000", 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4529999999999998e-06 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416874+0000", 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8579999999999996e-06 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416877+0000", 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1159999999999999e-06 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416934+0000", 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7232999999999999e-05 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.416952+0000", 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7600000000000001e-05 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:185679 5.c 5:398c63a8:::benchmark_data_smithi112_23632_object53575:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.417072+0000", 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0010948659999999999, 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001541284, 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:49.453 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 185679 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417072+0000", 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417072+0000", 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417073+0000", 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.16e-07 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417077+0000", 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5829999999999998e-06 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417087+0000", 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0866000000000001e-05 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417094+0000", 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3659999999999997e-06 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417137+0000", 2024-09-20T21:02:49.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3237e-05 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417244+0000", 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010722600000000001 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:185680 5.3 5:c01de70e:::benchmark_data_smithi112_23632_object53576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.417113+0000", 2024-09-20T21:02:49.457 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0010539919999999999, 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015719639999999999, 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 185680 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417113+0000", 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417113+0000", 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417114+0000", 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5499999999999998e-07 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417116+0000", 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3269999999999999e-06 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417123+0000", 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2429999999999999e-06 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.417128+0000", 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9099999999999996e-06 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418128+0000", 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0009994820000000001 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418262+0000", 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000134146 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:185681 5.3 5.afa08843 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.418080+0000", 2024-09-20T21:02:49.461 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.7386000000000007e-05, 2024-09-20T21:02:49.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067068499999999997, 2024-09-20T21:02:49.462 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.462 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.462 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:49.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:49.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:49.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.462 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 185681 2024-09-20T21:02:49.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.463 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418080+0000", 2024-09-20T21:02:49.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418080+0000", 2024-09-20T21:02:49.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418080+0000", 2024-09-20T21:02:49.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9200000000000001e-07 2024-09-20T21:02:49.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418083+0000", 2024-09-20T21:02:49.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1580000000000001e-06 2024-09-20T21:02:49.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418101+0000", 2024-09-20T21:02:49.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7156999999999999e-05 2024-09-20T21:02:49.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418106+0000", 2024-09-20T21:02:49.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6200000000000004e-06 2024-09-20T21:02:49.467 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.467 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.467 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.467 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:185678 5.0 e59/21)", 2024-09-20T21:02:49.468 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.418735+0000", 2024-09-20T21:02:49.468 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9994326, 2024-09-20T21:02:49.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9543999999999997e-05, 2024-09-20T21:02:49.468 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.468 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.468 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:49.468 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418735+0000", 2024-09-20T21:02:49.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418735+0000", 2024-09-20T21:02:49.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418735+0000", 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2300000000000001e-07 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418739+0000", 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0899999999999998e-06 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418747+0000", 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9119999999999998e-06 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418752+0000", 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3159999999999996e-06 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:185682 5.4 5.9d3c9764 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.418797+0000", 2024-09-20T21:02:49.471 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9993701, 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3448999999999995e-05, 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 185682 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418797+0000", 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418797+0000", 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418798+0000", 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5600000000000005e-07 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418802+0000", 2024-09-20T21:02:49.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5789999999999997e-06 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418812+0000", 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5719999999999992e-06 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418820+0000", 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4309999999999994e-06 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.418869+0000", 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8497e-05 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:185666 5.3 5:ca6cfcca:::benchmark_data_smithi112_23632_object53562:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:49.412636+0000", 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0055313430000000002, 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0062900250000000003, 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:49.475 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 185666 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.412636+0000", 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.412636+0000", 2024-09-20T21:02:49.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.412637+0000", 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.105e-06 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.412642+0000", 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9490000000000004e-06 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:49.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.412656+0000", 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3942e-05 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.412663+0000", 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1080000000000004e-06 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.412739+0000", 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6180000000000006e-05 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:49.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:49.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:49.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:49.412824+0000", 2024-09-20T21:02:49.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5233000000000002e-05 2024-09-20T21:02:49.479 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.479 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:49.479 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.479 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:49.479 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:49.479 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 12 2024-09-20T21:02:49.479 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:49.480 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:49.482 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:49.482 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:49.482 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:49.483 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:49.483 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:49.476+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:49.484 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:49.484 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:49.484 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:49.581 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:49.576+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:49.672 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:49.672 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:49.682 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:49.676+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:49.692 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:49.783 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:49.780+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:49.834 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:49.835 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:49.854 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:49.883 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:49.880+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:49.984 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:49.980+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:50.007 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:50.007 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:50.028 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:50.085 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:50.080+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:50.186 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:50.180+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:50.214 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:50.214 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:50.230 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:50.287 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:50.284+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:50.378 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:50.378 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:50.387 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:50.384+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:50.398 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:50.488 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:50.484+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:50.554 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:50.554 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:50.573 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:50.589 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:50.584+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:50.690 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:50.684+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:50.719 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:50.719 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:50.738 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:50.790 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:50.788+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:50.892 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:50.884+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:50.931 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:50.932 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:50.951 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:50.992 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:50.988+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:51.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~23s 2024-09-20T21:02:51.093 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:51.088+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:51.107 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:51.107 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:51.128 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:51.194 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:51.192+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:51.267 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T21:02:51.282 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:51.282 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:51.295 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:51.292+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:51.300 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:51.396 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:51.392+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:51.485 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:51.492 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:51.493 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:51.497 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:51.492+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:51.510 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:51.600 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:51.592+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:51.640 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:51.641 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:51.641 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:51.658 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:51.659 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:51.661 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:51.661 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191391 5.a 5:5a1a587a:::benchmark_data_smithi112_23632_object59287:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.662341+0000", 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0046901180000000001, 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047083280000000003, 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:51.668 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191391 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662341+0000", 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662341+0000", 2024-09-20T21:02:51.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662342+0000", 2024-09-20T21:02:51.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1200000000000002e-07 2024-09-20T21:02:51.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662344+0000", 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8600000000000001e-06 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662351+0000", 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4910000000000002e-06 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662355+0000", 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2520000000000001e-06 2024-09-20T21:02:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:51.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662387+0000", 2024-09-20T21:02:51.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1752999999999999e-05 2024-09-20T21:02:51.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:51.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662451+0000", 2024-09-20T21:02:51.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4139000000000004e-05 2024-09-20T21:02:51.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662509+0000", 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8470000000000001e-05 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666349+0000", 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038393619999999998 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191392 5.4 5:2461d532:::benchmark_data_smithi112_23632_object59288:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.662823+0000", 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0042076630000000004, 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004275966, 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:51.674 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191392 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662823+0000", 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662823+0000", 2024-09-20T21:02:51.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662824+0000", 2024-09-20T21:02:51.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0999999999999998e-07 2024-09-20T21:02:51.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662828+0000", 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.709e-06 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662839+0000", 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.115e-05 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662846+0000", 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.781e-06 2024-09-20T21:02:51.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662881+0000", 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5014000000000001e-05 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.662946+0000", 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5604000000000004e-05 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.663004+0000", 2024-09-20T21:02:51.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7945999999999997e-05 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191382 5.b e59/21 5:dc8632c8:::benchmark_data_smithi112_23632_object59278:head v 59'12221, mlcod=59'12217)", 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.663534+0000", 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0034969380000000002, 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0036091859999999999, 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.663534+0000", 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.663534+0000", 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.663534+0000", 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.72e-07 2024-09-20T21:02:51.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.663538+0000", 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9609999999999999e-06 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.663544+0000", 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1059999999999996e-06 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.663548+0000", 2024-09-20T21:02:51.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1590000000000003e-06 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.663590+0000", 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1099000000000001e-05 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.663608+0000", 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8252000000000001e-05 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191397 5.4 5:2ed1b9f2:::benchmark_data_smithi112_23632_object59293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.664283+0000", 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0027474410000000002, 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028927509999999998, 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191397 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.683 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664283+0000", 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664283+0000", 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664284+0000", 2024-09-20T21:02:51.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1900000000000002e-07 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664287+0000", 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1499999999999999e-06 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664303+0000", 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5582000000000001e-05 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664309+0000", 2024-09-20T21:02:51.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9410000000000004e-06 2024-09-20T21:02:51.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:51.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664387+0000", 2024-09-20T21:02:51.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8286000000000002e-05 2024-09-20T21:02:51.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:51.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664454+0000", 2024-09-20T21:02:51.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7168000000000005e-05 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664522+0000", 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7337999999999998e-05 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191398 5.a 5:508594d6:::benchmark_data_smithi112_23632_object59294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.664476+0000", 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0025549029999999999, 2024-09-20T21:02:51.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027388220000000001, 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191398 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664476+0000", 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664476+0000", 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664477+0000", 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5499999999999997e-07 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664480+0000", 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4359999999999998e-06 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664489+0000", 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9770000000000006e-06 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664494+0000", 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.293e-06 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664532+0000", 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7230000000000001e-05 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664649+0000", 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117636 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.664745+0000", 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5835000000000007e-05 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.692 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191399 5.a 5:59389749:::benchmark_data_smithi112_23632_object59295:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.665056+0000", 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0019752559999999999, 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021958110000000002, 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191399 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665056+0000", 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665056+0000", 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665056+0000", 2024-09-20T21:02:51.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:02:51.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665059+0000", 2024-09-20T21:02:51.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0000000000000001e-06 2024-09-20T21:02:51.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665070+0000", 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0199e-05 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665076+0000", 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666376+0000", 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001300647 2024-09-20T21:02:51.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666478+0000", 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102194 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666583+0000", 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104932 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191400 5.4 5:256ac120:::benchmark_data_smithi112_23632_object59296:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.665337+0000", 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0016938630000000001, 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001950731, 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:51.698 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191400 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665337+0000", 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665337+0000", 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665338+0000", 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8599999999999998e-07 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665341+0000", 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.898e-06 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665349+0000", 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9190000000000005e-06 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665355+0000", 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0690000000000001e-06 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666318+0000", 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096341099999999995 2024-09-20T21:02:51.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:51.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666413+0000", 2024-09-20T21:02:51.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5091000000000001e-05 2024-09-20T21:02:51.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:51.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666519+0000", 2024-09-20T21:02:51.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105566 2024-09-20T21:02:51.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.703 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191393 5.0 e59/21 5:01466f01:::benchmark_data_smithi112_23632_object59289:head v 59'11890, mlcod=59'11888)", 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.665601+0000", 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0014300579999999999, 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0017250970000000001, 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665601+0000", 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665601+0000", 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665601+0000", 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0400000000000002e-07 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665605+0000", 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8600000000000003e-06 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665612+0000", 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3730000000000004e-06 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665617+0000", 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.313e-06 2024-09-20T21:02:51.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665746+0000", 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012890800000000001 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665758+0000", 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2296999999999999e-05 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191385 5.b e59/21)", 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.665642+0000", 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001388788, 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0017112399999999999, 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665642+0000", 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665642+0000", 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665643+0000", 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.46e-07 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665646+0000", 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.805e-06 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665654+0000", 2024-09-20T21:02:51.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2509999999999997e-06 2024-09-20T21:02:51.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665659+0000", 2024-09-20T21:02:51.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7509999999999997e-06 2024-09-20T21:02:51.710 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.710 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191401 5.3 5.3c78d973 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.665701+0000", 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001330164, 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016764880000000001, 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:51.711 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191401 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665701+0000", 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665701+0000", 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665701+0000", 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6599999999999996e-07 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665704+0000", 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.145e-06 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665711+0000", 2024-09-20T21:02:51.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5089999999999999e-06 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.665715+0000", 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.658e-06 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191402 5.a 5.9c02872a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.666605+0000", 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00042635900000000002, 2024-09-20T21:02:51.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00079955900000000003, 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191402 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666605+0000", 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666605+0000", 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666605+0000", 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2500000000000004e-07 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666610+0000", 2024-09-20T21:02:51.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2089999999999999e-06 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666618+0000", 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3920000000000003e-06 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666626+0000", 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0320000000000003e-06 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191403 5.6 5:6ee67a20:::benchmark_data_smithi112_23632_object59299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.666776+0000", 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000254782, 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00065589499999999998, 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191403 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666776+0000", 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666776+0000", 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666777+0000", 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6400000000000001e-07 2024-09-20T21:02:51.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666780+0000", 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.32e-06 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666791+0000", 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0411000000000001e-05 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666799+0000", 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3720000000000005e-06 2024-09-20T21:02:51.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666877+0000", 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7686000000000001e-05 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.667018+0000", 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000141693 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191404 5.a 5.7212b2da (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.666817+0000", 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00021375300000000001, 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064673699999999998, 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191404 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666817+0000", 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666817+0000", 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666818+0000", 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9400000000000001e-07 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666820+0000", 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3259999999999998e-06 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666828+0000", 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7449999999999995e-06 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.666833+0000", 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0019999999999997e-06 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191391 5.a e59/21)", 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.667337+0000", 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9996939, 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017755399999999999, 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:51.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.667337+0000", 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.667337+0000", 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.667338+0000", 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5499999999999998e-07 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:51.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.667341+0000", 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4910000000000001e-06 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.667352+0000", 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0482999999999999e-05 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.667358+0000", 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9000000000000003e-06 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:51.727 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.728 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:51.728 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:51.728 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 14 2024-09-20T21:02:51.728 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:51.729 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:51.784 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:51.724+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:51.830 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:51.824+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:51.930 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:51.928+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:51.931 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:51.931 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:51.931 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:51.931 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:51.931 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:51.950 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:52.036 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:52.032+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:52.123 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-20T21:02:52.133 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:52.128+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:52.148 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.951809933000007, 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.149 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:52.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:52.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.951585402000006, 2024-09-20T21:02:52.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:52.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.161 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.471891014, 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:02:52.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:02:52.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:02:52.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.167 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.47155678899999998, 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:52.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:02:52.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.47129797200000001, 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.173 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:52.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:02:52.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:02:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46968305500000002, 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:02:52.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:02:52.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46736513499999999, 2024-09-20T21:02:52.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:02:52.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:02:52.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46533704199999998, 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.189 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:52.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.193 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46521240200000002, 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:02:52.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.198 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46320408499999999, 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:02:52.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:02:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46214342600000002, 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46194960200000001, 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.207 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:02:52.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:02:52.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:02:52.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46187296799999999, 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:52.213 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:02:52.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:02:52.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46180176499999998, 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.223 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46148656900000001, 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:02:52.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.46007983299999999, 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:02:52.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:02:52.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:02:52.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:02:52.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:02:52.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:02:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.459825975, 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:02:52.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.45924124799999999, 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:52.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.241 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.45921899599999999, 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:52.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.245 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.45815152799999997, 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:02:52.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:52.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:02:52.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.251 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:52.251 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:52.251 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:52.253 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:52.253 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:52.248+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:52.354 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:52.348+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:52.409 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:52.409 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:52.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.409 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:193007 5.0 5:09ad583d:::benchmark_data_smithi112_23632_object60903:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:52.409 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.400043+0000", 2024-09-20T21:02:52.409 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0083625109999999996, 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0083864600000000001, 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 193007 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400043+0000", 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400043+0000", 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400044+0000", 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0999999999999997e-07 2024-09-20T21:02:52.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400048+0000", 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0450000000000002e-06 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400059+0000", 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1099e-05 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400066+0000", 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0619999999999997e-06 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400965+0000", 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00089980799999999999 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401088+0000", 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012273000000000001 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401204+0000", 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011576100000000001 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.404311+0000", 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0031072679999999998 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.414 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:193008 5.0 5:04d2ee7c:::benchmark_data_smithi112_23632_object60904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.400705+0000", 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.007700793, 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077841990000000003, 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 193008 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.415 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400705+0000", 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400705+0000", 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400706+0000", 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2299999999999999e-07 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400711+0000", 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9089999999999999e-06 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400724+0000", 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2690999999999999e-05 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.400731+0000", 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1339999999999998e-06 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.402844+0000", 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0021132450000000001 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.402916+0000", 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2341000000000004e-05 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.402981+0000", 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4187000000000001e-05 2024-09-20T21:02:52.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405238+0000", 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002257949 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:193009 5.b 5:d9237271:::benchmark_data_smithi112_23632_object60905:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.401342+0000", 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0070635589999999996, 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0071919410000000003, 2024-09-20T21:02:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 193009 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401342+0000", 2024-09-20T21:02:52.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401342+0000", 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401343+0000", 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4199999999999995e-07 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401346+0000", 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.0199999999999999e-06 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401354+0000", 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.456e-06 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401361+0000", 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.528e-06 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401538+0000", 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017722500000000001 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401623+0000", 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4420999999999997e-05 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.401692+0000", 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9622000000000005e-05 2024-09-20T21:02:52.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405879+0000", 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0041867359999999999 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:193013 5.8 e60/38 5:1248b9d3:::benchmark_data_smithi112_23632_object60909:head v 60'12117, mlcod=60'12114)", 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.403338+0000", 2024-09-20T21:02:52.424 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.005068197, 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0052401310000000003, 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403338+0000", 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.425 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403338+0000", 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403338+0000", 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3500000000000002e-07 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403342+0000", 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8430000000000003e-06 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403348+0000", 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9780000000000002e-06 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403352+0000", 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.515e-06 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.404300+0000", 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00094734500000000004 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.404316+0000", 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6274e-05 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:193014 5.b 5:d0b997a7:::benchmark_data_smithi112_23632_object60910:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.403593+0000", 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0048130239999999999, 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050382350000000003, 2024-09-20T21:02:52.428 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 193014 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403593+0000", 2024-09-20T21:02:52.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.430 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403593+0000", 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403594+0000", 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2299999999999999e-07 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403598+0000", 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.532e-06 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403610+0000", 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1562e-05 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403617+0000", 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7129999999999999e-06 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403669+0000", 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2788999999999999e-05 2024-09-20T21:02:52.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403830+0000", 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016011199999999999 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.403941+0000", 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000111459 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408562+0000", 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0046214899999999998 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:193018 5.4 e60/38 5:235ebc49:::benchmark_data_smithi112_23632_object60914:head v 60'12219, mlcod=60'12217)", 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.405007+0000", 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.003398748, 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003666267, 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.434 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405007+0000", 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405007+0000", 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405008+0000", 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9500000000000002e-07 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405013+0000", 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.417e-06 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405027+0000", 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4327e-05 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405033+0000", 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3000000000000001e-06 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405084+0000", 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0881000000000003e-05 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405104+0000", 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0509999999999998e-05 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.437 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:193020 5.0 5:05e16567:::benchmark_data_smithi112_23632_object60916:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.405780+0000", 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002625886, 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029255790000000002, 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.438 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 193020 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405780+0000", 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405780+0000", 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405781+0000", 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2900000000000003e-07 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405785+0000", 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9940000000000002e-06 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405797+0000", 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2516e-05 2024-09-20T21:02:52.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405802+0000", 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2190000000000003e-06 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405853+0000", 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0503000000000001e-05 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.405944+0000", 2024-09-20T21:02:52.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0974e-05 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406057+0000", 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011331400000000001 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:193021 5.f 5:faca2abc:::benchmark_data_smithi112_23632_object60917:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.406252+0000", 2024-09-20T21:02:52.442 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002153753, 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024936899999999998, 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 193021 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406252+0000", 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406252+0000", 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406253+0000", 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6799999999999999e-07 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406257+0000", 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8399999999999997e-06 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406268+0000", 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0930999999999999e-05 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406273+0000", 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.412e-06 2024-09-20T21:02:52.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406326+0000", 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2760999999999998e-05 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406446+0000", 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000119667 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:193023 5.9 5:9aef2865:::benchmark_data_smithi112_23632_object60919:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.406692+0000", 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001714333, 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020887280000000002, 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 193023 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.447 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406692+0000", 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406692+0000", 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406693+0000", 2024-09-20T21:02:52.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5799999999999998e-07 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406697+0000", 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.578e-06 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406716+0000", 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9262e-05 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406723+0000", 2024-09-20T21:02:52.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0620000000000003e-06 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406786+0000", 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2411999999999998e-05 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.406904+0000", 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118554 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:193024 5.0 5:0a63acbc:::benchmark_data_smithi112_23632_object60920:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.407942+0000", 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00046340699999999999, 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087201900000000003, 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 193024 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.451 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.407942+0000", 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.407942+0000", 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.407943+0000", 2024-09-20T21:02:52.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2500000000000005e-07 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.407947+0000", 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0810000000000004e-06 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.407957+0000", 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0155e-05 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.407963+0000", 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0640000000000001e-06 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408341+0000", 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000378429 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408468+0000", 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000126799 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408585+0000", 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116897 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:193022 5.a e60/21 5:55e86e8c:::benchmark_data_smithi112_23632_object60918:head v 60'12040, mlcod=60'12038)", 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.408172+0000", 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00023346400000000001, 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00068004899999999995, 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.455 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408172+0000", 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408172+0000", 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408173+0000", 2024-09-20T21:02:52.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3200000000000005e-07 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408178+0000", 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8189999999999999e-06 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408187+0000", 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9099999999999994e-06 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408192+0000", 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8169999999999998e-06 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408237+0000", 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5708999999999999e-05 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408255+0000", 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.749e-05 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.458 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:193020 5.0 e60/21)", 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:52.408496+0000", 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9999104, 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00038683400000000002, 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408496+0000", 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408496+0000", 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408496+0000", 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7999999999999995e-07 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408500+0000", 2024-09-20T21:02:52.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9280000000000003e-06 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408509+0000", 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9619999999999999e-06 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:52.408515+0000", 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0480000000000004e-06 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.461 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:52.462 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 12 2024-09-20T21:02:52.462 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:52.463 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:52.456+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:52.463 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:52.566 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:52.564+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:52.653 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:52.654 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:52.654 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:52.667 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:52.660+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:52.671 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:52.768 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:52.764+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:52.869 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:52.864+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:52.871 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 100.67278019699999, 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:52.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 100.67269016100001, 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.878 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:52.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:52.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:52.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:52.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:52.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:52.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:52.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:52.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:52.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:52.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:52.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:52.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:52.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:52.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:52.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:52.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:52.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:52.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 100.67260380800001, 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.887 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:52.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.893 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 100.67253499900001, 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:52.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:52.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.900 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 100.672502139, 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:52.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:52.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.906 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 100.672460122, 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:52.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:52.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:52.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 100.67233501600001, 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:52.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:52.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 100.67224266700001, 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.919 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:52.923 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 100.672158295, 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.906698839000001, 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:52.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:52.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:52.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.906146833000001, 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:52.934 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:52.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:52.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:52.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 61.905519251999998, 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.940 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:52.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:52.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:52.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 41.155785356000003, 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.946 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:52.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:52.951 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 41.151434430999998, 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.952 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:52.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 41.14319236, 2024-09-20T21:02:52.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:52.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:52.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.194063047, 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.963 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:52.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.1881464799999999, 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.969 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.970 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.970 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.970 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.970 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:02:52.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.970 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:02:52.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:02:52.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:02:52.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.1848768620000001, 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:02:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:02:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:02:52.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:02:52.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:02:52.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.1843763410000001, 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.981 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:02:52.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:02:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:02:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.986 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 1.1842210550000001, 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:52.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:52.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:52.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:02:52.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:02:52.992 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.992 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.992 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.992 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:52.992 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:52.992 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:52.994 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:52.988+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:52.994 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:53.094 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:53.088+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:53.116 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-09-20T21:02:53.116 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:02:53.116 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-20T21:02:53.116 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-20T21:02:53.147 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194906 5.a 5:5db2ca70:::benchmark_data_smithi112_23632_object62802:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.141293+0000", 2024-09-20T21:02:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00470807, 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047257499999999999, 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194906 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141293+0000", 2024-09-20T21:02:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141293+0000", 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141294+0000", 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.53e-07 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141296+0000", 2024-09-20T21:02:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1399999999999998e-06 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141302+0000", 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9340000000000003e-06 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141307+0000", 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0849999999999996e-06 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.143429+0000", 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002122184 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.143523+0000", 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4277999999999994e-05 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.143589+0000", 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6277000000000003e-05 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194909 5.8 5:1d4ffdd8:::benchmark_data_smithi112_23632_object62805:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.141352+0000", 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0046488479999999997, 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047146180000000003, 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194909 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141352+0000", 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141352+0000", 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141353+0000", 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141356+0000", 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6199999999999999e-06 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141362+0000", 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.545e-06 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141368+0000", 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5979999999999996e-06 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141524+0000", 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015645200000000001 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141634+0000", 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109385 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141728+0000", 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4647000000000004e-05 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194910 5.a 5:56b34b60:::benchmark_data_smithi112_23632_object62806:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.141384+0000", 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0046176710000000003, 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004753073, 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194910 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141384+0000", 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141384+0000", 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141384+0000", 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5600000000000001e-07 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141386+0000", 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0600000000000002e-06 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141394+0000", 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6520000000000006e-06 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141401+0000", 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8689999999999998e-06 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144898+0000", 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034975499999999999 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144982+0000", 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3431999999999997e-05 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.145053+0000", 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1626999999999997e-05 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194911 5.a 5.5cd9188a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.141408+0000", 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0045935230000000004, 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048053610000000002, 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194911 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141408+0000", 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141408+0000", 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141408+0000", 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2300000000000002e-07 2024-09-20T21:02:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141410+0000", 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.092e-06 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141418+0000", 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.554e-06 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141425+0000", 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8290000000000002e-06 2024-09-20T21:02:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194912 5.6 5:61595f29:::benchmark_data_smithi112_23632_object62808:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.141431+0000", 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0045703489999999996, 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048430979999999997, 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194912 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141431+0000", 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141431+0000", 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141431+0000", 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9599999999999999e-07 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141434+0000", 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1830000000000001e-06 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141441+0000", 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2049999999999996e-06 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141446+0000", 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2889999999999997e-06 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.142813+0000", 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013673419999999999 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.142935+0000", 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121885 2024-09-20T21:02:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194916 5.2 5:4719aa17:::benchmark_data_smithi112_23632_object62812:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.144413+0000", 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0015883029999999999, 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019287690000000001, 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194916 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144413+0000", 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144413+0000", 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144414+0000", 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144418+0000", 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.228e-06 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144427+0000", 2024-09-20T21:02:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2920000000000001e-06 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144435+0000", 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.146287+0000", 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001852158 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194917 5.8 5:1b4c7d37:::benchmark_data_smithi112_23632_object62813:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.144450+0000", 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0015516900000000001, 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019551260000000002, 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194917 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144450+0000", 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144450+0000", 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144450+0000", 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7599999999999997e-07 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144453+0000", 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.525e-06 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144459+0000", 2024-09-20T21:02:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2779999999999999e-06 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144465+0000", 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8109999999999999e-06 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144512+0000", 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7644e-05 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144644+0000", 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013177299999999999 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144707+0000", 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2803000000000002e-05 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:194915 5.0 e60/21 5:094dda7f:::benchmark_data_smithi112_23632_object62811:head v 60'12110, mlcod=60'12108)", 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.144941+0000", 2024-09-20T21:02:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0010606979999999999, 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015455130000000001, 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144941+0000", 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144941+0000", 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144941+0000", 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3600000000000003e-07 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144947+0000", 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9939999999999997e-06 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144958+0000", 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0957e-05 2024-09-20T21:02:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.144965+0000", 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1389999999999998e-06 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.145011+0000", 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5932e-05 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.145034+0000", 2024-09-20T21:02:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2187e-05 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194919 5.2 5.2a6ad332 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.145685+0000", 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000316483, 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00086422599999999995, 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194919 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.145685+0000", 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.145685+0000", 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.145686+0000", 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6899999999999996e-07 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.145690+0000", 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2910000000000001e-06 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.145704+0000", 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3669000000000001e-05 2024-09-20T21:02:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.145713+0000", 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9409999999999996e-06 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:194920 5.e e60/21 5:776f3a21:::benchmark_data_smithi112_23632_object62816:head v 60'12184, mlcod=60'12182)", 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.146124+0000", 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.999877, 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00048346499999999998, 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.183 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.146124+0000", 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.146124+0000", 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.146125+0000", 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.44e-07 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.146129+0000", 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4519999999999999e-06 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.146139+0000", 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2350000000000005e-06 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.146145+0000", 2024-09-20T21:02:53.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4150000000000004e-06 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.146196+0000", 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1418999999999997e-05 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.146215+0000", 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9035e-05 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194901 5.a 5:56424877:::benchmark_data_smithi112_23632_object62797:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.136364+0000", 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0096374449999999997, 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010304347, 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194901 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.136364+0000", 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.136364+0000", 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.136365+0000", 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.094e-06 2024-09-20T21:02:53.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.136369+0000", 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4360000000000004e-06 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.136383+0000", 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3978000000000001e-05 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.136391+0000", 2024-09-20T21:02:53.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0190000000000006e-06 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.136435+0000", 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4100000000000001e-05 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.136517+0000", 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1613999999999995e-05 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.136600+0000", 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3160999999999999e-05 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.138174+0000", 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573802 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194903 5.2 5:49c56e25:::benchmark_data_smithi112_23632_object62799:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.141201+0000", 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0048002130000000002, 2024-09-20T21:02:53.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.005549109, 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194903 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141201+0000", 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141201+0000", 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141202+0000", 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4000000000000001e-07 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141205+0000", 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219999999999999e-06 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141214+0000", 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3000000000000002e-06 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141218+0000", 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7010000000000004e-06 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141275+0000", 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6501e-05 2024-09-20T21:02:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141395+0000", 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119825 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:194905 5.a 5:532e37c2:::benchmark_data_smithi112_23632_object62801:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:53.141271+0000", 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0047298089999999997, 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.005551327, 2024-09-20T21:02:53.195 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 194905 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141271+0000", 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141271+0000", 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141272+0000", 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3999999999999997e-07 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141274+0000", 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.159e-06 2024-09-20T21:02:53.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141280+0000", 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141285+0000", 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9840000000000001e-06 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141319+0000", 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4326000000000003e-05 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141440+0000", 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000120266 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.141553+0000", 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112923 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:53.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:53.146212+0000", 2024-09-20T21:02:53.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046591389999999996 2024-09-20T21:02:53.200 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.200 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.200 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.200 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.200 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:53.200 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 13 2024-09-20T21:02:53.200 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:53.201 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:53.202 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:53.196+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:53.288 INFO:teuthology.orchestra.run.smithi112.stderr:no valid command found; 10 closest matches: 2024-09-20T21:02:53.288 INFO:teuthology.orchestra.run.smithi112.stderr:0 2024-09-20T21:02:53.288 INFO:teuthology.orchestra.run.smithi112.stderr:1 2024-09-20T21:02:53.288 INFO:teuthology.orchestra.run.smithi112.stderr:2 2024-09-20T21:02:53.288 INFO:teuthology.orchestra.run.smithi112.stderr:abort 2024-09-20T21:02:53.289 INFO:teuthology.orchestra.run.smithi112.stderr:assert 2024-09-20T21:02:53.289 INFO:teuthology.orchestra.run.smithi112.stderr:bench [] [] [] [] 2024-09-20T21:02:53.289 INFO:teuthology.orchestra.run.smithi112.stderr:bluefs debug_inject_read_zeros 2024-09-20T21:02:53.289 INFO:teuthology.orchestra.run.smithi112.stderr:bluefs files list 2024-09-20T21:02:53.289 INFO:teuthology.orchestra.run.smithi112.stderr:bluefs stats 2024-09-20T21:02:53.289 INFO:teuthology.orchestra.run.smithi112.stderr:bluestore allocator dump block 2024-09-20T21:02:53.289 INFO:teuthology.orchestra.run.smithi112.stderr:Error EINVAL: invalid command 2024-09-20T21:02:53.291 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T21:02:53.291 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-20T21:02:53.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-20T21:02:53.302 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:53.300+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:53.402 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:53.402 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:53.402 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:53.402 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:53.402 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:53.403 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:53.400+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:53.420 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:53.421 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:53.421 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-20T21:02:53.421 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-20T21:02:53.504 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:53.500+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:53.576 INFO:teuthology.orchestra.run.smithi112.stderr:no valid command found; 10 closest matches: 2024-09-20T21:02:53.576 INFO:teuthology.orchestra.run.smithi112.stderr:0 2024-09-20T21:02:53.576 INFO:teuthology.orchestra.run.smithi112.stderr:1 2024-09-20T21:02:53.576 INFO:teuthology.orchestra.run.smithi112.stderr:2 2024-09-20T21:02:53.576 INFO:teuthology.orchestra.run.smithi112.stderr:abort 2024-09-20T21:02:53.576 INFO:teuthology.orchestra.run.smithi112.stderr:assert 2024-09-20T21:02:53.576 INFO:teuthology.orchestra.run.smithi112.stderr:bench [] [] [] [] 2024-09-20T21:02:53.576 INFO:teuthology.orchestra.run.smithi112.stderr:bluefs debug_inject_read_zeros 2024-09-20T21:02:53.577 INFO:teuthology.orchestra.run.smithi112.stderr:bluefs files list 2024-09-20T21:02:53.577 INFO:teuthology.orchestra.run.smithi112.stderr:bluefs stats 2024-09-20T21:02:53.577 INFO:teuthology.orchestra.run.smithi112.stderr:bluestore allocator dump block 2024-09-20T21:02:53.577 INFO:teuthology.orchestra.run.smithi112.stderr:Error EINVAL: invalid command 2024-09-20T21:02:53.579 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 101.38332651100001, 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 101.38310198000001, 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.586 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:53.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.903407592, 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:02:53.592 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:02:53.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:02:53.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:53.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.903073367, 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.598 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:53.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:02:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.603 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.90281455, 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:02:53.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:02:53.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:02:53.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:02:53.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.608 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.608 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:53.608 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:02:53.609 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.9011996330000001, 2024-09-20T21:02:53.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:02:53.609 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.609 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.609 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:02:53.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.898881713, 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.615 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:02:53.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.8968536199999999, 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.621 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:02:53.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.625 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.89672898, 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:02:53.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.630 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.894720663, 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:02:53.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:02:53.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.634 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.893660004, 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:02:53.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.8934661799999999, 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:02:53.639 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:02:53.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.8933895459999999, 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.645 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:02:53.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:02:53.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.893318343, 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.650 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:02:53.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:53.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.8930031469999999, 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:02:53.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:02:53.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:02:53.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.8915964110000001, 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.660 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:02:53.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.8913425529999999, 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:02:53.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.890757826, 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.669 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:02:53.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.890735574, 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:53.673 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:53.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.889668106, 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:53.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:53.682 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:53.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:53.684 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:53.680+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:53.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T21:02:53.685 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-20T21:02:53.685 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:53.785 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:53.780+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:196606 5.e 5:7aa62858:::benchmark_data_smithi112_23632_object64502:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.832764+0000", 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0051135140000000004, 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0051395030000000001, 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:53.839 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 196606 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.832764+0000", 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.832764+0000", 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.840 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.832765+0000", 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1030000000000001e-06 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.832771+0000", 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2689999999999999e-06 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.832783+0000", 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2748999999999999e-05 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.832793+0000", 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2809999999999997e-06 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.832830+0000", 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7595999999999997e-05 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.842 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.832922+0000", 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1971000000000004e-05 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.832998+0000", 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6087999999999994e-05 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.834722+0000", 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001723217 2024-09-20T21:02:53.843 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:196610 5.0 5:0de1b290:::benchmark_data_smithi112_23632_object64506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.835042+0000", 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0028363310000000001, 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029575259999999998, 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 196610 2024-09-20T21:02:53.844 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835042+0000", 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835042+0000", 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835043+0000", 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.9099999999999991e-07 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835047+0000", 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8369999999999996e-06 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835060+0000", 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2576e-05 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835067+0000", 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0199999999999997e-06 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835127+0000", 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9756999999999997e-05 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835274+0000", 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014752499999999999 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835394+0000", 2024-09-20T21:02:53.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000119504 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:196611 5.e 5:7ddd003f:::benchmark_data_smithi112_23632_object64507:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.835239+0000", 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0026389360000000001, 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002839271, 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.848 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 196611 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835239+0000", 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835239+0000", 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835240+0000", 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9599999999999998e-07 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835243+0000", 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5140000000000002e-06 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835252+0000", 2024-09-20T21:02:53.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2140000000000002e-06 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835258+0000", 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9190000000000004e-06 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835306+0000", 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7905999999999998e-05 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:53.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835377+0000", 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1012000000000004e-05 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.835468+0000", 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0254999999999996e-05 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837245+0000", 2024-09-20T21:02:53.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017778609999999999 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:196614 5.9 5:9af6cd22:::benchmark_data_smithi112_23632_object64510:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.836449+0000", 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00142877, 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017166149999999999, 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.853 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 196614 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836449+0000", 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836449+0000", 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836450+0000", 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2900000000000003e-07 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836453+0000", 2024-09-20T21:02:53.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3280000000000002e-06 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836461+0000", 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2700000000000004e-06 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836466+0000", 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8500000000000002e-06 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836530+0000", 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3460000000000006e-05 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836620+0000", 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0617000000000003e-05 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.857 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:196616 5.f 5:f82a2427:::benchmark_data_smithi112_23632_object64512:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.836480+0000", 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0013982440000000001, 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017493999999999999, 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 196616 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836480+0000", 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836480+0000", 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836480+0000", 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3700000000000001e-07 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836483+0000", 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8949999999999998e-06 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836492+0000", 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5979999999999997e-06 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836497+0000", 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6420000000000004e-06 2024-09-20T21:02:53.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836553+0000", 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6190000000000002e-05 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836679+0000", 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012515599999999999 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:196617 5.0 5:00b8abd1:::benchmark_data_smithi112_23632_object64513:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.836677+0000", 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001200691, 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016119839999999999, 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "reached pg", 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 196617 2024-09-20T21:02:53.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836677+0000", 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836677+0000", 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836678+0000", 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.61e-07 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836682+0000", 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.895e-06 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836690+0000", 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1410000000000005e-06 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836697+0000", 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8260000000000004e-06 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837646+0000", 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00094888899999999996 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:196618 5.9 5.6fc57b39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.836753+0000", 2024-09-20T21:02:53.865 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001125151, 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0015900860000000001, 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 196618 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836753+0000", 2024-09-20T21:02:53.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836753+0000", 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836754+0000", 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836759+0000", 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.814e-06 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836769+0000", 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0232e-05 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.836778+0000", 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7790000000000001e-06 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.868 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.869 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.870 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:196619 5.4 e60/38 5:246709a1:::benchmark_data_smithi112_23632_object64515:head v 60'12441, mlcod=60'12439)", 2024-09-20T21:02:53.870 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.837119+0000", 2024-09-20T21:02:53.870 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000758916, 2024-09-20T21:02:53.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0012767150000000001, 2024-09-20T21:02:53.870 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.870 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.871 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:53.871 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837119+0000", 2024-09-20T21:02:53.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837119+0000", 2024-09-20T21:02:53.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837119+0000", 2024-09-20T21:02:53.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4799999999999999e-07 2024-09-20T21:02:53.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837124+0000", 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.831e-06 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837133+0000", 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8929999999999994e-06 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837138+0000", 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2009999999999998e-06 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837193+0000", 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4608000000000003e-05 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837212+0000", 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9559999999999999e-05 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:196620 5.9 5.bc71b49 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.837369+0000", 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00050883899999999997, 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001078486, 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 196620 2024-09-20T21:02:53.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837369+0000", 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837369+0000", 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837370+0000", 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2500000000000004e-07 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837375+0000", 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.707e-06 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837390+0000", 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5797000000000001e-05 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837404+0000", 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3196e-05 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:196621 5.f 5.367ff8bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.837416+0000", 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00046207600000000001, 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010794330000000001, 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.879 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 196621 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837416+0000", 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837416+0000", 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837416+0000", 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.32e-07 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837419+0000", 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6560000000000001e-06 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837425+0000", 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4139999999999999e-06 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837430+0000", 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8500000000000002e-06 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:196622 5.d 5:b6e18a30:::benchmark_data_smithi112_23632_object64518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:53.837726+0000", 2024-09-20T21:02:53.882 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00015226500000000001, 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00082223699999999997, 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 196622 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837726+0000", 2024-09-20T21:02:53.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837726+0000", 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837726+0000", 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3600000000000003e-07 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:53.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837730+0000", 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3890000000000001e-06 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837738+0000", 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7129999999999994e-06 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837744+0000", 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5999999999999997e-06 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837802+0000", 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7781999999999997e-05 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:53.837949+0000", 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000147174 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:53.886 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 11 2024-09-20T21:02:53.887 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:53.887 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:53.888 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:53.888 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:53.889 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:53.889 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:53.884+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:53.905 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:53.905 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:53.908 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:53.909 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:53.989 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:53.984+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:54.084 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:54.085 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:54.090 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:54.084+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:54.105 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:54.191 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:54.184+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:54.254 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:02:54.289 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:54.289 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:54.291 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:54.288+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:54.308 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:54.392 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:54.388+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:54.466 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:54.466 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:54.487 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:54.528 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:54.524+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:54.595 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:54.588+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:54.679 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:54.679 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:54.696 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:54.692+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:54.699 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:54.796 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:54.792+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:54.895 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:54.895 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:54.897 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:54.892+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:54.916 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:54.998 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:54.992+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:55.065 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:55.065 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:55.084 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:55.099 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:55.092+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:55.147 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:02:55.199 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:55.196+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:55.235 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:55.235 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:55.254 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:55.301 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:55.296+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:55.401 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:55.396+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:55.451 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:55.451 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:55.472 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:55.516 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:55.512+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:55.602 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:55.600+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:55.631 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:55.631 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:55.651 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:55.703 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:55.700+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:55.804 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:55.800+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:55.849 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:55.849 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:55.868 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:55.905 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:55.900+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:55.910 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:02:56.006 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:56.000+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:56.020 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:56.020 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:56.040 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:56.066 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:56.067 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:56.067 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:56.085 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:56.085 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:56.088 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:56.088 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:56.108 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:56.104+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:56.194 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:56.194 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:56.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:202729 5.4 e61/38 5:2f4e0e94:::benchmark_data_smithi112_23632_object70625:head v 61'12819, mlcod=61'12817)", 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.192426+0000", 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001104357, 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001126515, 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192426+0000", 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192426+0000", 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192427+0000", 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1099999999999995e-07 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192443+0000", 2024-09-20T21:02:56.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6297999999999999e-05 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192454+0000", 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0655999999999999e-05 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192461+0000", 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9759999999999998e-06 2024-09-20T21:02:56.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192511+0000", 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0102999999999998e-05 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192524+0000", 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3624e-05 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:202728 5.a e61/21 5:561cad23:::benchmark_data_smithi112_23632_object70624:head v 61'12643, mlcod=61'12641)", 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.192478+0000", 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001052498, 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0011392010000000001, 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192478+0000", 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192478+0000", 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192478+0000", 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.0600000000000001e-07 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192482+0000", 2024-09-20T21:02:56.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.703e-06 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192488+0000", 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9460000000000003e-06 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192493+0000", 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0459999999999996e-06 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.201 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.193508+0000", 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001015691 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.193533+0000", 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4992999999999999e-05 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:202730 5.8 e61/38)", 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.192863+0000", 2024-09-20T21:02:56.202 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00066679800000000002, 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00081225199999999996, 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192863+0000", 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192863+0000", 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192864+0000", 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9599999999999999e-07 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192868+0000", 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3889999999999998e-06 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192878+0000", 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4560000000000006e-06 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192883+0000", 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9590000000000003e-06 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.205 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:202712 5.9 5:9f105ac8:::benchmark_data_smithi112_23632_object70608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.187562+0000", 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0059679800000000003, 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061738339999999996, 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 202712 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.206 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187562+0000", 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187562+0000", 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187563+0000", 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6099999999999999e-07 2024-09-20T21:02:56.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187569+0000", 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4550000000000003e-06 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187581+0000", 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2347999999999999e-05 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187590+0000", 2024-09-20T21:02:56.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4849999999999992e-06 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187654+0000", 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4249000000000001e-05 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187776+0000", 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000122562 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:202714 5.9 5:9aebea6a:::benchmark_data_smithi112_23632_object70610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.187633+0000", 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.005896976, 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061743070000000004, 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 202714 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.210 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187633+0000", 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187633+0000", 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187634+0000", 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2300000000000002e-07 2024-09-20T21:02:56.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187636+0000", 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4399999999999999e-06 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187643+0000", 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1289999999999998e-06 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187649+0000", 2024-09-20T21:02:56.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1600000000000003e-06 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189754+0000", 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0021049860000000001 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189900+0000", 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014585800000000001 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:202715 5.9 5:95fb9a89:::benchmark_data_smithi112_23632_object70611:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.187659+0000", 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.005871678, 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0062200559999999998, 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 202715 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.214 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187659+0000", 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187659+0000", 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187659+0000", 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8299999999999997e-07 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187662+0000", 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.745e-06 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187670+0000", 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8809999999999996e-06 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.187675+0000", 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7529999999999998e-06 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.191730+0000", 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040543740000000003 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.191914+0000", 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000184339 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.217 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:202724 5.9 5:9bdd7fa1:::benchmark_data_smithi112_23632_object70620:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.188313+0000", 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0052176100000000001, 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0056428219999999996, 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 202724 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.218 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.188313+0000", 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.188313+0000", 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.188313+0000", 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4099999999999997e-07 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.188318+0000", 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4619999999999998e-06 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.188327+0000", 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9889999999999998e-06 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.188334+0000", 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0149999999999998e-06 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.193550+0000", 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0052156800000000003 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.193695+0000", 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014541000000000001 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.221 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:202725 5.0 5:04cd19c6:::benchmark_data_smithi112_23632_object70621:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.189660+0000", 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0038703869999999999, 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0043624689999999999, 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.222 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 202725 2024-09-20T21:02:56.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.223 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189660+0000", 2024-09-20T21:02:56.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189660+0000", 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189661+0000", 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2399999999999996e-07 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189666+0000", 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8319999999999996e-06 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189684+0000", 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8487000000000001e-05 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189691+0000", 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.657e-06 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189750+0000", 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9735000000000003e-05 2024-09-20T21:02:56.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189861+0000", 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011027900000000001 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.189978+0000", 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000117534 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:202727 5.8 e61/38 5:1b02bba4:::benchmark_data_smithi112_23632_object70623:head v 61'12698, mlcod=61'12696)", 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.191162+0000", 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0023677360000000001, 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029377750000000001, 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.191162+0000", 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.191162+0000", 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.191163+0000", 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8100000000000003e-07 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.191168+0000", 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5800000000000002e-06 2024-09-20T21:02:56.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.191176+0000", 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3799999999999994e-06 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.191181+0000", 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6609999999999999e-06 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192096+0000", 2024-09-20T21:02:56.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00091565899999999998 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192109+0000", 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2276000000000001e-05 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:202734 5.9 5.32c53519 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.192142+0000", 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0013878079999999999, 2024-09-20T21:02:56.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020159599999999998, 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 202734 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192142+0000", 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192142+0000", 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192143+0000", 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8700000000000004e-07 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192148+0000", 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7910000000000004e-06 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192160+0000", 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2126e-05 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192168+0000", 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1850000000000004e-06 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:202735 5.d 5:be51c8bc:::benchmark_data_smithi112_23632_object70631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.192194+0000", 2024-09-20T21:02:56.233 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0013366389999999999, 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020195059999999999, 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 202735 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192194+0000", 2024-09-20T21:02:56.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192194+0000", 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192194+0000", 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1900000000000002e-07 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192198+0000", 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7759999999999999e-06 2024-09-20T21:02:56.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192207+0000", 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5669999999999995e-06 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192212+0000", 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8270000000000003e-06 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192266+0000", 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3925000000000003e-05 2024-09-20T21:02:56.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192410+0000", 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000143953 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:202736 5.0 5:0f787ad6:::benchmark_data_smithi112_23632_object70632:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.192226+0000", 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0013037789999999999, 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002049632, 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.237 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 202736 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192226+0000", 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192226+0000", 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192227+0000", 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1699999999999998e-07 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192230+0000", 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5600000000000001e-06 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192238+0000", 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4430000000000003e-06 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192244+0000", 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1430000000000003e-06 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.193724+0000", 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0014801930000000001 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.193853+0000", 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012871700000000001 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.193974+0000", 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121229 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.241 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:202737 5.0 5.5121e740 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:56.192413+0000", 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0011168529999999999, 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019284300000000001, 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 202737 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.242 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192413+0000", 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192413+0000", 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192414+0000", 2024-09-20T21:02:56.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4899999999999995e-07 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192417+0000", 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1360000000000001e-06 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192424+0000", 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0180000000000004e-06 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:56.192429+0000", 2024-09-20T21:02:56.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4259999999999996e-06 2024-09-20T21:02:56.245 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.245 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.245 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.245 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.245 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:56.245 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 13 2024-09-20T21:02:56.245 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:56.246 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:56.247 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:56.240+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:56.347 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:56.344+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:56.439 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:56.440 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:56.440 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:56.440 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:56.440 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:56.448 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:56.444+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:56.457 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:56.548 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:56.544+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:56.648 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:56.648 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:56.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:56.648 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:56.648 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 104.450083384, 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.649 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:56.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.652 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.653 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:56.654 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 104.44999334800001, 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:56.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:56.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:56.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:56.659 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 104.44990699500001, 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.660 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.661 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.662 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.663 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.664 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.665 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 104.44983818599999, 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.666 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.667 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.668 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.669 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.670 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:56.671 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 104.449805326, 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:56.672 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.673 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:56.674 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.675 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.676 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.677 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.678 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 104.44976330900001, 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.679 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.680 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:56.681 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:56.682 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.683 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 104.44963820300001, 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:56.686 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:56.687 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:56.688 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.689 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.690 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 104.44954585399999, 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.691 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.692 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.693 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:56.694 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:56.695 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 104.449461482, 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.696 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:56.697 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:56.698 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.699 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 65.684002026000002, 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.700 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.701 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.702 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.703 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:56.704 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.705 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 65.683450019999995, 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.706 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.707 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:56.708 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:56.709 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:56.710 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 65.682822439000006, 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.712 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.713 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:56.714 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.715 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:56.716 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.717 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:56.718 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 44.933088542999997, 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:56.719 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.720 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:56.722 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:56.723 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 44.928737618, 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:56.724 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:56.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:56.727 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.728 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:56.729 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 44.920495547000002, 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.730 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.731 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.732 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.733 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.734 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.9713662339999996, 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.736 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:02:56.737 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:02:56.738 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:02:56.739 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.740 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.9654496669999997, 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.741 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.742 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.743 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.744 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:02:56.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:02:56.746 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.9621800489999996, 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.747 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.748 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.749 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.750 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.751 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:02:56.752 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.9616795280000003, 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.753 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:02:56.754 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.755 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:02:56.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4.9615242420000003, 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:02:56.758 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.759 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:02:56.760 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.761 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.762 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:02:56.763 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.764 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.764 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.764 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:56.764 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:56.764 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:56.765 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:56.766 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:56.760+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:56.865 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:56.860+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:204565 5.a 5:521e9284:::benchmark_data_smithi112_23632_object72461:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:56.910478+0000", 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0055612730000000003, 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0055963310000000004, 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:56.917 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 204565 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.910478+0000", 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.910478+0000", 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.910480+0000", 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6129999999999998e-06 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.910483+0000", 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0029999999999999e-06 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.910491+0000", 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5089999999999996e-06 2024-09-20T21:02:56.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.910496+0000", 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.339e-06 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913953+0000", 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034564159999999999 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.914047+0000", 2024-09-20T21:02:56.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4456999999999994e-05 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.914126+0000", 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8286000000000002e-05 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916045+0000", 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019190139999999999 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:204572 5.7 5:e29e3643:::benchmark_data_smithi112_23632_object72468:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:56.913716+0000", 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0023232869999999998, 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0024515629999999999, 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.922 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 204572 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913716+0000", 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913716+0000", 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913717+0000", 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.308e-06 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913721+0000", 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2200000000000003e-06 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913738+0000", 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6920999999999999e-05 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913745+0000", 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9199999999999998e-06 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913797+0000", 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1286000000000003e-05 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913879+0000", 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2405999999999997e-05 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916092+0000", 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022131780000000001 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916138+0000", 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5942999999999997e-05 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:204571 5.b e61/21 5:d874dfeb:::benchmark_data_smithi112_23632_object72467:head v 61'13062, mlcod=61'13059)", 2024-09-20T21:02:56.926 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:56.913912+0000", 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002127079, 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023401910000000001, 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913912+0000", 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913912+0000", 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913913+0000", 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3499999999999996e-07 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913918+0000", 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9289999999999997e-06 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913926+0000", 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6440000000000006e-06 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.913933+0000", 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4359999999999999e-06 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.914119+0000", 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185978 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.914136+0000", 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7285000000000001e-05 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:204576 5.4 5:2cd96a44:::benchmark_data_smithi112_23632_object72472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:56.915892+0000", 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00014711300000000001, 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042489900000000001, 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:56.930 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 204576 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915892+0000", 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915892+0000", 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915893+0000", 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0890000000000001e-06 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915897+0000", 2024-09-20T21:02:56.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9870000000000001e-06 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915907+0000", 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4790000000000002e-06 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915912+0000", 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0000000000000004e-06 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915954+0000", 2024-09-20T21:02:56.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2855999999999998e-05 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916065+0000", 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110973 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916150+0000", 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4448000000000002e-05 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:204577 5.c 5:3557307e:::benchmark_data_smithi112_23632_object72473:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:56.915925+0000", 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000113789, 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000431144, 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 204577 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.935 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915925+0000", 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915925+0000", 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915926+0000", 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.75e-07 2024-09-20T21:02:56.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915929+0000", 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7410000000000001e-06 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915934+0000", 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8769999999999998e-06 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915938+0000", 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1949999999999999e-06 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915986+0000", 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8285000000000003e-05 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916142+0000", 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015588099999999999 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:204581 5.4 5.244e8e94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:56.938 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:56.915967+0000", 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 7.2162000000000005e-05, 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000422013, 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 204581 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915967+0000", 2024-09-20T21:02:56.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915967+0000", 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915968+0000", 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4099999999999998e-07 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915970+0000", 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.605e-06 2024-09-20T21:02:56.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915982+0000", 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1698e-05 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.915987+0000", 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0749999999999997e-06 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:204574 5.b e61/21)", 2024-09-20T21:02:56.941 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:56.916060+0000", 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9999795, 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035676799999999998, 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916060+0000", 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:56.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916060+0000", 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916061+0000", 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1379999999999999e-06 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916067+0000", 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1449999999999996e-06 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:56.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916084+0000", 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6974999999999999e-05 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:56.916089+0000", 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4979999999999997e-06 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 7 2024-09-20T21:02:56.944 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:56.945 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:56.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-09-20T21:02:56.967 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:56.964+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:57.068 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:57.064+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:57.138 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:57.138 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:02:57.138 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:02:57.138 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:02:57.139 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:57.159 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:57.169 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:57.164+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:57.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:02:57.270 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:57.268+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:57.353 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:57.353 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:02:57.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:02:57.353 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:57.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.353 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:57.353 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:57.353 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 105.156605687, 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:02:57.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:02:57.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 105.15638115599999, 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:02:57.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:02:57.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:02:57.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6766867679999997, 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.366 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:02:57.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:02:57.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6763525430000001, 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.372 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:57.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6760937259999995, 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:02:57.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.674478809, 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:02:57.382 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:02:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:02:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6721608889999997, 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:02:57.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:57.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.393 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6701327959999999, 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:57.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6700081559999997, 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.398 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:02:57.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6679998390000002, 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.403 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:02:57.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.66693918, 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:02:57.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6667453559999998, 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6666687219999998, 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.417 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:02:57.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:02:57.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6665975189999997, 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.422 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:02:57.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6662823229999999, 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.428 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:02:57.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.664875587, 2024-09-20T21:02:57.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:02:57.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:02:57.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:02:57.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6646217290000003, 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.437 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:02:57.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.441 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6640370019999997, 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.445 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6640147499999998, 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:02:57.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6629472820000002, 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:57.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:02:57.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:02:57.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:02:57.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.455 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:57.455 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:57.455 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:57.456 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:57.457 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:57.452+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:57.556 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:57.552+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:57.611 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:57.611 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:57.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:206388 5.9 5:972ca73b:::benchmark_data_smithi112_23632_object74284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.609276+0000", 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00094544500000000005, 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00096873, 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 206388 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.612 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609276+0000", 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609276+0000", 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609277+0000", 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2900000000000002e-07 2024-09-20T21:02:57.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609281+0000", 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3359999999999997e-06 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609294+0000", 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2584e-05 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609301+0000", 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2269999999999996e-06 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609339+0000", 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8379e-05 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609412+0000", 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2725000000000006e-05 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.615 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:206389 5.b 5.2c7c3c6b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.609315+0000", 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00090613800000000002, 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00099833499999999993, 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:57.616 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 206389 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609315+0000", 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609315+0000", 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609316+0000", 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3700000000000001e-07 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609318+0000", 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2060000000000001e-06 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.618 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609324+0000", 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2140000000000001e-06 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609329+0000", 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6739999999999996e-06 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:206391 5.b 5.1ee3d46b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.609335+0000", 2024-09-20T21:02:57.619 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00088619600000000001, 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010298149999999999, 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 206391 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609335+0000", 2024-09-20T21:02:57.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609335+0000", 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609335+0000", 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5699999999999998e-07 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.621 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609337+0000", 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9570000000000001e-06 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609343+0000", 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5049999999999998e-06 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609347+0000", 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4379999999999997e-06 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.622 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:206373 5.b 5:df13126c:::benchmark_data_smithi112_23632_object74269:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.603380+0000", 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0068413670000000001, 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0070392040000000003, 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 206373 2024-09-20T21:02:57.623 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603380+0000", 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603380+0000", 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.624 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603381+0000", 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1200000000000001e-07 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603385+0000", 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7119999999999999e-06 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603394+0000", 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9109999999999999e-06 2024-09-20T21:02:57.625 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603403+0000", 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1960000000000008e-06 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603456+0000", 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3593e-05 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:57.626 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603599+0000", 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000143029 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603661+0000", 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1946999999999995e-05 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:206374 5.b 5:d3d48ec0:::benchmark_data_smithi112_23632_object74270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.603492+0000", 2024-09-20T21:02:57.627 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0067288920000000002, 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0069963289999999999, 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 206374 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603492+0000", 2024-09-20T21:02:57.628 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603492+0000", 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603493+0000", 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.043e-06 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603500+0000", 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3110000000000002e-06 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603509+0000", 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1560000000000001e-06 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.603515+0000", 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9519999999999999e-06 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.630 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605495+0000", 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019800989999999999 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605623+0000", 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000128548 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605730+0000", 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010611999999999999 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.631 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:206375 5.b 5:df6dd098:::benchmark_data_smithi112_23632_object74271:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.604482+0000", 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0057387280000000002, 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0060736949999999996, 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.632 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 206375 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.604482+0000", 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.604482+0000", 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.633 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.604483+0000", 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7000000000000003e-07 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.604488+0000", 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5190000000000003e-06 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.604501+0000", 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3461e-05 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.634 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.604508+0000", 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7950000000000002e-06 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607743+0000", 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0032345550000000001 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607889+0000", 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014639399999999999 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.635 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608008+0000", 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118613 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:206365 5.8 e61/38 5:16f8c606:::benchmark_data_smithi112_23632_object74261:head v 61'12915, mlcod=61'12911)", 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.605236+0000", 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0049852270000000001, 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00538793, 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.636 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605236+0000", 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605236+0000", 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.637 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605237+0000", 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4600000000000004e-07 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605242+0000", 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1830000000000002e-06 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605252+0000", 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0163000000000001e-05 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.638 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605260+0000", 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6680000000000001e-06 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605305+0000", 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5053999999999999e-05 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.605324+0000", 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9330999999999998e-05 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.639 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:206380 5.b 5:de0b8fee:::benchmark_data_smithi112_23632_object74276:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.607343+0000", 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002878163, 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0033400309999999998, 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.640 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 206380 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607343+0000", 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607343+0000", 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.641 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607344+0000", 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0699999999999996e-07 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607352+0000", 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3080000000000008e-06 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607365+0000", 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2523e-05 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607372+0000", 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1350000000000003e-06 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609682+0000", 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023104639999999999 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609774+0000", 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1945000000000001e-05 2024-09-20T21:02:57.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609839+0000", 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4987999999999995e-05 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:206382 5.0 5:04ffc1a5:::benchmark_data_smithi112_23632_object74278:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.607386+0000", 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0028356560000000002, 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0033770190000000002, 2024-09-20T21:02:57.644 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 206382 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607386+0000", 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.645 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607386+0000", 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607386+0000", 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6599999999999996e-07 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607389+0000", 2024-09-20T21:02:57.646 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1350000000000001e-06 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607396+0000", 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1330000000000001e-06 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607403+0000", 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4439999999999996e-06 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:57.647 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607465+0000", 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2008999999999995e-05 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607541+0000", 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6515999999999997e-05 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607622+0000", 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0919000000000002e-05 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.648 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:206385 5.b 5.cc01a8eb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.607871+0000", 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002350315, 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029574810000000001, 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.649 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 206385 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607871+0000", 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607871+0000", 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607872+0000", 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4399999999999998e-07 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607877+0000", 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7419999999999997e-06 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607888+0000", 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1892000000000001e-05 2024-09-20T21:02:57.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607895+0000", 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6050000000000003e-06 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:206386 5.0 5:0d8eafda:::benchmark_data_smithi112_23632_object74282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.607907+0000", 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0023138669999999998, 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029758670000000001, 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.652 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 206386 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607907+0000", 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.653 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607907+0000", 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607908+0000", 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9299999999999999e-07 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607910+0000", 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2170000000000001e-06 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.654 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607916+0000", 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1210000000000003e-06 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.607921+0000", 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6059999999999996e-06 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609476+0000", 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001555173 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.655 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609590+0000", 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114207 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609699+0000", 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010880800000000001 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.656 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:206383 5.8 e61/38 5:18679c99:::benchmark_data_smithi112_23632_object74279:head v 61'12916, mlcod=61'12913)", 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.608541+0000", 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0016799079999999999, 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024104059999999999, 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608541+0000", 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.657 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608541+0000", 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608542+0000", 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608548+0000", 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0140000000000004e-06 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.658 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608560+0000", 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1936000000000001e-05 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608567+0000", 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.267e-06 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609467+0000", 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00090015500000000003 2024-09-20T21:02:57.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.609486+0000", 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8856e-05 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:206373 5.b e61/21)", 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.608580+0000", 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001640928, 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002423237, 2024-09-20T21:02:57.660 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608580+0000", 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608580+0000", 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.661 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608581+0000", 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4900000000000001e-07 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608583+0000", 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8049999999999998e-06 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608592+0000", 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3489999999999992e-06 2024-09-20T21:02:57.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608597+0000", 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1200000000000001e-06 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:206374 5.b e61/21)", 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:57.608604+0000", 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0016168759999999999, 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0024406950000000001, 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:57.663 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608604+0000", 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608604+0000", 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608605+0000", 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0699999999999999e-07 2024-09-20T21:02:57.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608606+0000", 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8619999999999999e-06 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608628+0000", 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1353999999999999e-05 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:57.608634+0000", 2024-09-20T21:02:57.665 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.365e-06 2024-09-20T21:02:57.666 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.666 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:57.666 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.666 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:57.666 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:02:57.666 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 14 2024-09-20T21:02:57.666 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:57.668 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:57.668 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:57.664+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:57.768 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:57.764+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:57.862 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:57.862 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:02:57.862 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:02:57.862 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:02:57.862 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:57.869 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:57.864+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:57.879 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:57.971 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:57.968+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:58.071 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:58.068+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:58.076 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:02:58.076 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:02:58.076 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:02:58.076 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:02:58.076 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 105.877972367, 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.077 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:02:58.078 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.080 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:02:58.082 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 105.877882331, 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.083 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:02:58.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:02:58.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:02:58.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.088 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 105.87779597799999, 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.089 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.090 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:02:58.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:58.095 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 105.877727169, 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:58.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:02:58.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 105.87769430900001, 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:02:58.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.107 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 105.87765229199999, 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.108 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:02:58.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:02:58.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.113 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 105.87752718599999, 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.114 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:02:58.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.118 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:02:58.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 105.877434837, 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:02:58.120 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:02:58.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:02:58.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 105.87735046500001, 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:02:58.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.129 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 67.111891009000004, 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.130 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:02:58.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:02:58.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 67.111339002999998, 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.136 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.137 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:02:58.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:02:58.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:02:58.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:02:58.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:02:58.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:02:58.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 67.110711421999994, 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.143 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:02:58.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:02:58.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:02:58.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.360977525999999, 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.149 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:02:58.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.154 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.356626601000002, 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.155 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:02:58.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 46.348384529999997, 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:02:58.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.166 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 6.3992552170000003, 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:02:58.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:02:58.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:02:58.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 6.3933386500000005, 2024-09-20T21:02:58.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:02:58.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 6.3900690319999995, 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.178 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:02:58.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:02:58.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 6.3895685110000002, 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.184 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:02:58.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:02:58.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 6.3894132250000002, 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.190 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:02:58.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:02:58.195 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:02:58.196 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:02:58.198 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:02:58.198 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:58.192+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:58.198 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:58.298 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:58.296+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:58.352 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:02:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:02:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:208277 5.4 5:2c1582fc:::benchmark_data_smithi112_23632_object76173:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-20T21:02:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.347389+0000", 2024-09-20T21:02:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0034549310000000001, 2024-09-20T21:02:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034796879999999999, 2024-09-20T21:02:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208277 2024-09-20T21:02:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347389+0000", 2024-09-20T21:02:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347389+0000", 2024-09-20T21:02:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347390+0000", 2024-09-20T21:02:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1790000000000001e-06 2024-09-20T21:02:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347395+0000", 2024-09-20T21:02:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1070000000000004e-06 2024-09-20T21:02:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347406+0000", 2024-09-20T21:02:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0339999999999999e-05 2024-09-20T21:02:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347413+0000", 2024-09-20T21:02:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.289e-06 2024-09-20T21:02:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347466+0000", 2024-09-20T21:02:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2741000000000002e-05 2024-09-20T21:02:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347573+0000", 2024-09-20T21:02:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107254 2024-09-20T21:02:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347669+0000", 2024-09-20T21:02:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6471999999999994e-05 2024-09-20T21:02:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:208279 5.8 5:1cea39e6:::benchmark_data_smithi112_23632_object76175:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-20T21:02:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.347435+0000", 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0034091080000000001, 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035090630000000002, 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208279 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347435+0000", 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347435+0000", 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347435+0000", 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0900000000000002e-07 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347438+0000", 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0649999999999999e-06 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347447+0000", 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1449999999999997e-06 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347453+0000", 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.614e-06 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347516+0000", 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2495000000000004e-05 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347641+0000", 2024-09-20T21:02:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012528699999999999 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347753+0000", 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011205999999999999 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:208282 5.6 5:69edf143:::benchmark_data_smithi112_23632_object76178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.347757+0000", 2024-09-20T21:02:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0030871589999999999, 2024-09-20T21:02:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032586189999999999, 2024-09-20T21:02:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208282 2024-09-20T21:02:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347757+0000", 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347757+0000", 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347758+0000", 2024-09-20T21:02:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9999999999999996e-07 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347762+0000", 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4850000000000003e-06 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347771+0000", 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1740000000000006e-06 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347778+0000", 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8619999999999997e-06 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.347847+0000", 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9282000000000005e-05 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.348009+0000", 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016203499999999999 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:208284 5.4 5:20ac3d43:::benchmark_data_smithi112_23632_object76180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-20T21:02:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.349692+0000", 2024-09-20T21:02:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0011520250000000001, 2024-09-20T21:02:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013844090000000001, 2024-09-20T21:02:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208284 2024-09-20T21:02:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349692+0000", 2024-09-20T21:02:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349692+0000", 2024-09-20T21:02:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349693+0000", 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0729999999999999e-06 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349698+0000", 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9289999999999997e-06 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349706+0000", 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8769999999999993e-06 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349711+0000", 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0470000000000001e-06 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349766+0000", 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5392000000000001e-05 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349896+0000", 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013015100000000001 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350021+0000", 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124523 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:208286 5.8 5:1d0db806:::benchmark_data_smithi112_23632_object76182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.349835+0000", 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001008522, 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001308399, 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208286 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349835+0000", 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349835+0000", 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349836+0000", 2024-09-20T21:02:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0299999999999999e-07 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349839+0000", 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.129e-06 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349850+0000", 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0428000000000001e-05 2024-09-20T21:02:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349856+0000", 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.742e-06 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.349909+0000", 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2383999999999999e-05 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350066+0000", 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015771000000000001 2024-09-20T21:02:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350176+0000", 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109807 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:208287 5.2 5:4579678f:::benchmark_data_smithi112_23632_object76183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.350032+0000", 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00081150500000000002, 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011787569999999999, 2024-09-20T21:02:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208287 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350032+0000", 2024-09-20T21:02:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350032+0000", 2024-09-20T21:02:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350033+0000", 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8400000000000003e-07 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350037+0000", 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9879999999999998e-06 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350046+0000", 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3190000000000001e-06 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350053+0000", 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1979999999999998e-06 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350161+0000", 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010837599999999999 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350274+0000", 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011281399999999999 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:208288 5.8 5.9f61b668 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.350071+0000", 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00077326100000000002, 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011989119999999999, 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208288 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350071+0000", 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350071+0000", 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350071+0000", 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8100000000000003e-07 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350074+0000", 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9699999999999999e-06 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350081+0000", 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3989999999999998e-06 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350087+0000", 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5289999999999999e-06 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:208289 5.c 5.6260241c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-20T21:02:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.350097+0000", 2024-09-20T21:02:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000746632, 2024-09-20T21:02:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012228989999999999, 2024-09-20T21:02:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208289 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350097+0000", 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350097+0000", 2024-09-20T21:02:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350098+0000", 2024-09-20T21:02:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6100000000000001e-07 2024-09-20T21:02:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350100+0000", 2024-09-20T21:02:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.604e-06 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350107+0000", 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7920000000000004e-06 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350112+0000", 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7870000000000001e-06 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:208285 5.0 e62/21 5:098d1307:::benchmark_data_smithi112_23632_object76181:head v 62'12978, mlcod=62'12975)", 2024-09-20T21:02:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.350221+0000", 2024-09-20T21:02:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00062261399999999996, 2024-09-20T21:02:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011500900000000001, 2024-09-20T21:02:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350221+0000", 2024-09-20T21:02:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350221+0000", 2024-09-20T21:02:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350222+0000", 2024-09-20T21:02:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2500000000000005e-07 2024-09-20T21:02:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350227+0000", 2024-09-20T21:02:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9799999999999998e-06 2024-09-20T21:02:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350235+0000", 2024-09-20T21:02:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2309999999999996e-06 2024-09-20T21:02:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350241+0000", 2024-09-20T21:02:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.84e-06 2024-09-20T21:02:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.351268+0000", 2024-09-20T21:02:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001026924 2024-09-20T21:02:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.351285+0000", 2024-09-20T21:02:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7167999999999999e-05 2024-09-20T21:02:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:208281 5.e e62/21 5:74d17b23:::benchmark_data_smithi112_23632_object76177:head v 62'13026, mlcod=62'13023)", 2024-09-20T21:02:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.350262+0000", 2024-09-20T21:02:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00058193899999999996, 2024-09-20T21:02:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011626710000000001, 2024-09-20T21:02:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350262+0000", 2024-09-20T21:02:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350262+0000", 2024-09-20T21:02:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350262+0000", 2024-09-20T21:02:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9299999999999999e-07 2024-09-20T21:02:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350266+0000", 2024-09-20T21:02:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9539999999999998e-06 2024-09-20T21:02:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350273+0000", 2024-09-20T21:02:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7349999999999999e-06 2024-09-20T21:02:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350278+0000", 2024-09-20T21:02:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.916e-06 2024-09-20T21:02:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350320+0000", 2024-09-20T21:02:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2058999999999998e-05 2024-09-20T21:02:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350338+0000", 2024-09-20T21:02:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7903000000000001e-05 2024-09-20T21:02:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:208290 5.8 5.a36dd838 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-20T21:02:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.350331+0000", 2024-09-20T21:02:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00051245800000000003, 2024-09-20T21:02:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001145077, 2024-09-20T21:02:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:02:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:02:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:02:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:02:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208290 2024-09-20T21:02:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350331+0000", 2024-09-20T21:02:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350331+0000", 2024-09-20T21:02:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350332+0000", 2024-09-20T21:02:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3e-07 2024-09-20T21:02:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350336+0000", 2024-09-20T21:02:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4000000000000001e-06 2024-09-20T21:02:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350344+0000", 2024-09-20T21:02:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2800000000000003e-06 2024-09-20T21:02:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.350350+0000", 2024-09-20T21:02:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6910000000000002e-06 2024-09-20T21:02:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:208293 5.b e62/21 5:d4860065:::benchmark_data_smithi112_23632_object76189:head v 62'13298, mlcod=62'13296)", 2024-09-20T21:02:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:58.351177+0000", 2024-09-20T21:02:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9996672, 2024-09-20T21:02:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035092100000000002, 2024-09-20T21:02:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:02:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:02:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:02:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:02:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:02:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.351177+0000", 2024-09-20T21:02:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:02:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.351177+0000", 2024-09-20T21:02:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:02:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:02:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.351177+0000", 2024-09-20T21:02:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0900000000000002e-07 2024-09-20T21:02:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:02:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.351182+0000", 2024-09-20T21:02:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0999999999999997e-06 2024-09-20T21:02:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:02:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.351190+0000", 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6249999999999996e-06 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.351196+0000", 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7309999999999998e-06 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.351240+0000", 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3612000000000002e-05 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:02:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:02:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:58.351256+0000", 2024-09-20T21:02:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6623e-05 2024-09-20T21:02:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:02:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:02:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:02:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 12 2024-09-20T21:02:58.418 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:02:58.419 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:02:58.420 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:58.416+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:58.420 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:02:58.421 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:02:58.421 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:02:58.422 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:58.422 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:02:58.423 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:02:58.423 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:02:58.520 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:58.516+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:58.583 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:58.583 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:58.603 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:58.648 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:58.647+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:58.685 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-09-20T21:02:58.686 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:02:58.686 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-20T21:02:58.686 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.079575 2024-09-20T21:02:58.686 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.07957501894812724 2024-09-20T21:02:58.722 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:58.716+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:58.756 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:58.756 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:58.775 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:58.823 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:58.819+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:58.923 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:58.920+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:58.931 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:58.931 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:58.953 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:02:59.038 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:59.036+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:59.125 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:59.123+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:59.144 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:59.145 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:59.163 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:02:59.173 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.0 primary-affinity to 0.079575 (852152) 2024-09-20T21:02:59.226 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:59.223+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:59.323 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:59.323 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:59.326 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:59.324+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:59.336 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:02:59.427 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:59.423+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:59.455 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:59.455 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:59.466 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:02:59.528 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:59.524+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:59.622 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:59.622 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:59.629 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:59.627+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:59.635 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:02:59.730 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:59.727+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:59.782 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:59.782 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:59.795 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:02:59.836 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:02:59.835+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:02:59.925 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:02:59.925 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:02:59.931 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:02:59.928+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:02:59.939 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:00.032 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:00.028+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:00.106 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:00.106 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:00.120 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:00.163 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:00.160+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:00.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:03:00.234 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:00.228+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:00.306 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:00.307 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:00.326 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:00.372 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:00.371+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:00.424 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:03:00.435 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:00.431+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:00.489 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:00.489 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:00.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:00.536 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:00.532+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:00.566 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:00.567 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:00.567 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:00.583 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:00.584 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:00.586 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:00.587 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:00.637 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:00.635+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:00.711 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:00.711 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:03:00.711 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:03:00.711 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:03:00.712 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:00.732 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:00.738 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:00.732+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:00.839 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:00.835+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:00.939 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:00.935+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 108.74951447799999, 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 108.74928994699999, 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:00.953 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2695955590000008, 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:00.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:00.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:00.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:00.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2692613339999994, 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:00.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:00.966 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:00.966 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:00.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.966 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:00.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:00.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:00.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:00.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:00.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:00.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:00.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:00.971 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.972 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:00.972 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.972 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:00.972 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:00.972 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2690025170000006, 2024-09-20T21:03:00.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:00.973 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:00.973 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:00.973 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:00.973 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:00.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:00.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.977 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2673875999999993, 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:00.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:00.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:00.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:00.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2650696799999999, 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.984 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:00.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:00.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.990 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:00.990 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:00.990 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.263041587, 2024-09-20T21:03:00.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:00.990 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:00.990 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:00.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:00.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:00.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:00.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:00.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:00.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2629169470000008, 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:00.995 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:00.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:00.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:00.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:00.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:00.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:00.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:00.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:01.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:01.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:01.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:01.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:01.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2609086299999994, 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:01.001 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:01.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:01.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:01.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:01.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.005 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2598479709999992, 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2596541469999991, 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.010 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:01.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:01.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:01.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:01.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:01.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:01.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:01.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:01.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:01.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:01.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.017 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.017 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:01.017 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.259577513, 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:01.023 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:01.023 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2595063100000008, 2024-09-20T21:03:01.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:01.023 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.023 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:01.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:01.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.023 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:01.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.024 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:01.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:01.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:01.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:01.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:01.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:01.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:01.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:01.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:01.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:01.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:01.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:01.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:01.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:01.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:01.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:01.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:01.030 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.030 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.030 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2591911140000001, 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:01.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2577843780000002, 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.036 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:01.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.037 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:01.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:01.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:01.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:01.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:01.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:01.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:01.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2575305199999995, 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.042 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:01.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.047 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:01.047 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:01.047 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2569457929999999, 2024-09-20T21:03:01.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:01.047 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.047 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.047 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:01.047 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:01.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2569235410000008, 2024-09-20T21:03:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:01.052 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.052 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.052 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:01.052 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:01.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.055 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2558560730000004, 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.056 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:01.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:01.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:01.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:01.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:01.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.061 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.062 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:01.063 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:01.060+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:01.063 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:01.163 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:01.159+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:01.190 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:03:01.220 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:01.220 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:01.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.220 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:212825 5.e 5:7e834e8f:::benchmark_data_smithi112_23632_object80721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.220 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:01.215413+0000", 2024-09-20T21:03:01.220 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.003890077, 2024-09-20T21:03:01.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0039155090000000002, 2024-09-20T21:03:01.220 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 212825 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215413+0000", 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215413+0000", 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215414+0000", 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0500000000000002e-07 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215418+0000", 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3900000000000003e-06 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215431+0000", 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2493e-05 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215438+0000", 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1899999999999998e-06 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215475+0000", 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7069e-05 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215581+0000", 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106399 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215691+0000", 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010958 2024-09-20T21:03:01.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.219235+0000", 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035443050000000002 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:212826 5.d 5:b3ba9b83:::benchmark_data_smithi112_23632_object80722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:01.215453+0000", 2024-09-20T21:03:01.225 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0038498040000000001, 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0039585970000000003, 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 212826 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215453+0000", 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215453+0000", 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215454+0000", 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1200000000000003e-07 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215457+0000", 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8509999999999999e-06 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215464+0000", 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3259999999999998e-06 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215469+0000", 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4550000000000003e-06 2024-09-20T21:03:01.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215521+0000", 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1638000000000003e-05 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.215616+0000", 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4928999999999999e-05 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:212830 5.e 5:752862d6:::benchmark_data_smithi112_23632_object80726:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:01.216506+0000", 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002796804, 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029709300000000001, 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 212830 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216506+0000", 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216506+0000", 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216507+0000", 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8299999999999995e-07 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216512+0000", 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216524+0000", 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2231e-05 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216531+0000", 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1029999999999996e-06 2024-09-20T21:03:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.217506+0000", 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00097490499999999998 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.217616+0000", 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010938900000000001 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.217680+0000", 2024-09-20T21:03:01.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4070000000000002e-05 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:212831 5.b 5:d99dcbea:::benchmark_data_smithi112_23632_object80727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:01.216656+0000", 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0026467299999999999, 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0028892089999999998, 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.234 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 212831 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216656+0000", 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216656+0000", 2024-09-20T21:03:01.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216657+0000", 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0400000000000005e-07 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216664+0000", 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.443e-06 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216674+0000", 2024-09-20T21:03:01.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0594000000000001e-05 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216681+0000", 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7139999999999996e-06 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216735+0000", 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3604999999999999e-05 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216873+0000", 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013865200000000001 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.217003+0000", 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000130221 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:212832 5.f 5:f4c7afba:::benchmark_data_smithi112_23632_object80728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.238 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:01.216700+0000", 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0026031090000000002, 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029121630000000002, 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 212832 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216700+0000", 2024-09-20T21:03:01.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216700+0000", 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216700+0000", 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.15e-07 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.240 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216703+0000", 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8219999999999998e-06 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216710+0000", 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5729999999999996e-06 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216714+0000", 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6430000000000003e-06 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.217232+0000", 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00051720100000000001 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.217372+0000", 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000140161 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:212834 5.d 5:bee371fd:::benchmark_data_smithi112_23632_object80730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:01.216924+0000", 2024-09-20T21:03:01.242 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0023788490000000002, 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027494440000000002, 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 212834 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216924+0000", 2024-09-20T21:03:01.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216924+0000", 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216925+0000", 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6199999999999997e-07 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216929+0000", 2024-09-20T21:03:01.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7299999999999999e-06 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216938+0000", 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0850000000000003e-06 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.216943+0000", 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4700000000000001e-06 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.217733+0000", 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00078972999999999999 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.217872+0000", 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013889600000000001 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:212828 5.a e65/21 5:5435c905:::benchmark_data_smithi112_23632_object80724:head v 65'13314, mlcod=65'13310)", 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:01.219061+0000", 2024-09-20T21:03:01.246 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000241971, 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000673049, 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.219061+0000", 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.219061+0000", 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.219062+0000", 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.85e-07 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.219070+0000", 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7209999999999994e-06 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.219081+0000", 2024-09-20T21:03:01.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0743e-05 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.219088+0000", 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0829999999999998e-06 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.219144+0000", 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6747999999999999e-05 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:01.219162+0000", 2024-09-20T21:03:01.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7306e-05 2024-09-20T21:03:01.250 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.250 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.250 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.250 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.250 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:03:01.250 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 7 2024-09-20T21:03:01.250 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:01.251 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:01.295 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:01.292+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:01.367 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:01.363+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:01.407 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:01.407 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:01.407 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:03:01.407 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:03:01.407 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:01.426 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:01.466 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:01.463+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:01.568 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:01.564+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:01.629 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:01.686 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:03:01.686 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 109.430985866, 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:01.687 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.688 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.689 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:03:01.690 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.691 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:03:01.692 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 109.43089583, 2024-09-20T21:03:01.693 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.694 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:03:01.695 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:03:01.696 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.697 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.697 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.697 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:03:01.697 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:03:01.698 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.698 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.698 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.698 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:03:01.698 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:03:01.698 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.698 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.699 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.700 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 109.430809477, 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:01.701 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.702 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.703 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:03:01.704 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.705 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.706 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.707 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:01.708 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:01.708 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 109.430740668, 2024-09-20T21:03:01.708 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:03:01.709 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.709 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.710 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.711 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:01.712 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.713 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:03:01.714 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.715 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 109.43070780799999, 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.716 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:03:01.717 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.718 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.719 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:03:01.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:03:01.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 109.430665791, 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.722 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:03:01.723 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:03:01.724 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:03:01.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.725 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.725 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.725 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:03:01.725 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:03:01.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.725 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.725 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:01.725 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:03:01.725 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:01.726 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:03:01.727 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.728 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 109.430540685, 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.729 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.730 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:03:01.731 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.732 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.733 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:03:01.734 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 109.430448336, 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.735 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.736 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:03:01.738 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.739 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 109.43036396399999, 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.740 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.741 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:01.741 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.741 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.741 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.742 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.743 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:03:01.744 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 70.664904508000006, 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.745 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.746 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:03:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.748 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.749 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:03:01.750 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.751 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.751 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.751 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:03:01.751 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:03:01.751 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.751 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.751 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:03:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:03:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 70.664352502, 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.753 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.754 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.755 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.756 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.757 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.758 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.758 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:03:01.758 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:03:01.758 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.758 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.759 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.759 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:03:01.759 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:03:01.759 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.759 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.759 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.759 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.759 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 70.663724920999996, 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.760 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.761 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:03:01.762 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:01.762 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.762 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.762 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.762 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:03:01.762 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:03:01.762 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.762 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.762 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.763 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.764 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.765 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 49.913991025000001, 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.766 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.767 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.768 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.769 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.771 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 49.909640099999997, 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.772 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.773 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.774 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:01.777 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 49.901398028999999, 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.778 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.779 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.780 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:03:01.781 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:03:01.782 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.9522687160000007, 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:03:01.783 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:03:01.785 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:03:01.786 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:03:01.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.9463521489999991, 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.790 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.793 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.794 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.9430825309999999, 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.795 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.797 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:01.800 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.9425820100000006, 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:01.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:03:01.802 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.803 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.804 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.805 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 9.9424267240000006, 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:01.806 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:01.807 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:01.808 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.809 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.810 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.811 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.812 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.812 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:01.812 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:01.812 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:01.813 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:01.808+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:01.813 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:01.915 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:01.912+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:01.979 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:01.979 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:01.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.979 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:214745 5.2 5:4d54b5ba:::benchmark_data_smithi112_23632_object82641:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.979 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:01.972027+0000", 2024-09-20T21:03:01.979 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0058468219999999998, 2024-09-20T21:03:01.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0058667720000000001, 2024-09-20T21:03:01.979 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.980 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.980 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:01.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:01.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:01.981 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.981 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 214745 2024-09-20T21:03:01.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.981 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.972027+0000", 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.972027+0000", 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.972027+0000", 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9900000000000001e-07 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.972029+0000", 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3779999999999999e-06 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.972037+0000", 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.972042+0000", 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7090000000000001e-06 2024-09-20T21:03:01.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.972099+0000", 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7673000000000002e-05 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.972223+0000", 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012350300000000001 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:214748 5.2 5:44042b40:::benchmark_data_smithi112_23632_object82644:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:01.973654+0000", 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0042192990000000001, 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0042842150000000001, 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 214748 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.973654+0000", 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.973654+0000", 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.973655+0000", 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6400000000000003e-07 2024-09-20T21:03:01.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.973657+0000", 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.973664+0000", 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8789999999999997e-06 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.973670+0000", 2024-09-20T21:03:01.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7169999999999996e-06 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.974125+0000", 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00045517700000000002 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.974265+0000", 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000139901 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.988 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:214752 5.2 5:4d2becc7:::benchmark_data_smithi112_23632_object82648:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:01.976599+0000", 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0012744189999999999, 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013770029999999999, 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.989 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 214752 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.976599+0000", 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.976599+0000", 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.976600+0000", 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0669999999999999e-06 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.976605+0000", 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2519999999999999e-06 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.976637+0000", 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2123999999999999e-05 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.976646+0000", 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2409999999999995e-06 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.976699+0000", 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3829000000000002e-05 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.976831+0000", 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000131734 2024-09-20T21:03:01.992 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:214753 5.a 5.b08188a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:01.977128+0000", 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00074585299999999999, 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00088202199999999999, 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.993 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 214753 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977128+0000", 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977128+0000", 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977128+0000", 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2500000000000004e-07 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977133+0000", 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977144+0000", 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1090000000000001e-05 2024-09-20T21:03:01.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977152+0000", 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8380000000000002e-06 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:214756 5.5 5:aadd97ed:::benchmark_data_smithi112_23632_object82652:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:01.977261+0000", 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00061203899999999999, 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00080563399999999995, 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:01.996 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 214756 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977261+0000", 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977261+0000", 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977262+0000", 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4399999999999999e-07 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977266+0000", 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3669999999999999e-06 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977275+0000", 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0010000000000007e-06 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977282+0000", 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.596e-06 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977331+0000", 2024-09-20T21:03:01.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8532000000000002e-05 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977458+0000", 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012735399999999999 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:214758 5.6 5:69a338e1:::benchmark_data_smithi112_23632_object82654:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:01.977460+0000", 2024-09-20T21:03:02.000 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00041307900000000001, 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000644493, 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 214758 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977460+0000", 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977460+0000", 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977461+0000", 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0100000000000001e-06 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977465+0000", 2024-09-20T21:03:02.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9740000000000004e-06 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977480+0000", 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4785e-05 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977487+0000", 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0140000000000001e-06 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977562+0000", 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5191999999999994e-05 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977707+0000", 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145119 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:214760 5.6 5.4b2f76f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.004 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:01.977512+0000", 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00036100900000000003, 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00062557200000000002, 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 214760 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977512+0000", 2024-09-20T21:03:02.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977512+0000", 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977513+0000", 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.13e-07 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977516+0000", 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977525+0000", 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0800000000000006e-06 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977530+0000", 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9399999999999999e-06 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:214755 5.b e65/21 5:d6cdbd37:::benchmark_data_smithi112_23632_object82651:head v 65'13711, mlcod=65'13709)", 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:01.977551+0000", 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000322687, 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061667099999999995, 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977551+0000", 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977551+0000", 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977552+0000", 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8999999999999995e-07 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977558+0000", 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.066e-06 2024-09-20T21:03:02.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977565+0000", 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.216e-06 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977569+0000", 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.233e-06 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977618+0000", 2024-09-20T21:03:02.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8662000000000003e-05 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977646+0000", 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7903e-05 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:214762 5.a 5.27dd4f9a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:01.977752+0000", 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000121385, 2024-09-20T21:03:02.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000447188, 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 214762 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977752+0000", 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977752+0000", 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977753+0000", 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6500000000000008e-07 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977756+0000", 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.349e-06 2024-09-20T21:03:02.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977765+0000", 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9879999999999993e-06 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.977769+0000", 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1989999999999999e-06 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:214763 5.6 5.18681f96 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:01.978026+0000", 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9998469, 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000201418, 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 214763 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.978026+0000", 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.978026+0000", 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.978027+0000", 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6799999999999999e-07 2024-09-20T21:03:02.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.978031+0000", 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0300000000000004e-06 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.978043+0000", 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1917e-05 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:01.978050+0000", 2024-09-20T21:03:02.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8889999999999996e-06 2024-09-20T21:03:02.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.018 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.018 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:03:02.018 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 10 2024-09-20T21:03:02.018 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:02.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:02.020 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:02.016+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:02.120 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:02.116+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:02.173 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:02.173 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:03:02.173 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:03:02.173 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:03:02.173 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:02.191 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:02.236 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:02.235+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:02.324 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:02.319+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:02.346 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 110.148779275, 2024-09-20T21:03:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:02.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:02.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:02.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 110.14855474399999, 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:02.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.358 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.668860356, 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:02.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:02.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.364 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.668526131, 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:02.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:02.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.668267314, 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:02.370 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.374 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:02.375 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:02.375 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.666652397, 2024-09-20T21:03:02.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:02.375 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.375 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.375 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:02.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.664334477000001, 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.662306384000001, 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.662181744, 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.660173427, 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.659112768, 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.658918944, 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.658842310000001, 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.658771107, 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.658455911000001, 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.657049175000001, 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.656795317, 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.656210590000001, 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.656188338, 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.655120869999999, 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.449 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:02.449 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:02.449 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:02.450 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:02.451 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:02.447+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:02.550 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:02.547+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:02.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:03:02.608 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:02.608 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:02.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.608 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216367 5.9 5:9860de70:::benchmark_data_smithi112_23632_object84263:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.608 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.603154+0000", 2024-09-20T21:03:02.608 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0041742960000000001, 2024-09-20T21:03:02.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0041932250000000001, 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216367 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603154+0000", 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603154+0000", 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603154+0000", 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0999999999999999e-07 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603157+0000", 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.9560000000000002e-06 2024-09-20T21:03:02.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603166+0000", 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3469999999999999e-06 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603172+0000", 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0260000000000004e-06 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603221+0000", 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9790999999999998e-05 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603355+0000", 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013358000000000001 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216369 5.4 5:2138bf7d:::benchmark_data_smithi112_23632_object84265:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.603724+0000", 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0036041039999999999, 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036686119999999999, 2024-09-20T21:03:02.612 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.613 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.613 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:02.613 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.613 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.613 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.613 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216369 2024-09-20T21:03:02.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.613 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.613 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603724+0000", 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603724+0000", 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603725+0000", 2024-09-20T21:03:02.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6400000000000001e-07 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603729+0000", 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2549999999999999e-06 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603741+0000", 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2155e-05 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603747+0000", 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2779999999999999e-06 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603799+0000", 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1189000000000001e-05 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.616 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603924+0000", 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012570600000000001 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604007+0000", 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3222999999999999e-05 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606393+0000", 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002385458 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.617 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:216370 5.a e65/21 5:560a717e:::benchmark_data_smithi112_23632_object84266:head v 65'13545, mlcod=65'13543)", 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.604584+0000", 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0027441950000000001, 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0028527639999999998, 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.619 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604584+0000", 2024-09-20T21:03:02.619 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.619 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.619 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.619 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.619 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604584+0000", 2024-09-20T21:03:02.619 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.619 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604585+0000", 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2399999999999997e-07 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604591+0000", 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6549999999999998e-06 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604604+0000", 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2578000000000001e-05 2024-09-20T21:03:02.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604610+0000", 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5189999999999998e-06 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604668+0000", 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7652999999999998e-05 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604691+0000", 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.3411999999999999e-05 2024-09-20T21:03:02.621 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216375 5.e 5:750b8a6c:::benchmark_data_smithi112_23632_object84271:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.606240+0000", 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001088072, 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001228617, 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.622 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216375 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606240+0000", 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.623 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606240+0000", 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606241+0000", 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3379999999999999e-06 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606247+0000", 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.536e-06 2024-09-20T21:03:02.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606260+0000", 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2775000000000001e-05 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606268+0000", 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8710000000000003e-06 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606331+0000", 2024-09-20T21:03:02.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2331999999999999e-05 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606451+0000", 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000120399 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606568+0000", 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000117025 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.626 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.627 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.627 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.627 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.627 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216376 5.0 5:0d2f7ccb:::benchmark_data_smithi112_23632_object84272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.627 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.606364+0000", 2024-09-20T21:03:02.627 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00096393499999999997, 2024-09-20T21:03:02.627 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0011438240000000001, 2024-09-20T21:03:02.627 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.627 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.627 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216376 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606364+0000", 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.628 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606364+0000", 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606365+0000", 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.004e-06 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606373+0000", 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9910000000000002e-06 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606384+0000", 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0618000000000001e-05 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606391+0000", 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7190000000000001e-06 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.630 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606457+0000", 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5843e-05 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606573+0000", 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116024 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:02.631 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606687+0000", 2024-09-20T21:03:02.632 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113637 2024-09-20T21:03:02.632 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.632 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.632 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.632 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.632 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.633 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:216373 5.a e65/21 5:5a620425:::benchmark_data_smithi112_23632_object84269:head v 65'13546, mlcod=65'13543)", 2024-09-20T21:03:02.633 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.606484+0000", 2024-09-20T21:03:02.633 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00084371299999999995, 2024-09-20T21:03:02.633 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001060772, 2024-09-20T21:03:02.633 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.633 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.633 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:02.634 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.634 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.634 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.634 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606484+0000", 2024-09-20T21:03:02.634 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.634 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.634 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.635 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.635 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606484+0000", 2024-09-20T21:03:02.635 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.635 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.635 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.635 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.635 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606485+0000", 2024-09-20T21:03:02.635 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6599999999999996e-07 2024-09-20T21:03:02.636 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.636 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.636 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.636 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606490+0000", 2024-09-20T21:03:02.636 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4670000000000003e-06 2024-09-20T21:03:02.636 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.636 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.636 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.637 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606501+0000", 2024-09-20T21:03:02.637 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1046999999999999e-05 2024-09-20T21:03:02.637 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.637 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.637 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.637 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606508+0000", 2024-09-20T21:03:02.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9870000000000002e-06 2024-09-20T21:03:02.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.638 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.638 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.638 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606570+0000", 2024-09-20T21:03:02.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1696e-05 2024-09-20T21:03:02.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.639 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.639 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.639 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606592+0000", 2024-09-20T21:03:02.639 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2137000000000002e-05 2024-09-20T21:03:02.639 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.639 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.639 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.639 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216350 5.0 5:0ad09772:::benchmark_data_smithi112_23632_object84246:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.596601+0000", 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.010726615, 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01097564, 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216350 2024-09-20T21:03:02.640 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.641 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.641 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.641 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.641 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.596601+0000", 2024-09-20T21:03:02.641 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.596601+0000", 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.596602+0000", 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4300000000000003e-07 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.596605+0000", 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1549999999999999e-06 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.596613+0000", 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4789999999999999e-06 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.643 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.596617+0000", 2024-09-20T21:03:02.644 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3939999999999998e-06 2024-09-20T21:03:02.644 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.644 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.644 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.644 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600744+0000", 2024-09-20T21:03:02.644 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0041265540000000002 2024-09-20T21:03:02.644 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.644 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.644 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.645 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600893+0000", 2024-09-20T21:03:02.645 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014910100000000001 2024-09-20T21:03:02.645 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.645 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.645 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:02.645 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.601011+0000", 2024-09-20T21:03:02.645 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118025 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603257+0000", 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022466140000000001 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216356 5.f 5:ffb0c2c3:::benchmark_data_smithi112_23632_object84252:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.597150+0000", 2024-09-20T21:03:02.646 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.010177746999999999, 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010470663999999999, 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216356 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.647 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597150+0000", 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597150+0000", 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597151+0000", 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7000000000000005e-07 2024-09-20T21:03:02.648 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597154+0000", 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.993e-06 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597161+0000", 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5349999999999999e-06 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.649 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597167+0000", 2024-09-20T21:03:02.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5600000000000001e-06 2024-09-20T21:03:02.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600741+0000", 2024-09-20T21:03:02.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035739589999999998 2024-09-20T21:03:02.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600875+0000", 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000134146 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216357 5.f 5:f2bcc1fb:::benchmark_data_smithi112_23632_object84253:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.597358+0000", 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0099704530000000006, 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010298236000000001, 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216357 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597358+0000", 2024-09-20T21:03:02.652 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597358+0000", 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597358+0000", 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6799999999999999e-07 2024-09-20T21:03:02.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597362+0000", 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.799e-06 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597371+0000", 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0059999999999998e-06 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.654 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.597377+0000", 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.229e-06 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.602835+0000", 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0054577920000000004 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.602926+0000", 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0692000000000005e-05 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.655 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216361 5.f 5:f0fd9904:::benchmark_data_smithi112_23632_object84257:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.600660+0000", 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0066684530000000004, 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0070312170000000002, 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.656 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216361 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600660+0000", 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.657 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600660+0000", 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600661+0000", 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4600000000000003e-07 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600664+0000", 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8959999999999996e-06 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.658 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600675+0000", 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0101e-05 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600682+0000", 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9870000000000002e-06 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604240+0000", 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003558023 2024-09-20T21:03:02.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.604358+0000", 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011867 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216362 5.f 5:f1162dc0:::benchmark_data_smithi112_23632_object84258:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.660 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.600720+0000", 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0066078300000000003, 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0070051009999999997, 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216362 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.661 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600720+0000", 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600720+0000", 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600721+0000", 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0100000000000005e-07 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.662 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600724+0000", 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.9699999999999999e-06 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600730+0000", 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8590000000000001e-06 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600735+0000", 2024-09-20T21:03:02.663 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0810000000000001e-06 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606218+0000", 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0054831000000000003 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.606333+0000", 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000115208 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216365 5.d 5:ba1b3c07:::benchmark_data_smithi112_23632_object84261:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.600893+0000", 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0064349059999999998, 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006867115, 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216365 2024-09-20T21:03:02.665 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600893+0000", 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600893+0000", 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.666 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.667 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.667 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.667 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600894+0000", 2024-09-20T21:03:02.667 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8899999999999999e-07 2024-09-20T21:03:02.667 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.667 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.667 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.667 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600897+0000", 2024-09-20T21:03:02.667 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1140000000000002e-06 2024-09-20T21:03:02.667 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.668 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.668 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.668 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600903+0000", 2024-09-20T21:03:02.668 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0079999999999999e-06 2024-09-20T21:03:02.668 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.668 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.668 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.668 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600907+0000", 2024-09-20T21:03:02.668 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2119999999999997e-06 2024-09-20T21:03:02.669 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.669 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.669 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.669 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.600956+0000", 2024-09-20T21:03:02.669 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9060999999999997e-05 2024-09-20T21:03:02.669 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.669 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.669 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.670 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.601040+0000", 2024-09-20T21:03:02.670 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4299e-05 2024-09-20T21:03:02.670 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.670 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.670 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.670 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.670 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.670 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:216366 5.b 5:d4b6cfb8:::benchmark_data_smithi112_23632_object84262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-20T21:03:02.670 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:02.603110+0000", 2024-09-20T21:03:02.671 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.004217925, 2024-09-20T21:03:02.671 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047141140000000002, 2024-09-20T21:03:02.671 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:02.671 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:02.671 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:02.671 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:02.671 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:02.671 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:02.672 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 216366 2024-09-20T21:03:02.672 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.672 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:02.672 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.672 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:02.672 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603110+0000", 2024-09-20T21:03:02.672 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.672 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.672 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.672 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:02.673 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603110+0000", 2024-09-20T21:03:02.673 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:02.673 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.673 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.673 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:02.673 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603111+0000", 2024-09-20T21:03:02.673 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7700000000000003e-07 2024-09-20T21:03:02.673 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.673 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.674 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:02.674 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603116+0000", 2024-09-20T21:03:02.674 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7330000000000003e-06 2024-09-20T21:03:02.674 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.674 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.674 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:02.674 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603128+0000", 2024-09-20T21:03:02.674 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.221e-05 2024-09-20T21:03:02.674 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.675 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.675 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:02.675 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603135+0000", 2024-09-20T21:03:02.675 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1969999999999999e-06 2024-09-20T21:03:02.675 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.675 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.675 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:02.675 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603195+0000", 2024-09-20T21:03:02.676 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0269999999999997e-05 2024-09-20T21:03:02.676 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.676 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.676 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:02.676 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603328+0000", 2024-09-20T21:03:02.676 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013222700000000001 2024-09-20T21:03:02.676 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.676 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.676 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:02.676 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.603447+0000", 2024-09-20T21:03:02.677 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000119426 2024-09-20T21:03:02.677 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:02.677 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:02.677 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:02.677 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:02.605791+0000", 2024-09-20T21:03:02.677 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023443230000000002 2024-09-20T21:03:02.677 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.677 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:02.677 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.678 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:02.678 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:03:02.678 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 13 2024-09-20T21:03:02.678 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:02.680 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:02.680 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:02.676+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:02.752 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:02.752 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:02.752 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:02.772 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:02.772 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:02.776 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:02.776 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:02.779 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:02.775+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:02.875 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:02.875 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:02.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-09-20T21:03:02.881 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:02.876+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:02.896 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:02.982 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:02.979+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:03.082 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:03.080+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:03.092 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:03.092 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:03.110 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:03.183 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:03.179+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:03.213 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T21:03:03.262 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:03.262 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:03.282 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:03.283 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:03.280+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:03.384 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:03.380+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:03.481 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:03.481 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:03.485 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:03.483+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:03.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:03.588 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:03.587+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:03.687 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:03.683+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:03.695 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:03.695 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:03.715 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:03.787 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:03.783+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:03.872 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:03.873 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:03.888 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:03.887+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:03.890 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:03.989 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:03.984+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:04.040 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:04.040 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:04.060 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:04.090 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:04.087+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:04.190 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-20T21:03:04.190 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:04.187+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:04.199 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-09-20T21:03:04.199 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:03:04.199 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-20T21:03:04.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-20T21:03:04.255 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:04.255 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:04.277 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:04.320 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:04.319+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:04.392 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:04.388+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:04.427 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:04.427 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:04.447 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:04.493 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:04.488+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:04.509 INFO:teuthology.orchestra.run.smithi112.stdout:moved 0 / 242 (0%) 2024-09-20T21:03:04.509 INFO:teuthology.orchestra.run.smithi112.stdout:avg 121 2024-09-20T21:03:04.509 INFO:teuthology.orchestra.run.smithi112.stdout:stddev 40.7492 -> 40.7492 (expected baseline 7.77817) 2024-09-20T21:03:04.510 INFO:teuthology.orchestra.run.smithi112.stdout:min osd.2 with 76 -> 76 pgs (0.628099 -> 0.628099 * mean) 2024-09-20T21:03:04.510 INFO:teuthology.orchestra.run.smithi112.stdout:max osd.0 with 85 -> 85 pgs (0.702479 -> 0.702479 * mean) 2024-09-20T21:03:04.510 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:03:04.510 INFO:teuthology.orchestra.run.smithi112.stdout:oload 1000 2024-09-20T21:03:04.510 INFO:teuthology.orchestra.run.smithi112.stdout:max_change 0.05 2024-09-20T21:03:04.510 INFO:teuthology.orchestra.run.smithi112.stdout:max_change_osds 4 2024-09-20T21:03:04.510 INFO:teuthology.orchestra.run.smithi112.stdout:average_utilization 0.0041 2024-09-20T21:03:04.510 INFO:teuthology.orchestra.run.smithi112.stdout:overload_utilization 0.0408 2024-09-20T21:03:04.511 INFO:teuthology.orchestra.run.smithi112.stderr:no change 2024-09-20T21:03:04.529 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-20T21:03:04.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-09-20T21:03:04.594 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:04.591+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:04.635 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:04.635 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:04.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:04.695 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:04.691+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:04.778 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:03:04.796 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:04.791+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:04.827 INFO:teuthology.orchestra.run.smithi112.stdout:moved 0 / 242 (0%) 2024-09-20T21:03:04.827 INFO:teuthology.orchestra.run.smithi112.stdout:avg 121 2024-09-20T21:03:04.828 INFO:teuthology.orchestra.run.smithi112.stdout:stddev 40.7492 -> 40.7492 (expected baseline 7.77817) 2024-09-20T21:03:04.828 INFO:teuthology.orchestra.run.smithi112.stdout:min osd.2 with 76 -> 76 pgs (0.628099 -> 0.628099 * mean) 2024-09-20T21:03:04.828 INFO:teuthology.orchestra.run.smithi112.stdout:max osd.0 with 85 -> 85 pgs (0.702479 -> 0.702479 * mean) 2024-09-20T21:03:04.828 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:03:04.828 INFO:teuthology.orchestra.run.smithi112.stdout:oload 1000 2024-09-20T21:03:04.828 INFO:teuthology.orchestra.run.smithi112.stdout:max_change 0.05 2024-09-20T21:03:04.828 INFO:teuthology.orchestra.run.smithi112.stdout:max_change_osds 4 2024-09-20T21:03:04.828 INFO:teuthology.orchestra.run.smithi112.stdout:average_utilization 0.0041 2024-09-20T21:03:04.828 INFO:teuthology.orchestra.run.smithi112.stdout:overload_utilization 0.0408 2024-09-20T21:03:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:no change 2024-09-20T21:03:04.845 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:04.845 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:04.846 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-20T21:03:04.847 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-20T21:03:04.868 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:04.912 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:04.911+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:04.927 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:04.928 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:04.928 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:04.947 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:04.947 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:04.950 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:04.950 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:04.997 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:04.991+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:05.020 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:222523 5.8 5:1daf318e:::benchmark_data_smithi112_23632_object90419:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:05.015241+0000", 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0051247740000000003, 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0051427720000000003, 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.021 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 222523 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015241+0000", 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015241+0000", 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015243+0000", 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2279999999999999e-06 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015249+0000", 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9689999999999997e-06 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015265+0000", 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5111e-05 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015274+0000", 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8360000000000004e-06 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015323+0000", 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8727999999999998e-05 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015444+0000", 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012077400000000001 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015600+0000", 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156572 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:222525 5.b 5:d49f6cc3:::benchmark_data_smithi112_23632_object90421:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:05.015308+0000", 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0050581030000000004, 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0051310669999999996, 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.025 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 222525 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015308+0000", 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015308+0000", 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015309+0000", 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8299999999999997e-07 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015312+0000", 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.529e-06 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015321+0000", 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6470000000000004e-06 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015337+0000", 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6507999999999998e-05 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015382+0000", 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4626000000000003e-05 2024-09-20T21:03:05.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015498+0000", 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116031 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015612+0000", 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114312 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:222526 5.e 5:781bb0b6:::benchmark_data_smithi112_23632_object90422:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:05.015377+0000", 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0049889679999999999, 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0051026400000000003, 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 222526 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015377+0000", 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015377+0000", 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015378+0000", 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.23e-07 2024-09-20T21:03:05.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015381+0000", 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.478e-06 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015391+0000", 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7110000000000007e-06 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015399+0000", 2024-09-20T21:03:05.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9680000000000006e-06 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015496+0000", 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7477000000000002e-05 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015667+0000", 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000170846 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015775+0000", 2024-09-20T21:03:05.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108039 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.020254+0000", 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0044788409999999999 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:222528 5.4 5:29abc73d:::benchmark_data_smithi112_23632_object90424:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:05.015483+0000", 2024-09-20T21:03:05.034 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0048834059999999999, 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0050401830000000002, 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 222528 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015483+0000", 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015483+0000", 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015484+0000", 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4300000000000001e-07 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015487+0000", 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3249999999999999e-06 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015495+0000", 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1349999999999992e-06 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015500+0000", 2024-09-20T21:03:05.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4310000000000002e-06 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015552+0000", 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1066999999999997e-05 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015669+0000", 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000117433 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.015777+0000", 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108192 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:222530 5.a e66/21 5:591769e4:::benchmark_data_smithi112_23632_object90426:head v 66'13933, mlcod=66'13930)", 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:05.017164+0000", 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0032016779999999999, 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0033970319999999999, 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.017164+0000", 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.017164+0000", 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.017165+0000", 2024-09-20T21:03:05.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.53e-07 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.017170+0000", 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7699999999999998e-06 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.017176+0000", 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2989999999999996e-06 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.017180+0000", 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7940000000000002e-06 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.017303+0000", 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012249299999999999 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.017325+0000", 2024-09-20T21:03:05.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2382e-05 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:222536 5.0 5:0d60eefb:::benchmark_data_smithi112_23632_object90432:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:05.018085+0000", 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0022810700000000001, 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0025080430000000002, 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.043 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 222536 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.018085+0000", 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.018085+0000", 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.018086+0000", 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2800000000000005e-07 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.018090+0000", 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2520000000000001e-06 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.018100+0000", 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6420000000000002e-06 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.018105+0000", 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1109999999999999e-06 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.018143+0000", 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7891e-05 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.018222+0000", 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8819999999999994e-05 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:05.018285+0000", 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3145999999999995e-05 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 6 2024-09-20T21:03:05.047 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:05.048 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:05.139 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:05.135+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:05.141 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-20T21:03:05.137+0000 7f9a42900640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout:moved 18 / 242 (7.43802%) 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout:avg 121 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout:stddev 40.7492 -> 46.2871 (expected baseline 7.77817) 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout:min osd.2 with 76 -> 84 pgs (0.628099 -> 0.694215 * mean) 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout:max osd.0 with 85 -> 67 pgs (0.702479 -> 0.553719 * mean) 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout:oload 110 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout:max_change 1 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout:max_change_osds 4 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout:average_utilization 0.0041 2024-09-20T21:03:05.142 INFO:teuthology.orchestra.run.smithi112.stdout:overload_utilization 0.0045 2024-09-20T21:03:05.143 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 weight 1.0000 -> 0.8222 2024-09-20T21:03:05.143 INFO:teuthology.orchestra.run.smithi112.stderr:no change 2024-09-20T21:03:05.159 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-20T21:03:05.159 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-20T21:03:05.199 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:05.195+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:05.244 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:05.244 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:05.244 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:03:05.244 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:03:05.244 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:05.267 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:05.299 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:05.295+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:05.401 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:05.399+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:05.467 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 113.26874743400001, 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.468 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:03:05.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:03:05.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:03:05.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:03:05.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:03:05.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:03:05.474 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.475 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.475 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.475 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:05.475 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:05.475 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 113.268657398, 2024-09-20T21:03:05.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:03:05.475 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.476 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.476 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.476 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.476 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:05.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:05.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:03:05.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:03:05.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:03:05.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:03:05.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:03:05.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:03:05.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:03:05.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:03:05.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:03:05.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:03:05.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:05.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:03:05.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:03:05.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:03:05.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:03:05.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:03:05.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:03:05.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:05.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:03:05.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:03:05.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:03:05.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:03:05.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:03:05.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:03:05.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:03:05.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:03:05.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:03:05.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:03:05.487 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.487 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.488 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.488 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:05.488 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:05.488 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 113.268571045, 2024-09-20T21:03:05.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:03:05.489 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.489 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.489 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.489 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:05.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:05.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.491 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.491 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:03:05.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:03:05.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:03:05.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:03:05.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:03:05.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:03:05.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:03:05.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:03:05.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:03:05.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:03:05.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.495 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:05.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:03:05.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:03:05.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:03:05.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:03:05.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:03:05.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:03:05.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:05.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:03:05.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:03:05.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:03:05.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:03:05.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.499 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:03:05.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 113.268502236, 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:03:05.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.506 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 113.268469376, 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:03:05.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:03:05.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:03:05.512 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 113.268427359, 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:03:05.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:03:05.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:03:05.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:03:05.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 113.268302253, 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:03:05.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:03:05.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 113.268209904, 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:03:05.525 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.529 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 113.268125532, 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.532 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.533 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:05.534 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.502666075999997, 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.535 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.536 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.537 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.538 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.539 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.502114070000005, 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.540 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:05.541 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:03:05.542 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.543 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.544 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.545 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 74.501486489000001, 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.546 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.547 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.548 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.549 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.550 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.551 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 53.751752592999999, 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.552 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.553 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.554 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.555 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:03:05.556 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 53.747401668000002, 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.557 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.558 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.559 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.560 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.561 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:03:05.562 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 53.739159596999997, 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.563 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.564 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.565 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.566 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:03:05.567 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.568 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.790030284, 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.569 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.570 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:03:05.571 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:03:05.572 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:03:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.784113717, 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:03:05.574 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.575 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.576 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:03:05.577 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:03:05.578 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:03:05.579 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.780844098999999, 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.580 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.581 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.582 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.583 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.584 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.585 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.780343578, 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.586 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.587 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.588 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.589 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.590 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:05.591 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 13.780188292, 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:05.592 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:03:05.593 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:05.594 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:05.595 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:05.596 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:03:05.597 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:03:05.597 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.597 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.597 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.597 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:05.597 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:05.597 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:05.598 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:05.591+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:05.599 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:05.699 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:05.695+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:05.753 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:05.753 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:224508 5.b e66/21 5:dbcca4b0:::benchmark_data_smithi112_23632_object92404:head v 66'14326, mlcod=66'14323)", 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.743777+0000", 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0086768560000000002, 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0086936370000000006, 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743777+0000", 2024-09-20T21:03:05.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743777+0000", 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743777+0000", 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743785+0000", 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7619999999999995e-06 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743795+0000", 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0335e-05 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743802+0000", 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2349999999999996e-06 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.744737+0000", 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00093510900000000005 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.744761+0000", 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3728000000000001e-05 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:224512 5.3 5:cb97624c:::benchmark_data_smithi112_23632_object92408:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.757 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.744372+0000", 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0080810880000000002, 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0081371410000000005, 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 224512 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.744372+0000", 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.744372+0000", 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.744373+0000", 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5799999999999998e-07 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.744378+0000", 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2359999999999998e-06 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.744391+0000", 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3393e-05 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.744399+0000", 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.576e-06 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748203+0000", 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038038809999999998 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748326+0000", 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012319499999999999 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.761 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:224513 5.6 5:6915d9b5:::benchmark_data_smithi112_23632_object92409:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.745471+0000", 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0069821450000000004, 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070772370000000001, 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 224513 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745471+0000", 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745471+0000", 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745472+0000", 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7499999999999999e-07 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745487+0000", 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4985e-05 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745500+0000", 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2339e-05 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745507+0000", 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2259999999999999e-06 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745565+0000", 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7880000000000001e-05 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745702+0000", 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000137522 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.765 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:224515 5.6 5:6dc2764f:::benchmark_data_smithi112_23632_object92411:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.745917+0000", 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0065366319999999997, 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0066671569999999999, 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 224515 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745917+0000", 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745917+0000", 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745918+0000", 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5300000000000003e-07 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745922+0000", 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1609999999999996e-06 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745932+0000", 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5689999999999994e-06 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.745940+0000", 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7790000000000001e-06 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.747333+0000", 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001392456 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.747459+0000", 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012605400000000001 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.769 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:224517 5.6 5:629f01d1:::benchmark_data_smithi112_23632_object92413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.746244+0000", 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0062096089999999996, 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063758119999999998, 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 224517 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.746244+0000", 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.746244+0000", 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.746245+0000", 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0599999999999999e-07 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.746249+0000", 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5349999999999998e-06 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.746262+0000", 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3021e-05 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.746269+0000", 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7730000000000002e-06 2024-09-20T21:03:05.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749349+0000", 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030801859999999999 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749440+0000", 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1137999999999994e-05 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:224519 5.3 5:c6323180:::benchmark_data_smithi112_23632_object92415:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.747023+0000", 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.005430448, 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056309189999999999, 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 224519 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.747023+0000", 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.747023+0000", 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.747024+0000", 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4799999999999997e-07 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.747028+0000", 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7850000000000002e-06 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.747037+0000", 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2220000000000008e-06 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.747044+0000", 2024-09-20T21:03:05.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.601e-06 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749849+0000", 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028056359999999998 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749969+0000", 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011937799999999999 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:224522 5.6 5:661132b6:::benchmark_data_smithi112_23632_object92418:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.748182+0000", 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0042720589999999999, 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0045067730000000004, 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 224522 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.778 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748182+0000", 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748182+0000", 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748182+0000", 2024-09-20T21:03:05.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4099999999999998e-07 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748186+0000", 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.839e-06 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748198+0000", 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2265e-05 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748205+0000", 2024-09-20T21:03:05.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6760000000000001e-06 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751062+0000", 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028568880000000001 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751156+0000", 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4073000000000005e-05 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.781 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:224523 5.b e66/21 5:d401e372:::benchmark_data_smithi112_23632_object92419:head v 66'14327, mlcod=66'14324)", 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.748656+0000", 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0037977829999999999, 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0040683739999999996, 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748656+0000", 2024-09-20T21:03:05.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748656+0000", 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748656+0000", 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5199999999999996e-07 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748662+0000", 2024-09-20T21:03:05.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2240000000000003e-06 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748674+0000", 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2184999999999999e-05 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.748680+0000", 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4239999999999998e-06 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749831+0000", 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011508379999999999 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749851+0000", 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9559e-05 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:224526 5.e e66/21 5:7ee26a7e:::benchmark_data_smithi112_23632_object92422:head v 66'13987, mlcod=66'13985)", 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.749952+0000", 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0025018969999999999, 2024-09-20T21:03:05.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028025939999999998, 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749952+0000", 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749952+0000", 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749952+0000", 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5600000000000005e-07 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749957+0000", 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1290000000000004e-06 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749967+0000", 2024-09-20T21:03:05.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5759999999999995e-06 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.749974+0000", 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7009999999999999e-06 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751052+0000", 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001078365 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751067+0000", 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5400000000000002e-05 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:224527 5.b e66/21 5:dabc8303:::benchmark_data_smithi112_23632_object92423:head v 66'14328, mlcod=66'14324)", 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.751065+0000", 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0013882289999999999, 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0017189499999999999, 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.789 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751065+0000", 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751065+0000", 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751066+0000", 2024-09-20T21:03:05.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6100000000000001e-07 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751071+0000", 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8779999999999997e-06 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751078+0000", 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.661e-06 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751085+0000", 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2469999999999997e-06 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751792+0000", 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00070696300000000001 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751802+0000", 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0570999999999999e-05 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.792 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:224528 5.c 5:3c081869:::benchmark_data_smithi112_23632_object92424:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.751953+0000", 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00050091899999999995, 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00086215499999999997, 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.793 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 224528 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751953+0000", 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751953+0000", 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751954+0000", 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0499999999999999e-06 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751958+0000", 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4229999999999998e-06 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751972+0000", 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3566e-05 2024-09-20T21:03:05.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.751980+0000", 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.072e-06 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.752034+0000", 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3909999999999997e-05 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.752163+0000", 2024-09-20T21:03:05.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129436 2024-09-20T21:03:05.797 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.797 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.797 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.797 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:224506 5.3 5:c07e3fd6:::benchmark_data_smithi112_23632_object92402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-20T21:03:05.797 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:05.743468+0000", 2024-09-20T21:03:05.797 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0089854010000000005, 2024-09-20T21:03:05.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0093818140000000005, 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 224506 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743468+0000", 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743468+0000", 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743469+0000", 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.08e-06 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743474+0000", 2024-09-20T21:03:05.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9980000000000003e-06 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743484+0000", 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8300000000000008e-06 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.743492+0000", 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6490000000000008e-06 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:05.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.746440+0000", 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029485739999999998 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:05.746550+0000", 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109947 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 12 2024-09-20T21:03:05.801 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:05.803 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:05.803 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:05.799+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:05.903 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:05.899+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:05.997 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:05.997 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:03:05.997 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:03:05.997 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:03:05.997 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:06.003 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:05.999+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:06.018 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:06.108 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:06.107+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:06.205 INFO:teuthology.orchestra.run.smithi112.stdout:moved 2 / 242 (0.826446%) 2024-09-20T21:03:06.205 INFO:teuthology.orchestra.run.smithi112.stdout:avg 121 2024-09-20T21:03:06.205 INFO:teuthology.orchestra.run.smithi112.stdout:stddev 40.7492 -> 40.5771 (expected baseline 7.77817) 2024-09-20T21:03:06.205 INFO:teuthology.orchestra.run.smithi112.stdout:min osd.2 with 76 -> 78 pgs (0.628099 -> 0.644628 * mean) 2024-09-20T21:03:06.206 INFO:teuthology.orchestra.run.smithi112.stdout:max osd.0 with 85 -> 83 pgs (0.702479 -> 0.68595 * mean) 2024-09-20T21:03:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:03:06.206 INFO:teuthology.orchestra.run.smithi112.stdout:oload 110 2024-09-20T21:03:06.206 INFO:teuthology.orchestra.run.smithi112.stdout:max_change 0.05 2024-09-20T21:03:06.206 INFO:teuthology.orchestra.run.smithi112.stdout:max_change_osds 4 2024-09-20T21:03:06.206 INFO:teuthology.orchestra.run.smithi112.stdout:average_utilization 0.0041 2024-09-20T21:03:06.206 INFO:teuthology.orchestra.run.smithi112.stdout:overload_utilization 0.0045 2024-09-20T21:03:06.206 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 weight 1.0000 -> 0.9500 2024-09-20T21:03:06.206 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:06.199+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:06.214 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:06.214 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:06.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:06.214 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:06.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.214 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.214 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 114.017253559, 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:06.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:06.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 114.017029028, 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:06.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.227 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.537334639999999, 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:06.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:06.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:06.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:06.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:06.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:06.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.234 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:06.234 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:06.234 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.537000415, 2024-09-20T21:03:06.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:06.234 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.234 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.234 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:06.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.536741598000001, 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.240 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:06.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:06.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.244 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.535126680999999, 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.245 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.250 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.532808761, 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:06.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:06.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:06.256 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.530780668, 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:06.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:06.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.530656027999999, 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:06.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:06.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:06.266 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.528647711, 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.270 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.527587051999999, 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:06.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.527393227999999, 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.280 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.527316594, 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.281 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:06.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:06.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.527245390999999, 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:06.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:06.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:06.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.526930195, 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:06.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:06.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.525523459, 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:06.296 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:06.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:06.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:06.301 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.525269601, 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:06.305 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.524684874, 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:06.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.524662621999999, 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.310 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.523595154000001, 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:06.314 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:06.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:06.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:06.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:06.319 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:06.319 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:03:06.322 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-20T21:03:06.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-20T21:03:06.322 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:06.322 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:06.319+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:06.421 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:06.415+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:06.478 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:06.478 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:06.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226369 5.9 5:9c4ce2c5:::benchmark_data_smithi112_23632_object94265:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.474818+0000", 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0021137560000000001, 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0021453179999999998, 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226369 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.479 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474818+0000", 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474818+0000", 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474819+0000", 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5199999999999996e-07 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474826+0000", 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0099999999999998e-06 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474835+0000", 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2129999999999997e-06 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474842+0000", 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7240000000000003e-06 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474894+0000", 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1959000000000002e-05 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475009+0000", 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011538400000000001 2024-09-20T21:03:06.482 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:226368 5.a e67/21 5:5916e838:::benchmark_data_smithi112_23632_object94264:head v 67'14164, mlcod=67'14162)", 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.475159+0000", 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001772842, 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001890585, 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475159+0000", 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475159+0000", 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475160+0000", 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1699999999999998e-07 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475166+0000", 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9580000000000004e-06 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475175+0000", 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4900000000000006e-06 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475182+0000", 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2430000000000002e-06 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475230+0000", 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8092e-05 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475248+0000", 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.8240000000000002e-05 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226371 5.0 5:0bdafdc7:::benchmark_data_smithi112_23632_object94267:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.475306+0000", 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001625944, 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018140000000000001, 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226371 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475306+0000", 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475306+0000", 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475307+0000", 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0699999999999996e-07 2024-09-20T21:03:06.488 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475312+0000", 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5809999999999998e-06 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475335+0000", 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.3484000000000001e-05 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475343+0000", 2024-09-20T21:03:06.489 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2849999999999995e-06 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476371+0000", 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010278609999999999 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476476+0000", 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000104999 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:06.490 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476578+0000", 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000101335 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226372 5.d 5:bddc563b:::benchmark_data_smithi112_23632_object94268:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.475524+0000", 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001408117, 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001683199, 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.491 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226372 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475524+0000", 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.492 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475524+0000", 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475525+0000", 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2799999999999995e-07 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475529+0000", 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3150000000000002e-06 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.493 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475539+0000", 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4339999999999998e-06 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475545+0000", 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5420000000000002e-06 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475605+0000", 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9512999999999998e-05 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.494 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475716+0000", 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000111109 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226373 5.f 5.7007773f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.475806+0000", 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001125645, 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0014694420000000001, 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.495 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226373 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475806+0000", 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.496 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475806+0000", 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475807+0000", 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4399999999999999e-07 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475811+0000", 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1690000000000002e-06 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.497 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475821+0000", 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0950000000000002e-06 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475828+0000", 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9559999999999997e-06 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226374 5.0 5.326584d0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.498 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.476117+0000", 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00081459100000000003, 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0011938439999999999, 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226374 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.499 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476117+0000", 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476117+0000", 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476118+0000", 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9699999999999995e-07 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.500 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476122+0000", 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6509999999999999e-06 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476129+0000", 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4159999999999998e-06 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476134+0000", 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5839999999999996e-06 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.501 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226375 5.4 5:21acc383:::benchmark_data_smithi112_23632_object94271:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.476501+0000", 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00043126200000000002, 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00083992799999999999, 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.502 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226375 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476501+0000", 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476501+0000", 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.503 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476502+0000", 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476506+0000", 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3499999999999999e-06 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476516+0000", 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0115999999999999e-05 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.504 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476523+0000", 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8360000000000003e-06 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476575+0000", 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1518999999999999e-05 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476682+0000", 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010767 2024-09-20T21:03:06.505 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476789+0000", 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106679 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226376 5.0 5.cd26e730 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.477242+0000", 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9996901, 2024-09-20T21:03:06.506 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013804600000000001, 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226376 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.477242+0000", 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.477242+0000", 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.477243+0000", 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8999999999999995e-07 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.477247+0000", 2024-09-20T21:03:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4610000000000001e-06 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.477259+0000", 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2038999999999999e-05 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.477266+0000", 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7750000000000004e-06 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.509 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226355 5.0 5:0f6b9673:::benchmark_data_smithi112_23632_object94251:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.470693+0000", 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0062390290000000001, 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0067172450000000002, 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226355 2024-09-20T21:03:06.510 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470693+0000", 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470693+0000", 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470693+0000", 2024-09-20T21:03:06.511 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5800000000000001e-07 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470695+0000", 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4720000000000001e-06 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470698+0000", 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6500000000000002e-06 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.512 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470701+0000", 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8380000000000002e-06 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.472975+0000", 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002273901 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.473084+0000", 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010911 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.513 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.473191+0000", 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106727 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226357 5.e 5:75cdd710:::benchmark_data_smithi112_23632_object94253:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.470913+0000", 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0060186349999999996, 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0065345159999999998, 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.514 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226357 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470913+0000", 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.515 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470913+0000", 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470914+0000", 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7100000000000001e-07 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470918+0000", 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8929999999999998e-06 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.516 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470925+0000", 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7660000000000001e-06 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.470929+0000", 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7319999999999998e-06 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.472014+0000", 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010842180000000001 2024-09-20T21:03:06.517 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.472139+0000", 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000125377 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.472272+0000", 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000133385 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474262+0000", 2024-09-20T21:03:06.518 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019899380000000001 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226364 5.4 5:2b76a18f:::benchmark_data_smithi112_23632_object94260:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.472579+0000", 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0043531020000000002, 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0049100710000000002, 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.519 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226364 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.472579+0000", 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.472579+0000", 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.472580+0000", 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1299999999999998e-07 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.472586+0000", 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3799999999999999e-06 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.472595+0000", 2024-09-20T21:03:06.521 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1260000000000004e-06 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.472602+0000", 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1990000000000003e-06 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.473217+0000", 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00061515099999999998 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.522 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.473328+0000", 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000111216 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.473429+0000", 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010133599999999999 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.475968+0000", 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002538785 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.523 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226365 5.f 5:f213c7e5:::benchmark_data_smithi112_23632_object94261:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.474072+0000", 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002859973, 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003464721, 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226365 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.524 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474072+0000", 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474072+0000", 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474073+0000", 2024-09-20T21:03:06.525 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6400000000000001e-07 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474077+0000", 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5179999999999998e-06 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474088+0000", 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0577000000000001e-05 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.526 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474095+0000", 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1199999999999996e-06 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474149+0000", 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4116000000000002e-05 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474236+0000", 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7044000000000002e-05 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.527 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:226367 5.f 5:f7042e73:::benchmark_data_smithi112_23632_object94263:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:06.474552+0000", 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002380367, 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0030202940000000002, 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 226367 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.528 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474552+0000", 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474552+0000", 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474552+0000", 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4000000000000001e-07 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.529 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474556+0000", 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6689999999999999e-06 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474563+0000", 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4240000000000004e-06 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.474568+0000", 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8029999999999996e-06 2024-09-20T21:03:06.530 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476238+0000", 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001669352 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:06.476352+0000", 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011396999999999999 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.531 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:03:06.532 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 13 2024-09-20T21:03:06.532 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:06.533 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:06.533 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:06.527+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:06.634 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:06.631+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:06.725 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:06.725 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:06.725 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:03:06.725 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:03:06.725 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:06.735 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:06.731+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:06.746 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:06.836 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:06.831+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:06.937 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:06.931+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:06.944 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:06.944 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 114.74584154999999, 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:03:06.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:06.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 114.74575151400001, 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:03:06.951 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:03:06.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:06.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:03:06.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 114.74566516100001, 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:03:06.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:03:06.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:03:06.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.963 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 114.74559635200001, 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:06.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:03:06.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:03:06.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:03:06.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:03:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:03:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:03:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:03:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:03:06.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 114.745563492, 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:03:06.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.976 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 114.745521475, 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:06.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:03:06.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:03:06.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:03:06.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:06.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 114.74539636900001, 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.983 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:06.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:03:06.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 114.74530402000001, 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.989 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.993 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 114.745219648, 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:06.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:03:06.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:03:06.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:06.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 75.979760192000001, 2024-09-20T21:03:06.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:06.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 75.979208185999994, 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:07.004 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:03:07.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:03:07.009 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 75.978580605000005, 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:07.010 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:03:07.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.015 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.228846709000003, 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:07.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:03:07.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.224495783999998, 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:07.021 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:03:07.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:03:07.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:03:07.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 55.216253713, 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:07.027 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:03:07.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.032 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.2671244, 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.033 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.038 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:07.039 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:07.039 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.261207833, 2024-09-20T21:03:07.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:03:07.039 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:07.039 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:07.039 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:07.039 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:07.041 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:03:07.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:03:07.046 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.257938214999999, 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:07.047 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:03:07.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:03:07.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.052 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.257437694, 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:03:07.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:03:07.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:03:07.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 15.257282408, 2024-09-20T21:03:07.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:03:07.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:07.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:03:07.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:03:07.064 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.064 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.064 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.064 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:07.064 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:07.064 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:07.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:03:07.066 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:07.063+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:07.066 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:07.167 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:07.163+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:07.215 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:228213 5.2 5:49986468:::benchmark_data_smithi112_23632_object96109:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.210383+0000", 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0038356739999999999, 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038537770000000001, 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.216 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 228213 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210383+0000", 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210383+0000", 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210384+0000", 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1600000000000001e-07 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210387+0000", 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4589999999999998e-06 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210396+0000", 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4009999999999997e-06 2024-09-20T21:03:07.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210402+0000", 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.528e-06 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210481+0000", 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8627000000000005e-05 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210624+0000", 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143628 2024-09-20T21:03:07.219 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:228214 5.3 5:cb96dd23:::benchmark_data_smithi112_23632_object96110:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.210420+0000", 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0037988309999999999, 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038597850000000001, 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:07.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 228214 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210420+0000", 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210420+0000", 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210421+0000", 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210423+0000", 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.633e-06 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210430+0000", 2024-09-20T21:03:07.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0219999999999999e-06 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210435+0000", 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2190000000000003e-06 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211611+0000", 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011754700000000001 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211726+0000", 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011464300000000001 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:228217 5.b e67/21 5:d2f2a84f:::benchmark_data_smithi112_23632_object96113:head v 67'14565, mlcod=67'14562)", 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.211293+0000", 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0029259939999999999, 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030238859999999999, 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211293+0000", 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211293+0000", 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211293+0000", 2024-09-20T21:03:07.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8299999999999996e-07 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211298+0000", 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9389999999999996e-06 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211333+0000", 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4119000000000003e-05 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211339+0000", 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5760000000000002e-06 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211570+0000", 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023070100000000001 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211591+0000", 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0732000000000001e-05 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.227 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:228219 5.a 5:51b9ea25:::benchmark_data_smithi112_23632_object96115:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.211614+0000", 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0026049419999999998, 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027338280000000002, 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 228219 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211614+0000", 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211614+0000", 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211615+0000", 2024-09-20T21:03:07.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1459999999999999e-06 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211619+0000", 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4270000000000001e-06 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211630+0000", 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0395e-05 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211636+0000", 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5080000000000002e-06 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212491+0000", 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00085480699999999996 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212600+0000", 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108572 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212703+0000", 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010340699999999999 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:228220 5.6 5:64db5c17:::benchmark_data_smithi112_23632_object96116:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.211658+0000", 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0025606909999999999, 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027282420000000001, 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.232 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 228220 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211658+0000", 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211658+0000", 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211659+0000", 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9100000000000004e-07 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211661+0000", 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7250000000000002e-06 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211668+0000", 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7159999999999997e-06 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.211674+0000", 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.604e-06 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212515+0000", 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00084159499999999999 2024-09-20T21:03:07.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212615+0000", 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9705999999999997e-05 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:228221 5.c 5:391a8748:::benchmark_data_smithi112_23632_object96117:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.212615+0000", 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001603873, 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0018052490000000001, 2024-09-20T21:03:07.236 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 228221 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212615+0000", 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212615+0000", 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212616+0000", 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9100000000000003e-07 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212621+0000", 2024-09-20T21:03:07.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7790000000000003e-06 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212630+0000", 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1789999999999997e-06 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212638+0000", 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3669999999999997e-06 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212886+0000", 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024786099999999999 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213007+0000", 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000120809 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:228223 5.a 5:5cf157d1:::benchmark_data_smithi112_23632_object96119:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:07.240 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.212789+0000", 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0014293789999999999, 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016644310000000001, 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 228223 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212789+0000", 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212789+0000", 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212790+0000", 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.37e-07 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212797+0000", 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4230000000000002e-06 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212805+0000", 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2209999999999997e-06 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212811+0000", 2024-09-20T21:03:07.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4489999999999996e-06 2024-09-20T21:03:07.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214325+0000", 2024-09-20T21:03:07.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015133519999999999 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214432+0000", 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010774500000000001 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:228224 5.7 5:ecf0a301:::benchmark_data_smithi112_23632_object96120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.212880+0000", 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0013386579999999999, 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016093850000000001, 2024-09-20T21:03:07.246 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 228224 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212880+0000", 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212880+0000", 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212881+0000", 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212887+0000", 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4740000000000002e-06 2024-09-20T21:03:07.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212899+0000", 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1386000000000001e-05 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212917+0000", 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7980000000000001e-05 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.212957+0000", 2024-09-20T21:03:07.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0096999999999999e-05 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213055+0000", 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8657000000000001e-05 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:228222 5.0 e67/21)", 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.213168+0000", 2024-09-20T21:03:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0010511940000000001, 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001361866, 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213168+0000", 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213168+0000", 2024-09-20T21:03:07.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213168+0000", 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0500000000000003e-07 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213174+0000", 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2519999999999996e-06 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213183+0000", 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2320000000000001e-06 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213188+0000", 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1889999999999998e-06 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:228226 5.6 5.9eabba76 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.213813+0000", 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00040579199999999998, 2024-09-20T21:03:07.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00076996499999999995, 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 228226 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213813+0000", 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213813+0000", 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213814+0000", 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9800000000000003e-07 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213817+0000", 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2600000000000001e-06 2024-09-20T21:03:07.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213826+0000", 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0299999999999999e-06 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.213832+0000", 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0929999999999999e-06 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214568+0000", 2024-09-20T21:03:07.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00073634999999999998 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:228225 5.e e67/21 5:7ba51b55:::benchmark_data_smithi112_23632_object96121:head v 67'14228, mlcod=67'14224)", 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.214088+0000", 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00013061799999999999, 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000556939, 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214088+0000", 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214088+0000", 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214089+0000", 2024-09-20T21:03:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.06e-07 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214095+0000", 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4400000000000002e-06 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214103+0000", 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5480000000000004e-06 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214107+0000", 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7949999999999998e-06 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214548+0000", 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00044089299999999998 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.214567+0000", 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8825999999999999e-05 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.260 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:228206 5.e e67/21 5:71a70a31:::benchmark_data_smithi112_23632_object96102:head v 67'14226, mlcod=67'14223)", 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.207171+0000", 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0070476109999999996, 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075325180000000002, 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.207171+0000", 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.207171+0000", 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.207172+0000", 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2099999999999995e-07 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.207177+0000", 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1959999999999999e-06 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.207189+0000", 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1418e-05 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.207195+0000", 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8589999999999999e-06 2024-09-20T21:03:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.208567+0000", 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013713589999999999 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.208585+0000", 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8082000000000001e-05 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:228211 5.e e67/21 5:7693ba09:::benchmark_data_smithi112_23632_object96107:head v 67'14227, mlcod=67'14223)", 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:07.209280+0000", 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0049383059999999999, 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054758200000000002, 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.209280+0000", 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.209280+0000", 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.209281+0000", 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3499999999999996e-07 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.209299+0000", 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7762e-05 2024-09-20T21:03:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.209306+0000", 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7599999999999997e-06 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.209310+0000", 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2860000000000001e-06 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210590+0000", 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012802460000000001 2024-09-20T21:03:07.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:07.210606+0000", 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6171000000000002e-05 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 13 2024-09-20T21:03:07.268 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:07.269 INFO:teuthology.orchestra.run.smithi112.stdout:moved 10 / 242 (4.13223%) 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:avg 121 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:stddev 40.5771 -> 44.1814 (expected baseline 7.77817) 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:min osd.2 with 78 -> 81 pgs (0.644628 -> 0.669421 * mean) 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:max osd.0 with 83 -> 73 pgs (0.68595 -> 0.603306 * mean) 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:oload 110 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:max_change 0.05 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:max_change_osds 4 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:average_utilization 0.0039 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:overload_utilization 0.0043 2024-09-20T21:03:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 weight 0.9500 -> 0.9000 2024-09-20T21:03:07.271 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:07.263+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:07.271 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:03:07.271 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:07.272 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:07.272 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:07.273 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:07.274 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:07.274 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:07.275 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:07.370 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:07.367+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:07.436 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:07.436 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:07.448 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:07.496 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:07.495+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:07.572 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:07.567+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:07.613 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:07.613 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:07.626 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:07.673 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:07.667+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:07.758 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:07.758 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:07.772 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:07.815 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:07.811+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:07.874 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:07.867+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:07.941 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:07.941 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:07.955 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:07.975 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:07.971+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:08.075 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:08.071+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:08.124 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:08.124 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:08.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:08.184 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:08.183+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:08.270 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:08.270 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:08.277 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:08.275+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:08.283 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:08.377 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:08.371+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:08.440 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:08.440 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:08.452 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:08.496 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:08.495+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:08.566 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:08.566 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:08.580 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:08.580 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:08.575+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:08.683 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:08.679+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:08.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-09-20T21:03:08.711 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:08.711 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:08.724 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:08.783 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:08.779+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:08.846 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:08.847 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:08.860 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:08.884 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:08.879+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:08.976 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:08.976 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:08.984 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:08.983+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:08.989 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:09.085 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:09.079+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:09.114 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:09.115 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:09.128 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:09.185 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:09.183+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:09.252 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:09.252 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:09.267 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:09.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:03:09.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:03:09.308 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:09.307+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:09.391 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:09.383+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:09.427 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:09.427 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:09.427 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:09.448 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:09.448 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:09.451 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:09.451 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:09.462 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 117.265460645, 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:09.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:09.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:09.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:09.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:09.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:09.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:09.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:09.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:09.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:09.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:09.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:09.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:09.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:09.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:09.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:09.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:09.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:09.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:09.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:09.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:09.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:09.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:09.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:09.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:09.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:09.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:09.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:09.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:09.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:09.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:09.475 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.475 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.475 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.476 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:09.476 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:09.476 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 117.265236114, 2024-09-20T21:03:09.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:09.476 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.477 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.477 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.477 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:09.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:09.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:09.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:09.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:09.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:09.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:09.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:09.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:09.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:09.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:09.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:09.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:09.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:09.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:09.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:09.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:09.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:09.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:09.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:09.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:09.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:09.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:09.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:09.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:09.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:09.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:09.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:09.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:09.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:09.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:09.489 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.489 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.489 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.785541726000002, 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:09.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.495 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.785207500999999, 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:09.496 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:09.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.784948684, 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:09.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:09.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:09.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:09.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:09.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.783333766999998, 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:09.507 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:09.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:09.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:09.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:09.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:09.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:09.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:09.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:09.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:09.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:09.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.514 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.514 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:09.514 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:09.515 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.781015846999999, 2024-09-20T21:03:09.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:09.515 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:09.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:09.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.515 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:09.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.516 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:09.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:09.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:09.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:09.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:09.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:09.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:09.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:09.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:09.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:09.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:09.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:09.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:09.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:09.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:09.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:09.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:09.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:09.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:09.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:09.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:09.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:09.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:09.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:09.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:09.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:09.524 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.524 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.524 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.524 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:09.524 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:09.524 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.778987753999999, 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:09.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:09.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:09.529 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.529 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.529 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.529 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:09.529 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:09.529 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.778863114, 2024-09-20T21:03:09.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:09.530 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.530 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.530 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.530 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:09.530 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:09.530 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.531 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:09.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.531 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:09.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:09.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:09.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:09.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:09.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:09.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:09.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:09.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:09.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:09.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:09.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:09.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:09.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:09.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:09.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:09.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:09.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:09.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:09.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:09.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.538 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.539 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:09.539 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:09.539 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.776854796999999, 2024-09-20T21:03:09.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:09.539 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.539 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.539 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:09.540 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:09.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:09.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:09.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:09.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:09.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:09.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:09.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:09.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:09.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:09.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:09.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:09.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:09.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:09.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:09.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:09.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.546 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.547 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:09.547 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:09.547 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.775794137999998, 2024-09-20T21:03:09.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:09.547 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.547 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.548 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.548 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:09.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:09.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:09.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:09.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:09.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:09.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:09.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:09.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:09.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:09.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:09.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:09.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:09.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:09.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:09.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:09.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:09.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:09.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.555 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.555 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:09.555 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:09.555 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.775600313999998, 2024-09-20T21:03:09.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:09.556 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.556 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.556 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:09.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:09.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.556 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:09.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.557 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:09.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:09.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:09.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:09.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:09.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:09.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:09.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:09.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:09.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:09.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:09.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:09.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:09.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:09.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:09.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:09.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:09.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:09.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:09.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:09.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:09.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:09.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:09.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:09.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:09.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:09.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.565 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.566 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:09.566 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:09.566 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.775523679999999, 2024-09-20T21:03:09.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:09.566 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.566 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.567 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:09.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:09.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.567 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:09.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.567 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:09.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:09.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:09.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:09.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:09.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:09.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:09.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:09.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:09.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:09.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:09.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:09.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:09.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:09.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:09.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:09.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:09.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:09.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:09.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:09.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.575 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.575 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:09.575 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:09.576 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.775452477000002, 2024-09-20T21:03:09.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:09.576 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.576 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.576 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:09.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:09.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.576 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:09.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.577 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:09.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:09.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:09.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.775137280999999, 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.582 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.586 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.773730544999999, 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.587 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:09.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:09.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:09.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:09.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.592 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.773476686999999, 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:09.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:09.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:09.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.772891959999999, 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.597 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:09.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:09.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:09.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.601 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.601 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.772869708000002, 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:09.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:09.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:09.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:09.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:09.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:09.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:09.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:09.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.77180224, 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.607 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:09.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:09.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:09.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.611 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:09.612 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:09.612 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:09.613 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:09.614 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:09.607+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:09.714 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:09.707+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:229461 5.b 5:d381dd14:::benchmark_data_smithi112_23632_object97357:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:09.765447+0000", 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0019844089999999999, 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020116639999999998, 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 229461 2024-09-20T21:03:09.769 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765447+0000", 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765447+0000", 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765448+0000", 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5199999999999995e-07 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765453+0000", 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0669999999999999e-06 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765463+0000", 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0127e-05 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.771 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765470+0000", 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3069999999999997e-06 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765533+0000", 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3181000000000004e-05 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765683+0000", 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014972 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.772 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765806+0000", 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000123514 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:229464 5.0 5:0e9268b9:::benchmark_data_smithi112_23632_object97360:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:09.765493+0000", 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001937636, 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020431690000000001, 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:09.773 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 229464 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765493+0000", 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.774 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765493+0000", 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765494+0000", 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6499999999999999e-07 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765497+0000", 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2109999999999998e-06 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.775 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765505+0000", 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765511+0000", 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2530000000000001e-06 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765555+0000", 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3985e-05 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.776 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765673+0000", 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118447 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.766872+0000", 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0011988910000000001 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:229465 5.8 5:15fb97cf:::benchmark_data_smithi112_23632_object97361:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-20T21:03:09.777 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:09.765527+0000", 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001904064, 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020798959999999999, 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 229465 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:09.778 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765527+0000", 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765527+0000", 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765527+0000", 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7299999999999996e-07 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:09.779 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765530+0000", 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.914e-06 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765538+0000", 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7200000000000006e-06 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765544+0000", 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8649999999999998e-06 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.780 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765590+0000", 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6226000000000001e-05 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765719+0000", 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000128615 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765852+0000", 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013361100000000001 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:09.781 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:229467 5.e 5:73c168f7:::benchmark_data_smithi112_23632_object97363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:09.765649+0000", 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0017823520000000001, 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002027909, 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 229467 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765649+0000", 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765649+0000", 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.783 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765649+0000", 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3699999999999999e-07 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765654+0000", 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3229999999999999e-06 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765666+0000", 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1826e-05 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.784 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765671+0000", 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3879999999999999e-06 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765727+0000", 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5988e-05 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765823+0000", 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6037000000000002e-05 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.785 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765927+0000", 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000104456 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:229439 5.0 e70/69)", 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:09.765776+0000", 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001655318, 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019691829999999998, 2024-09-20T21:03:09.786 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765776+0000", 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765776+0000", 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.787 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765776+0000", 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9599999999999999e-07 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765780+0000", 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8419999999999998e-06 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765789+0000", 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.788 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765795+0000", 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2020000000000001e-06 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:229462 5.a e70/21 5:5ed467fd:::benchmark_data_smithi112_23632_object97358:head v 70'14380, mlcod=70'14377)", 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:09.765817+0000", 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001614135, 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00197868, 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:09.789 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765817+0000", 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765817+0000", 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.790 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765817+0000", 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0200000000000003e-07 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765823+0000", 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2970000000000003e-06 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765830+0000", 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2849999999999997e-06 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765835+0000", 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2299999999999999e-06 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765887+0000", 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1649e-05 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765900+0000", 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.792 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:229468 5.f 5:ff39e13b:::benchmark_data_smithi112_23632_object97364:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:09.766766+0000", 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00066514299999999998, 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001079254, 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.793 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 229468 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.766766+0000", 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.766766+0000", 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:09.794 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.766767+0000", 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0999999999999997e-07 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.766771+0000", 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6990000000000002e-06 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.766782+0000", 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0905e-05 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.795 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.766789+0000", 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0430000000000002e-06 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.766852+0000", 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2582999999999994e-05 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.766968+0000", 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011568100000000001 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:09.796 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:229439 5.0 5:02f7def9:::benchmark_data_smithi112_23632_object97335:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:09.757005+0000", 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.010425650999999999, 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010879494999999999, 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 229439 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.797 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.757005+0000", 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.757005+0000", 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.757006+0000", 2024-09-20T21:03:09.798 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6200000000000006e-07 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.757011+0000", 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2660000000000003e-06 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.757022+0000", 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1661999999999999e-05 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.757030+0000", 2024-09-20T21:03:09.799 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6620000000000005e-06 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.761835+0000", 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004804844 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.761973+0000", 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000137847 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.762105+0000", 2024-09-20T21:03:09.800 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000132087 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:09.765414+0000", 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003308947 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 8 2024-09-20T21:03:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:09.802 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:09.847 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:09.843+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:09.918 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:09.911+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:09.999 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:09.999 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:09.999 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:03:09.999 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:03:09.999 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:10.016 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:10.015+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:10.019 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:10.117 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:10.115+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:10.214 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:10.214 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:03:10.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 118.015667448, 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:03:10.219 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:03:10.220 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 118.015577412, 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.221 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:10.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.222 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:10.222 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.222 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.222 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.222 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.223 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:03:10.224 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:03:10.225 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:03:10.226 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 118.015491059, 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:03:10.227 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.228 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:03:10.229 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:10.230 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.231 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:03:10.232 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.233 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 118.01542225, 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.234 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:03:10.235 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.236 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.237 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.238 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:03:10.239 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 118.01538939, 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.240 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:10.241 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.242 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.242 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:03:10.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:03:10.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.242 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.242 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.242 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:03:10.242 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:03:10.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:10.243 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:03:10.244 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.245 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 118.015347373, 2024-09-20T21:03:10.246 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:10.247 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:03:10.248 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:10.249 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.250 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.251 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.252 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 118.015222267, 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.253 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.254 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.255 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.256 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:03:10.257 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.258 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 118.015129918, 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.259 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:03:10.260 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:03:10.261 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.263 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 118.015045546, 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:03:10.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.249586089999994, 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.268 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:03:10.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:03:10.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.249034084000002, 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.274 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:10.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:03:10.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.279 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 79.248406502999998, 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:03:10.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:03:10.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 58.498672607000003, 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:03:10.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 58.494321681999999, 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:03:10.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:10.297 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 58.486079611000001, 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:03:10.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:03:10.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:10.303 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 18.536950298000001, 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:10.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:03:10.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:03:10.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:10.309 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 18.531033731000001, 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:10.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:03:10.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 18.527764113, 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:03:10.315 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:10.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:03:10.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 18.527263592000001, 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.321 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:10.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.326 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 18.527108305999999, 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.327 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.328 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:03:10.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:03:10.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:10.332 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:10.333 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:10.335 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:03:10.335 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:10.331+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:10.336 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:10.435 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:10.431+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:10.501 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:10.501 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:10.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.501 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:231281 5.8 e71/63 5:11b7edf5:::benchmark_data_smithi112_23632_object99177:head v 71'14477, mlcod=71'14475)", 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.495611+0000", 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0041539599999999999, 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0041769750000000003, 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495611+0000", 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495611+0000", 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495612+0000", 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6899999999999996e-07 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495619+0000", 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3159999999999999e-06 2024-09-20T21:03:10.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495628+0000", 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7020000000000007e-06 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495633+0000", 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5330000000000002e-06 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495687+0000", 2024-09-20T21:03:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3189000000000002e-05 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495700+0000", 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2942000000000001e-05 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:231285 5.6 5:631a6fb9:::benchmark_data_smithi112_23632_object99181:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.495932+0000", 2024-09-20T21:03:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0038333780000000001, 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039212129999999998, 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 231285 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495932+0000", 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495932+0000", 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495932+0000", 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3300000000000002e-07 2024-09-20T21:03:10.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495935+0000", 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.954e-06 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495942+0000", 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0870000000000001e-06 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.495954+0000", 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.148e-05 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.496055+0000", 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010122 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498101+0000", 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0020465190000000001 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.509 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:231290 5.1 5:8e840f63:::benchmark_data_smithi112_23632_object99186:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.496632+0000", 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0031325720000000001, 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032882639999999999, 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.510 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 231290 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.496632+0000", 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.496632+0000", 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.496633+0000", 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.84e-07 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.496635+0000", 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3520000000000001e-06 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.496643+0000", 2024-09-20T21:03:10.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9899999999999997e-06 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.496648+0000", 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0839999999999999e-06 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.496702+0000", 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4106e-05 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.496846+0000", 2024-09-20T21:03:10.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143628 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499812+0000", 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029660229999999999 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499859+0000", 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6594999999999997e-05 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:231284 5.4 e71/63 5:2ce63358:::benchmark_data_smithi112_23632_object99180:head v 71'14621, mlcod=71'14618)", 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.498534+0000", 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001231036, 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014619019999999999, 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498534+0000", 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498534+0000", 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498534+0000", 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8299999999999998e-07 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498538+0000", 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9129999999999996e-06 2024-09-20T21:03:10.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498544+0000", 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3709999999999999e-06 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498547+0000", 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.687e-06 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498590+0000", 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2944000000000001e-05 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498610+0000", 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9769999999999999e-05 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:231288 5.e e71/21 5:7bab5322:::benchmark_data_smithi112_23632_object99184:head v 71'14424, mlcod=71'14422)", 2024-09-20T21:03:10.518 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.498557+0000", 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001207575, 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015059800000000001, 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498557+0000", 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498557+0000", 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498558+0000", 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.79e-07 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498573+0000", 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5424999999999999e-05 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498579+0000", 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.161e-06 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498582+0000", 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.236e-06 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498626+0000", 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3306000000000002e-05 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498646+0000", 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9970999999999999e-05 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:231282 5.8 e71/63 5:1dcd6243:::benchmark_data_smithi112_23632_object99178:head v 71'14478, mlcod=71'14475)", 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.498592+0000", 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001172967, 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001526356, 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.522 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498592+0000", 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498592+0000", 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498592+0000", 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.03e-07 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498595+0000", 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0979999999999998e-06 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498601+0000", 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9680000000000003e-06 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498607+0000", 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8279999999999999e-06 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499528+0000", 2024-09-20T21:03:10.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00092050900000000002 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499544+0000", 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6161e-05 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:231292 5.4 e71/63)", 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.498630+0000", 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0011350970000000001, 2024-09-20T21:03:10.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015397060000000001, 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498630+0000", 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498630+0000", 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498630+0000", 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4400000000000001e-07 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498637+0000", 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3759999999999996e-06 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498643+0000", 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8669999999999996e-06 2024-09-20T21:03:10.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.498648+0000", 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7140000000000001e-06 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:231293 5.b e71/21 5:dcacb3a9:::benchmark_data_smithi112_23632_object99189:head v 71'14759, mlcod=71'14757)", 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.499493+0000", 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00027177899999999999, 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00072111300000000001, 2024-09-20T21:03:10.529 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499493+0000", 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499493+0000", 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499494+0000", 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4899999999999995e-07 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499501+0000", 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8580000000000002e-06 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499510+0000", 2024-09-20T21:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2599999999999994e-06 2024-09-20T21:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499516+0000", 2024-09-20T21:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1229999999999997e-06 2024-09-20T21:03:10.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499588+0000", 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1796000000000002e-05 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499607+0000", 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9130000000000001e-05 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.533 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:231291 5.8 e71/63)", 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.499556+0000", 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00020893999999999999, 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00072729499999999998, 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499556+0000", 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499556+0000", 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499556+0000", 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5499999999999999e-07 2024-09-20T21:03:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499563+0000", 2024-09-20T21:03:10.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2620000000000004e-06 2024-09-20T21:03:10.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499570+0000", 2024-09-20T21:03:10.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9720000000000003e-06 2024-09-20T21:03:10.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.499574+0000", 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8119999999999998e-06 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:231296 5.a 5:5704e46f:::benchmark_data_smithi112_23632_object99192:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.500077+0000", 2024-09-20T21:03:10.538 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9996877, 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000254968, 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 231296 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500077+0000", 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500077+0000", 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500078+0000", 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0499999999999999e-06 2024-09-20T21:03:10.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500084+0000", 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3709999999999999e-06 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500094+0000", 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0616e-05 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500100+0000", 2024-09-20T21:03:10.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4219999999999999e-06 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500146+0000", 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6247e-05 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500249+0000", 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102731 2024-09-20T21:03:10.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500341+0000", 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2547999999999996e-05 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:231297 5.6 5.4ed7d7b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.500115+0000", 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9996505, 2024-09-20T21:03:10.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030019200000000002, 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 231297 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500115+0000", 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500115+0000", 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500115+0000", 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7700000000000005e-07 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500118+0000", 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4240000000000002e-06 2024-09-20T21:03:10.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500126+0000", 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.43e-06 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500131+0000", 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5720000000000002e-06 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:231299 5.6 5.c3519bc6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.500140+0000", 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9996247, 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033080799999999998, 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 231299 2024-09-20T21:03:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500140+0000", 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500140+0000", 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500141+0000", 2024-09-20T21:03:10.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2300000000000002e-07 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500143+0000", 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3089999999999998e-06 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500149+0000", 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.789e-06 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500156+0000", 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9580000000000001e-06 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:231300 5.7 5:ee4b5fd4:::benchmark_data_smithi112_23632_object99196:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.500268+0000", 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9994969, 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024661099999999999, 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.550 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 231300 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500268+0000", 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500268+0000", 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500269+0000", 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.68e-07 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500273+0000", 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.658e-06 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500283+0000", 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0015e-05 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500289+0000", 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.905e-06 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500342+0000", 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2848e-05 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500464+0000", 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012130599999999999 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:231301 5.1 5:84c0021c:::benchmark_data_smithi112_23632_object99197:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:10.500401+0000", 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9993634, 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0001494, 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.554 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 231301 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500401+0000", 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500401+0000", 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500402+0000", 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5499999999999997e-07 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500407+0000", 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5970000000000002e-06 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500416+0000", 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5799999999999998e-06 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500424+0000", 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2729999999999997e-06 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:10.500485+0000", 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1550999999999994e-05 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.558 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.558 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:03:10.558 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 14 2024-09-20T21:03:10.558 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:10.559 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:10.560 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:10.555+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:10.659 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:10.655+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:10.754 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:03:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:03:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:03:10.755 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:10.764 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:10.763+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:10.773 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:10.861 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:10.855+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:10.962 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:10.955+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:10.965 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:10.965 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:10.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:10.965 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:10.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.965 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.965 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:10.965 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.768216649, 2024-09-20T21:03:10.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:10.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:10.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:10.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:10.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:10.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:10.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:10.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:10.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:10.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:10.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:10.972 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.767992118, 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.973 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:10.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:10.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:10.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:10.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:10.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:10.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:10.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:10.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:10.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:10.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:10.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:10.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:10.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:10.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:10.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:10.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:10.980 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.981 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.981 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.981 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:10.981 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:10.981 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.28829773, 2024-09-20T21:03:10.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:10.981 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.982 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.982 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:10.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:10.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.982 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:10.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.982 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:10.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:10.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:10.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:10.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:10.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:10.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:10.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:10.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:10.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:10.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:10.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:10.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:10.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:10.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:10.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:10.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:10.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:10.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:10.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:10.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.989 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.287963505, 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:10.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:10.991 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:10.991 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:10.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.991 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:10.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:10.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:10.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:10.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:10.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:10.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:10.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:10.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:10.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:10.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:10.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:10.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:10.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:10.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:10.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:10.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:10.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:10.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:10.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:10.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:10.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:10.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:10.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:10.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:10.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:10.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:10.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:10.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:10.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:10.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:10.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:10.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:10.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:10.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:10.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:10.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:10.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:11.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:11.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:11.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.001 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.001 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.001 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:11.001 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:11.001 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.287704688000002, 2024-09-20T21:03:11.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:11.002 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.002 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.002 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.002 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:11.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:11.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:11.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:11.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:11.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:11.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:11.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:11.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:11.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:11.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:11.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:11.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:11.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:11.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:11.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:11.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:11.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:11.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.286089771, 2024-09-20T21:03:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.013 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:11.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:11.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:11.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:11.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:11.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:11.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:11.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:11.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:11.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:11.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:11.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:11.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:11.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:11.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:11.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:11.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:11.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:11.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:11.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:11.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:11.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:11.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:11.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:11.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:11.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:11.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:11.021 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.021 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.021 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.022 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:11.022 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:11.022 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.283771851000001, 2024-09-20T21:03:11.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:11.023 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.023 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:11.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:11.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.023 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:11.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.024 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:11.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:11.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:11.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:11.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:11.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:11.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:11.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:11.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:11.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:11.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:11.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:11.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:11.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:11.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:11.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:11.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:11.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:11.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:11.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:11.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:11.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:11.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:11.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:11.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:11.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:11.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:11.033 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.033 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.033 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.034 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:11.034 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:11.034 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.281743758000001, 2024-09-20T21:03:11.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:11.035 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.035 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.035 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.035 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:11.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:11.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:11.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:11.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:11.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:11.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:11.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:11.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:11.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:11.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:11.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:11.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:11.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:11.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:11.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:11.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:11.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:11.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.043 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.044 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:11.044 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:11.044 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.281619117999998, 2024-09-20T21:03:11.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:11.044 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.045 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.045 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:11.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:11.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.045 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:11.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.046 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:11.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:11.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:11.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:11.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:11.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:11.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:11.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:11.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:11.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:11.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:11.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:11.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:11.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:11.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:11.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:11.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:11.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:11.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:11.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:11.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:11.054 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.054 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.054 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.054 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.279610801, 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.278550142, 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:11.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:11.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.278356318, 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:11.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:11.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.068 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.278279684000001, 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.073 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.278208481, 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.277893285000001, 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.079 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:11.083 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.276486549000001, 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:11.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:11.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:11.088 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.276232691000001, 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:11.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.275647964000001, 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:11.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:11.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.096 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.275625712, 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:11.100 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.274558244000001, 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:11.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:11.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:11.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:11.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:11.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:11.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:11.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:11.105 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.105 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.105 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.105 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:11.105 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:11.105 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:11.107 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:11.107 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:11.103+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:11.207 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:11.203+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:11.261 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:11.261 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:11.261 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.261 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233176 5.d 5:b7c8815e:::benchmark_data_smithi112_23632_object101072:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.261 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.256494+0000", 2024-09-20T21:03:11.261 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.002892071, 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029109650000000002, 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233176 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256494+0000", 2024-09-20T21:03:11.262 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256494+0000", 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256495+0000", 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3399999999999997e-07 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.263 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256499+0000", 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3429999999999998e-06 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256510+0000", 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1576999999999999e-05 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256518+0000", 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1899999999999998e-06 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.264 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256573+0000", 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5565000000000001e-05 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256683+0000", 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110085 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.265 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233177 5.0 5:00edfe2b:::benchmark_data_smithi112_23632_object101073:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.256538+0000", 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0028476159999999999, 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0029377650000000002, 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233177 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256538+0000", 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256538+0000", 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256539+0000", 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.68e-07 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256542+0000", 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.157e-06 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256550+0000", 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4360000000000002e-06 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256557+0000", 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2469999999999997e-06 2024-09-20T21:03:11.268 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257177+0000", 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00062001700000000005 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257291+0000", 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00011393800000000001 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:11.269 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257394+0000", 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0001038 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233178 5.8 5:14410b85:::benchmark_data_smithi112_23632_object101074:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.256745+0000", 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0026406590000000001, 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027736760000000001, 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:11.270 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233178 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256745+0000", 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256745+0000", 2024-09-20T21:03:11.271 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256746+0000", 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4300000000000002e-07 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256750+0000", 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0740000000000003e-06 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256761+0000", 2024-09-20T21:03:11.272 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0777e-05 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256768+0000", 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5549999999999997e-06 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257164+0000", 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000395802 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.258394+0000", 2024-09-20T21:03:11.273 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0012295990000000001 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.258455+0000", 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.1709000000000002e-05 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233179 5.0 5:022c4f04:::benchmark_data_smithi112_23632_object101075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.256874+0000", 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0025117389999999998, 2024-09-20T21:03:11.274 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0026829050000000002, 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233179 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256874+0000", 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.275 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256874+0000", 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256875+0000", 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4399999999999999e-07 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256879+0000", 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1359999999999999e-06 2024-09-20T21:03:11.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256889+0000", 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0477e-05 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256896+0000", 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5980000000000002e-06 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.258907+0000", 2024-09-20T21:03:11.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0020112200000000002 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.259029+0000", 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121493 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.259154+0000", 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012543600000000001 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233181 5.4 5:296c66be:::benchmark_data_smithi112_23632_object101077:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.257631+0000", 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0017550529999999999, 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00196561, 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233181 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257631+0000", 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257631+0000", 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257632+0000", 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3500000000000005e-07 2024-09-20T21:03:11.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257636+0000", 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2590000000000002e-06 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257648+0000", 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1702000000000001e-05 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257655+0000", 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3250000000000002e-06 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.258020+0000", 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00036476100000000001 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.258126+0000", 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000105876 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.258227+0000", 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000101505 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:233165 5.e e71/21)", 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.257831+0000", 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001554955, 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018007850000000001, 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.283 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257831+0000", 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257831+0000", 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257831+0000", 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2600000000000002e-07 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257835+0000", 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5980000000000001e-06 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257860+0000", 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.5469999999999998e-05 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257867+0000", 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.251e-06 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233161 5.e 5:7ffc5605:::benchmark_data_smithi112_23632_object101057:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.251923+0000", 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.007462855, 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077352480000000001, 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.286 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233161 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251923+0000", 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251923+0000", 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251924+0000", 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6600000000000005e-07 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251929+0000", 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0180000000000001e-06 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251942+0000", 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.305e-05 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251950+0000", 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8930000000000005e-06 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251994+0000", 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4474999999999997e-05 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.252080+0000", 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5702e-05 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.252146+0000", 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6353000000000007e-05 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257255+0000", 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0051089509999999996 2024-09-20T21:03:11.290 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233162 5.0 5:0cfee94f:::benchmark_data_smithi112_23632_object101058:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.251968+0000", 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.007417781, 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077331209999999999, 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.291 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233162 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251968+0000", 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251968+0000", 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251968+0000", 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.37e-07 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251972+0000", 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.252e-06 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251980+0000", 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5159999999999994e-06 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.251986+0000", 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8860000000000001e-06 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.252021+0000", 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5117999999999998e-05 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.252147+0000", 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012533100000000001 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.252241+0000", 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4854999999999999e-05 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.258876+0000", 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0066348179999999998 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.295 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233165 5.e 5:7434c392:::benchmark_data_smithi112_23632_object101061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.253028+0000", 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0063580169999999997, 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0067310240000000004, 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233165 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253028+0000", 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253028+0000", 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253029+0000", 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4099999999999997e-07 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253033+0000", 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5379999999999996e-06 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253045+0000", 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1796e-05 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253052+0000", 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.469e-06 2024-09-20T21:03:11.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253937+0000", 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00088478799999999996 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.254058+0000", 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000120827 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.254168+0000", 2024-09-20T21:03:11.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010962 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233167 5.d 5:b655bee6:::benchmark_data_smithi112_23632_object101063:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.253146+0000", 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0062400590000000001, 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0066580679999999996, 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.300 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233167 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253146+0000", 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253146+0000", 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253146+0000", 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0200000000000001e-07 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253150+0000", 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.512e-06 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253158+0000", 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4810000000000006e-06 2024-09-20T21:03:11.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253166+0000", 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9670000000000001e-06 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253215+0000", 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8194e-05 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253343+0000", 2024-09-20T21:03:11.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012889800000000001 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:233164 5.a e71/21 5:55ec7070:::benchmark_data_smithi112_23632_object101060:head v 71'14609, mlcod=71'14607)", 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.253416+0000", 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0059693150000000002, 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0064227549999999996, 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253416+0000", 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253416+0000", 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253417+0000", 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2700000000000001e-07 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253420+0000", 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.0489999999999999e-06 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253424+0000", 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2300000000000002e-06 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253427+0000", 2024-09-20T21:03:11.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.444e-06 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253464+0000", 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6950999999999999e-05 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253486+0000", 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2069000000000002e-05 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233171 5.0 5:01016396:::benchmark_data_smithi112_23632_object101067:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.253413+0000", 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0059726240000000002, 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0064581660000000004, 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233171 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253413+0000", 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253413+0000", 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253414+0000", 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.16e-07 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253418+0000", 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0130000000000004e-06 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253427+0000", 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4749999999999999e-06 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253433+0000", 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0730000000000001e-06 2024-09-20T21:03:11.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253487+0000", 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3557000000000002e-05 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253605+0000", 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000118416 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.253726+0000", 2024-09-20T21:03:11.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012103 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:233170 5.a e71/21 5:5f37ca17:::benchmark_data_smithi112_23632_object101066:head v 71'14610, mlcod=71'14607)", 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.255505+0000", 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0038804859999999998, 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0044031310000000002, 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255505+0000", 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255505+0000", 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255506+0000", 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.04e-06 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255514+0000", 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7759999999999997e-06 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255527+0000", 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2465e-05 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255536+0000", 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8439999999999993e-06 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255591+0000", 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4605000000000003e-05 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255613+0000", 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1902000000000001e-05 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233174 5.0 5:0b031ada:::benchmark_data_smithi112_23632_object101070:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.315 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.255681+0000", 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0037049240000000001, 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0042732300000000003, 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233174 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255681+0000", 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255681+0000", 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255682+0000", 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.195e-06 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255687+0000", 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3410000000000002e-06 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255699+0000", 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2034e-05 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255709+0000", 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8330000000000006e-06 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255747+0000", 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7592999999999997e-05 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255826+0000", 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9499999999999994e-05 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.255891+0000", 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4750000000000002e-05 2024-09-20T21:03:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:233175 5.4 5:258dc0ad:::benchmark_data_smithi112_23632_object101071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.256059+0000", 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0033266300000000001, 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0039648280000000001, 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:11.320 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 233175 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256059+0000", 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256059+0000", 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256060+0000", 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0389999999999999e-06 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256065+0000", 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4299999999999999e-06 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256079+0000", 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4365000000000001e-05 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256087+0000", 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.824e-06 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256129+0000", 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2002999999999997e-05 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256205+0000", 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6686000000000004e-05 2024-09-20T21:03:11.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256268+0000", 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2211000000000005e-05 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:233173 5.a e71/21 5:556a81e3:::benchmark_data_smithi112_23632_object101069:head v 71'14611, mlcod=71'14607)", 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:11.256489+0000", 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0028970770000000001, 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035966409999999998, 2024-09-20T21:03:11.324 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256489+0000", 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256489+0000", 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256489+0000", 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-07 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256494+0000", 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.13e-06 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256507+0000", 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2412000000000001e-05 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.256513+0000", 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5679999999999996e-06 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257267+0000", 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00075341799999999995 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:11.257281+0000", 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4561e-05 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.327 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:11.328 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.328 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:11.328 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:03:11.328 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 16 2024-09-20T21:03:11.328 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:11.329 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:11.330 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:11.327+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:11.430 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:11.427+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:11.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:03:11.484 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:11.485 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:11.485 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:03:11.485 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:03:11.485 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:11.504 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:11.547 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:11.543+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:11.615 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:11.615 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:11.615 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:11.634 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:11.627+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:11.635 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:11.635 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:11.637 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:11.638 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:11.663 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:11.663 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:11.679 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:11.734 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:11.731+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:11.834 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:11.834 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:11.834 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:11.827+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:11.855 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:11.935 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:11.927+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:12.036 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:12.031+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:12.050 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:12.050 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:12.071 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:12.136 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:12.131+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:12.224 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:12.225 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:12.237 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:12.235+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:12.247 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:12.273 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-09-20T21:03:12.274 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-09-20T21:03:12.274 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi161.front.sepia.ceph.com 2024-09-20T21:03:12.274 INFO:teuthology.orchestra.console.smithi161:Power on 2024-09-20T21:03:12.274 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-20T21:03:12.298 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-09-20T21:03:12.336 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:03:12.338 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:12.335+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:12.403 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:12.403 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:12.423 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:12.467 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:12.463+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:12.539 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:12.535+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:12.573 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:12.573 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:12.592 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:12.679 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:12.675+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:12.741 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:12.735+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:12.786 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:12.786 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:12.806 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:12.847 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:12.843+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:12.943 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:12.939+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:12.955 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:12.955 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:12.976 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:13.044 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:13.039+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:13.145 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:13.139+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:13.174 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:13.174 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:13.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:13.246 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:13.243+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:13.279 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:03:13.344 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:13.345 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:13.347 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:13.343+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:13.362 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:13.448 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:13.447+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:13.516 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:13.516 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:13.536 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:13.549 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:13.547+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:13.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:03:13.650 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:13.647+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:13.695 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:13.695 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:13.716 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:13.763 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:13.759+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:13.796 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:13.796 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:13.796 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:13.817 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:13.818 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:13.821 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:13.821 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:13.851 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:13.847+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:13.877 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:13.877 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:03:13.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:03:13.877 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:13.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 121.677186401, 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:03:13.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:03:13.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:03:13.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:03:13.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:03:13.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:03:13.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:03:13.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 121.677096365, 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:03:13.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 121.677010012, 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:03:13.891 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:03:13.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:03:13.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:03:13.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:03:13.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:03:13.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:03:13.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:03:13.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:03:13.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:03:13.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:13.898 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 121.676941203, 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:13.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:13.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:03:13.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:03:13.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:03:13.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:03:13.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:03:13.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:03:13.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 121.67690834299999, 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:03:13.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.911 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 121.676866326, 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:03:13.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:03:13.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:03:13.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.917 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.918 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 121.67674122, 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:03:13.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:03:13.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 121.676648871, 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:03:13.925 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:03:13.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:03:13.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.929 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 121.67656449899999, 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:13.930 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:03:13.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:03:13.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.934 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.911105043000006, 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.935 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:03:13.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.940 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.910553037, 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.941 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:03:13.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:03:13.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 82.909925455999996, 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.947 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:13.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:03:13.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.952 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 62.160191560000001, 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:03:13.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:03:13.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 62.155840634999997, 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:03:13.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:03:13.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:13.964 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 62.147598563999999, 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:03:13.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:03:13.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:13.970 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.198469250999999, 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:13.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.972 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:13.976 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.192552683999999, 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:03:13.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:03:13.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.981 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:13.982 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.189283066000002, 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:13.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:03:13.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.188782544999999, 2024-09-20T21:03:13.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:03:13.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 22.188627259, 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:03:13.994 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:03:13.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:03:13.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:13.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:03:14.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:03:14.000 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.000 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.000 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.000 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.000 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.000 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:14.001 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:13.995+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:14.002 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:14.102 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:14.095+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:14.155 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:14.155 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:14.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.155 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:240610 5.8 e72/63 5:121a0596:::benchmark_data_smithi112_23632_object108506:head v 72'15093, mlcod=72'15090)", 2024-09-20T21:03:14.155 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.149934+0000", 2024-09-20T21:03:14.155 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003049974, 2024-09-20T21:03:14.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030735150000000002, 2024-09-20T21:03:14.155 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.155 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149934+0000", 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149934+0000", 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149934+0000", 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000004e-07 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149940+0000", 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2290000000000002e-06 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149949+0000", 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5580000000000006e-06 2024-09-20T21:03:14.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149956+0000", 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.72e-06 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150004+0000", 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7632000000000001e-05 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150023+0000", 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9140999999999999e-05 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:240616 5.5 5:a68f9777:::benchmark_data_smithi112_23632_object108512:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.149952+0000", 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0030314069999999999, 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031202299999999999, 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 240616 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149952+0000", 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149952+0000", 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149953+0000", 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1399999999999995e-07 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149957+0000", 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8689999999999997e-06 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149967+0000", 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8549999999999997e-06 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149973+0000", 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4139999999999999e-06 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150023+0000", 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0222000000000001e-05 2024-09-20T21:03:14.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150139+0000", 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011576100000000001 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.153016+0000", 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028768439999999999 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.153057+0000", 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0669e-05 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:240612 5.b e72/21 5:d96a497c:::benchmark_data_smithi112_23632_object108508:head v 72'15317, mlcod=72'15315)", 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.149983+0000", 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0030010179999999998, 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031699250000000001, 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.164 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:14.165 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149983+0000", 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149983+0000", 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149983+0000", 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7300000000000002e-07 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149987+0000", 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6239999999999999e-06 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149994+0000", 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0949999999999998e-06 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150001+0000", 2024-09-20T21:03:14.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3000000000000004e-06 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150040+0000", 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8575000000000003e-05 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150057+0000", 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7442e-05 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.168 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:240618 5.4 e72/63 5:2e029cd3:::benchmark_data_smithi112_23632_object108514:head v 72'15192, mlcod=72'15190)", 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.150352+0000", 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0026320129999999999, 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028593759999999998, 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150352+0000", 2024-09-20T21:03:14.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150352+0000", 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150352+0000", 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9100000000000003e-07 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150357+0000", 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0549999999999999e-06 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150369+0000", 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1386000000000001e-05 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.150375+0000", 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.314e-06 2024-09-20T21:03:14.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151690+0000", 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001314562 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151708+0000", 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8720999999999999e-05 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:240619 5.a 5:55485b8a:::benchmark_data_smithi112_23632_object108515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.151857+0000", 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00112659, 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014140839999999999, 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 240619 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.173 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151857+0000", 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151857+0000", 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151858+0000", 2024-09-20T21:03:14.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000002e-07 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151862+0000", 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7699999999999999e-06 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151868+0000", 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7989999999999996e-06 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151873+0000", 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4669999999999998e-06 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151930+0000", 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6981000000000002e-05 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152052+0000", 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000122612 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152163+0000", 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110778 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:240620 5.2 5:4da78bbf:::benchmark_data_smithi112_23632_object108516:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.151886+0000", 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001097673, 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014555849999999999, 2024-09-20T21:03:14.177 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 240620 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151886+0000", 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151886+0000", 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151886+0000", 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.84e-07 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151888+0000", 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.685e-06 2024-09-20T21:03:14.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151892+0000", 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4139999999999996e-06 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151895+0000", 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0690000000000002e-06 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152946+0000", 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001050523 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.153057+0000", 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110729 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:240614 5.b e72/21 5:d19e1522:::benchmark_data_smithi112_23632_object108510:head v 72'15318, mlcod=72'15315)", 2024-09-20T21:03:14.181 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.152021+0000", 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00096235699999999995, 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013822019999999999, 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152021+0000", 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152021+0000", 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152022+0000", 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4099999999999998e-07 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152027+0000", 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9080000000000003e-06 2024-09-20T21:03:14.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152035+0000", 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152041+0000", 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6919999999999999e-06 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152403+0000", 2024-09-20T21:03:14.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036214400000000001 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152422+0000", 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8488999999999999e-05 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:240621 5.8 e72/63)", 2024-09-20T21:03:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.152386+0000", 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00059764900000000001, 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00107172, 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152386+0000", 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152386+0000", 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152386+0000", 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.75e-07 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152391+0000", 2024-09-20T21:03:14.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6460000000000001e-06 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152405+0000", 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4431e-05 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152411+0000", 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4469999999999997e-06 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:240622 5.4 e72/63)", 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.152434+0000", 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00055001599999999996, 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001065889, 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152434+0000", 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152434+0000", 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152434+0000", 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8799999999999998e-07 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152438+0000", 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2030000000000002e-06 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152446+0000", 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9540000000000004e-06 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152451+0000", 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0289999999999996e-06 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.191 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:240623 5.c 5.5cdcd6fc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.152456+0000", 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00052736600000000003, 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010875259999999999, 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.192 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 240623 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152456+0000", 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152456+0000", 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152457+0000", 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9300000000000006e-07 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152462+0000", 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7480000000000001e-06 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152474+0000", 2024-09-20T21:03:14.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2095e-05 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152482+0000", 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9710000000000004e-06 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:240624 5.a 5.79d02e9a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.152974+0000", 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.1430000000000004e-06, 2024-09-20T21:03:14.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061961500000000001, 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 240624 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152974+0000", 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152974+0000", 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152975+0000", 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5099999999999999e-07 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152979+0000", 2024-09-20T21:03:14.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5760000000000002e-06 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152987+0000", 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6600000000000001e-06 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.152992+0000", 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9080000000000003e-06 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:240605 5.a 5:5636c10c:::benchmark_data_smithi112_23632_object108501:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.147108+0000", 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0058757540000000004, 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065396830000000001, 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 240605 2024-09-20T21:03:14.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147108+0000", 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147108+0000", 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147108+0000", 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7300000000000002e-07 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147110+0000", 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.888e-06 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147116+0000", 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8300000000000001e-06 2024-09-20T21:03:14.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147119+0000", 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3569999999999998e-06 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147381+0000", 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026206599999999998 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147497+0000", 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116091 2024-09-20T21:03:14.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147606+0000", 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010888200000000001 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151850+0000", 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0042440560000000004 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.203 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:240607 5.8 e72/63 5:19497309:::benchmark_data_smithi112_23632_object108503:head v 72'15092, mlcod=72'15090)", 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.147687+0000", 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0052961600000000003, 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060510169999999997, 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147687+0000", 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147687+0000", 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147688+0000", 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7499999999999999e-07 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147694+0000", 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3290000000000001e-06 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147703+0000", 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147711+0000", 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2710000000000003e-06 2024-09-20T21:03:14.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147756+0000", 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5148999999999998e-05 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.147773+0000", 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7374999999999999e-05 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:240609 5.a 5:5802df83:::benchmark_data_smithi112_23632_object108505:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:14.149377+0000", 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0036061579999999999, 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0044224529999999998, 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 240609 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.208 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149377+0000", 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149377+0000", 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149378+0000", 2024-09-20T21:03:14.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.33e-07 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149383+0000", 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4669999999999998e-06 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149392+0000", 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1560000000000001e-06 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149399+0000", 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2450000000000001e-06 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149489+0000", 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0205999999999997e-05 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149609+0000", 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119667 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.149723+0000", 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114257 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:14.151889+0000", 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021660339999999998 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.212 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:03:14.213 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 14 2024-09-20T21:03:14.213 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:14.214 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:14.215 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:14.207+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:14.314 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:14.311+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:14.367 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:14.367 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:03:14.368 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:03:14.368 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:03:14.368 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:14.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:14.416 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:14.411+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:14.517 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:14.511+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:14.589 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:14.589 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.392952585, 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:14.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:14.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:14.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:14.596 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.392728054, 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:14.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:14.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.913033666, 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.603 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:14.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:14.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.912699441000001, 2024-09-20T21:03:14.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:14.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:14.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:14.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:14.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:14.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:14.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:14.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:14.615 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.912440623999998, 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:14.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.910825707000001, 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:14.620 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:14.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:14.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:14.626 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.908507787000001, 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:14.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.906479694000002, 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.632 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:14.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.906355053999999, 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:14.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:14.641 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.904346737000001, 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:14.645 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.903286078000001, 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:14.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:14.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:14.650 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.903092254000001, 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:14.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:14.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:14.656 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.903015620000001, 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:14.661 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.902944417, 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:14.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.902629221000002, 2024-09-20T21:03:14.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:14.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.671 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.901222485000002, 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:14.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:14.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:14.677 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.900968627000001, 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:14.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:14.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:14.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.900383900000001, 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:14.682 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.900361648000001, 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.686 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.899294179999998, 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:14.690 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:14.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:14.695 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:14.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-09-20T21:03:14.697 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:14.697 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:14.695+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:14.797 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:14.791+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:14.855 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:14.855 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:14.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.855 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242451 5.0 5:028aafae:::benchmark_data_smithi112_23632_object110347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.855 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.847456+0000", 2024-09-20T21:03:14.855 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0059181850000000003, 2024-09-20T21:03:14.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0059432249999999999, 2024-09-20T21:03:14.855 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242451 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.847456+0000", 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.847456+0000", 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.847457+0000", 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8599999999999998e-07 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.847460+0000", 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4290000000000001e-06 2024-09-20T21:03:14.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.847468+0000", 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7519999999999996e-06 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.847475+0000", 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0439999999999998e-06 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:14.858 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848678+0000", 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001202975 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848754+0000", 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6019999999999994e-05 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848816+0000", 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2439000000000003e-05 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852378+0000", 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0035613680000000001 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242453 5.4 5:2df285aa:::benchmark_data_smithi112_23632_object110349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.848943+0000", 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0044312839999999997, 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0045421180000000004, 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.860 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242453 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848943+0000", 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848943+0000", 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848944+0000", 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.4900000000000004e-07 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848948+0000", 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7770000000000002e-06 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848960+0000", 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1959e-05 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848967+0000", 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9859999999999997e-06 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.849028+0000", 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0353000000000003e-05 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.849142+0000", 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114256 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.849249+0000", 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000106714 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.851524+0000", 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022749329999999998 2024-09-20T21:03:14.864 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242456 5.8 5:18fbf624:::benchmark_data_smithi112_23632_object110352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.850121+0000", 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0032525649999999998, 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034409509999999998, 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242456 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850121+0000", 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850121+0000", 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850122+0000", 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8899999999999998e-07 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850126+0000", 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1740000000000002e-06 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850137+0000", 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0963e-05 2024-09-20T21:03:14.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850143+0000", 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0000000000000002e-06 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850302+0000", 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000158209 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850416+0000", 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114846 2024-09-20T21:03:14.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850522+0000", 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000105141 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852385+0000", 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018635310000000001 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242457 5.b 5:d460e5e1:::benchmark_data_smithi112_23632_object110353:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.850752+0000", 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0026224429999999999, 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0028879230000000001, 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242457 2024-09-20T21:03:14.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850752+0000", 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850752+0000", 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.871 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850752+0000", 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3399999999999998e-07 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850757+0000", 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.921e-06 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850770+0000", 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2323e-05 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850777+0000", 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3019999999999997e-06 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850835+0000", 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8320999999999999e-05 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.850966+0000", 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000130331 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.851207+0000", 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000240855 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242459 5.9 5:91723b0c:::benchmark_data_smithi112_23632_object110355:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.852508+0000", 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000865565, 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0011997430000000001, 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.874 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242459 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852508+0000", 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852508+0000", 2024-09-20T21:03:14.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852509+0000", 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7499999999999999e-07 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852513+0000", 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6090000000000001e-06 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852522+0000", 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0340000000000002e-06 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852527+0000", 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1320000000000002e-06 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852576+0000", 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8659999999999998e-05 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852667+0000", 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0879999999999997e-05 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242460 5.e 5:72be90aa:::benchmark_data_smithi112_23632_object110356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.852542+0000", 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00083241299999999995, 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001229129, 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242460 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852542+0000", 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852542+0000", 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852542+0000", 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0200000000000002e-07 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852545+0000", 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.9550000000000001e-06 2024-09-20T21:03:14.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852553+0000", 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852561+0000", 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.6369999999999999e-06 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852611+0000", 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9701999999999999e-05 2024-09-20T21:03:14.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852748+0000", 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000137792 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852870+0000", 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121414 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242462 5.8 5:108b4f8b:::benchmark_data_smithi112_23632_object110358:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.852958+0000", 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00041620399999999999, 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00088666799999999996, 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242462 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.883 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852958+0000", 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852958+0000", 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852959+0000", 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9299999999999997e-07 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852963+0000", 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1540000000000004e-06 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852973+0000", 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7040000000000006e-06 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852979+0000", 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4740000000000002e-06 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853037+0000", 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8165000000000003e-05 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853119+0000", 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2046999999999996e-05 2024-09-20T21:03:14.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853203+0000", 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4270000000000005e-05 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242465 5.b 5:d8403f8e:::benchmark_data_smithi112_23632_object110361:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.853103+0000", 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00027125599999999999, 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000810471, 2024-09-20T21:03:14.887 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242465 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853103+0000", 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853103+0000", 2024-09-20T21:03:14.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853104+0000", 2024-09-20T21:03:14.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3e-07 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853107+0000", 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4630000000000001e-06 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853115+0000", 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9580000000000007e-06 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853121+0000", 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6080000000000003e-06 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853178+0000", 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7620000000000001e-05 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853293+0000", 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000115197 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853418+0000", 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000124151 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242466 5.8 5.643e0cd8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.853386+0000", 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9999876, 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00059445500000000003, 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.892 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242466 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853386+0000", 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853386+0000", 2024-09-20T21:03:14.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853387+0000", 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7400000000000002e-07 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853391+0000", 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.693e-06 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853400+0000", 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3789999999999995e-06 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853406+0000", 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2020000000000001e-06 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242467 5.b 5.e86f75b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.895 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.853556+0000", 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 4294967295.9998183, 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00047648200000000002, 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242467 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853556+0000", 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853556+0000", 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853556+0000", 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853560+0000", 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4379999999999999e-06 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853569+0000", 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8550000000000008e-06 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.853574+0000", 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6180000000000003e-06 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.898 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:242438 5.8 5:1bdb19cc:::benchmark_data_smithi112_23632_object110334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:14.843171+0000", 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.01020326, 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.010913989000000001, 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:14.899 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 242438 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.843171+0000", 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.843171+0000", 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:14.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.843172+0000", 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3099999999999996e-07 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.843176+0000", 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5499999999999996e-06 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.843186+0000", 2024-09-20T21:03:14.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2399999999999996e-06 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.843190+0000", 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7820000000000001e-06 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848555+0000", 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0053646520000000001 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:14.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848642+0000", 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6873999999999995e-05 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.848711+0000", 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8856999999999995e-05 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:14.852371+0000", 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036603249999999999 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.903 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:14.904 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:03:14.904 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 11 2024-09-20T21:03:14.904 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:14.905 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:14.905 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:14.899+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:15.006 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:15.003+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:15.097 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:15.097 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:15.097 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:03:15.098 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:03:15.098 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:15.107 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:15.103+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:15.117 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:15.208 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:15.203+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 123.075900383, 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.275 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.276 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:03:15.277 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:03:15.278 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:03:15.279 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:03:15.280 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 123.075810347, 2024-09-20T21:03:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:15.282 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:03:15.283 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:03:15.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.285 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:03:15.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:03:15.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:15.286 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:03:15.286 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:03:15.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.286 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.286 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.287 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 123.075723994, 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.288 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.289 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:03:15.290 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:03:15.291 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:03:15.292 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:03:15.293 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 123.075655185, 2024-09-20T21:03:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.295 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:03:15.296 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:03:15.297 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:03:15.298 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:03:15.299 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 123.075622325, 2024-09-20T21:03:15.300 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.301 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:03:15.302 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:03:15.303 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:03:15.304 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:03:15.305 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 123.075580308, 2024-09-20T21:03:15.306 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.307 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:03:15.308 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:03:15.309 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:03:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.311 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 123.075455202, 2024-09-20T21:03:15.312 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:15.313 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:03:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:15.315 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:15.316 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.317 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.318 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 123.075362853, 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.320 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:15.321 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.322 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 123.075278481, 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.323 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:03:15.325 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:03:15.326 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:03:15.327 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 84.309819024999996, 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.328 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:03:15.330 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.332 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.333 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 84.309267019000004, 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:03:15.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:03:15.335 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:03:15.336 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.337 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.338 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:15.339 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 84.308639438, 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.340 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:03:15.341 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:03:15.342 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:03:15.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:03:15.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 63.558905541999998, 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:03:15.345 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:15.346 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.347 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.348 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.349 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.350 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 63.554554617000001, 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.351 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:15.352 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.353 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.354 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.355 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.356 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 63.546312546000003, 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.357 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.358 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.359 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:03:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:03:15.361 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.362 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.597183232999999, 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.363 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.364 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:03:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.367 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:15.368 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.591266665999999, 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:15.369 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:03:15.370 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.371 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.372 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.373 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.587997047999998, 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.374 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.375 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.376 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.377 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:03:15.378 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:03:15.379 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.587496526999999, 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.380 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.381 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.382 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.382 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.382 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:03:15.382 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.383 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:03:15.384 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:03:15.385 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.386 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 23.587341241000001, 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.387 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.389 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:03:15.390 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:03:15.391 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:15.392 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:15.393 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:15.393 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T21:03:15.395 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:15.387+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:15.395 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:15.495 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:15.491+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:15.549 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:15.549 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:15.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.549 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:244288 5.6 5:64a8fd5c:::benchmark_data_smithi112_23632_object112184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.539465+0000", 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0081354040000000006, 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0081649140000000005, 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 244288 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539465+0000", 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539465+0000", 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539466+0000", 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1999999999999998e-07 2024-09-20T21:03:15.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539470+0000", 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.408e-06 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539481+0000", 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1113e-05 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539489+0000", 2024-09-20T21:03:15.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2889999999999998e-06 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.542603+0000", 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031139929999999998 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.542730+0000", 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012683700000000001 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:244290 5.6 5:68072ed6:::benchmark_data_smithi112_23632_object112186:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.539684+0000", 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0079157020000000002, 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080346489999999996, 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 244290 2024-09-20T21:03:15.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539684+0000", 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539684+0000", 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539685+0000", 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1399999999999996e-07 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539689+0000", 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5049999999999999e-06 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539695+0000", 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1639999999999998e-06 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539699+0000", 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6210000000000003e-06 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544362+0000", 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046626319999999999 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544444+0000", 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1865000000000003e-05 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:244287 5.b e72/21 5:d94f2508:::benchmark_data_smithi112_23632_object112183:head v 72'15578, mlcod=72'15576)", 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.539882+0000", 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0077179850000000001, 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079125470000000007, 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539882+0000", 2024-09-20T21:03:15.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539882+0000", 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539883+0000", 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9999999999999997e-07 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539887+0000", 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0489999999999997e-06 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539892+0000", 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6489999999999996e-06 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.539896+0000", 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.540627+0000", 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00073103899999999995 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.540645+0000", 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7747000000000001e-05 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.561 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:244296 5.3 5:c94ef9a2:::benchmark_data_smithi112_23632_object112192:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.541702+0000", 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0058976619999999997, 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061377209999999996, 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 244296 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541702+0000", 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541702+0000", 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541703+0000", 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1100000000000004e-07 2024-09-20T21:03:15.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541707+0000", 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0060000000000003e-06 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541716+0000", 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9579999999999996e-06 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541723+0000", 2024-09-20T21:03:15.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4649999999999999e-06 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541769+0000", 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6183999999999997e-05 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541883+0000", 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114361 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:244292 5.b e72/21 5:db409031:::benchmark_data_smithi112_23632_object112188:head v 72'15579, mlcod=72'15576)", 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.541844+0000", 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.005756171, 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060646099999999998, 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541844+0000", 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541844+0000", 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541845+0000", 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8800000000000002e-07 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541850+0000", 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1499999999999998e-06 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541858+0000", 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0860000000000002e-06 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.541863+0000", 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6860000000000003e-06 2024-09-20T21:03:15.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.543564+0000", 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0017004209999999999 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.543580+0000", 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6427999999999999e-05 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:244294 5.b e72/21 5:dc362137:::benchmark_data_smithi112_23632_object112190:head v 72'15580, mlcod=72'15576)", 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.543573+0000", 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0040273169999999999, 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0043977729999999998, 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.543573+0000", 2024-09-20T21:03:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.543573+0000", 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.543573+0000", 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.06e-07 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.543579+0000", 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8780000000000003e-06 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.543587+0000", 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9880000000000004e-06 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.543593+0000", 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.947e-06 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545450+0000", 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0018564849999999999 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545461+0000", 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1141000000000001e-05 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:244303 5.5 5:a281c056:::benchmark_data_smithi112_23632_object112199:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.544903+0000", 2024-09-20T21:03:15.573 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0026969250000000002, 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031314009999999998, 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 244303 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544903+0000", 2024-09-20T21:03:15.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544903+0000", 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544904+0000", 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2160000000000001e-06 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544909+0000", 2024-09-20T21:03:15.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5639999999999998e-06 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544921+0000", 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2306999999999999e-05 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544929+0000", 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9240000000000007e-06 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544983+0000", 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3426e-05 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545497+0000", 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000514666 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:244304 5.2 5:4b5452ec:::benchmark_data_smithi112_23632_object112200:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.544954+0000", 2024-09-20T21:03:15.577 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0026458549999999999, 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031624050000000001, 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 244304 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544954+0000", 2024-09-20T21:03:15.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544954+0000", 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544955+0000", 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7599999999999997e-07 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544958+0000", 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7980000000000001e-06 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544979+0000", 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0890000000000002e-05 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544985+0000", 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2920000000000001e-06 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545033+0000", 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-05 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545160+0000", 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012645500000000001 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:244295 5.b e72/21 5:d6b9c7f7:::benchmark_data_smithi112_23632_object112191:head v 72'15581, mlcod=72'15576)", 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.544989+0000", 2024-09-20T21:03:15.581 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002610752, 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032164799999999999, 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544989+0000", 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544989+0000", 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544990+0000", 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.544995+0000", 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1699999999999996e-06 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545005+0000", 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4329999999999993e-06 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545012+0000", 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6510000000000001e-06 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.546643+0000", 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001630339 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.546653+0000", 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0525e-05 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:244302 5.4 e72/63 5:264b49ec:::benchmark_data_smithi112_23632_object112198:head v 72'15429, mlcod=72'15426)", 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.545107+0000", 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0024934739999999999, 2024-09-20T21:03:15.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031635040000000001, 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545107+0000", 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545107+0000", 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545107+0000", 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6899999999999998e-07 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545111+0000", 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6200000000000001e-06 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545118+0000", 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7479999999999996e-06 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545122+0000", 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9030000000000003e-06 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545165+0000", 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2879000000000001e-05 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545184+0000", 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8567e-05 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:244306 5.2 5:4accbd70:::benchmark_data_smithi112_23632_object112202:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.545924+0000", 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0016766350000000001, 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002411991, 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.589 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 244306 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545924+0000", 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545924+0000", 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545924+0000", 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0299999999999997e-07 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545928+0000", 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0550000000000001e-06 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545940+0000", 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1855000000000001e-05 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.545947+0000", 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6830000000000002e-06 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.547049+0000", 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001101758 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.547168+0000", 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119431 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:244305 5.8 e72/63 5:15cecb41:::benchmark_data_smithi112_23632_object112201:head v 72'15348, mlcod=72'15346)", 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.546099+0000", 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001500712, 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023068730000000001, 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.546099+0000", 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.546099+0000", 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.546100+0000", 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5799999999999999e-07 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.546105+0000", 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5600000000000004e-06 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.546114+0000", 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.268e-06 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.546119+0000", 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1580000000000004e-06 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.546165+0000", 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6294000000000001e-05 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.546183+0000", 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8117999999999998e-05 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:244307 5.5 5:a6518dee:::benchmark_data_smithi112_23632_object112203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:15.547016+0000", 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00058405700000000002, 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014536550000000001, 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 244307 2024-09-20T21:03:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.547016+0000", 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.547016+0000", 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.547017+0000", 2024-09-20T21:03:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2200000000000003e-07 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.547020+0000", 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6049999999999998e-06 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.547031+0000", 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0276e-05 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.547041+0000", 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9280000000000005e-06 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.547461+0000", 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042067100000000001 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:15.547583+0000", 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121625 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:03:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 13 2024-09-20T21:03:15.601 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:15.602 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:15.602 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:15.599+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:15.702 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:15.695+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:15.796 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:15.796 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:03:15.796 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:03:15.797 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:03:15.797 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:15.803 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:15.799+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:15.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:15.822 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:03:15.904 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:15.899+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:15.972 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:15.972 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:15.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:15.972 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 123.775519816, 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:15.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:15.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 123.775295285, 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:15.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:15.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.295600897, 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:15.985 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:15.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:15.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:15.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.295266672, 2024-09-20T21:03:15.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:15.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:15.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:15.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.295007855000001, 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:15.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:15.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:15.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:16.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.293392938, 2024-09-20T21:03:16.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:16.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:16.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:16.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.291075018000001, 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.007 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:16.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.012 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.289046925000001, 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:16.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.288922285000002, 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:16.017 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:16.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:16.022 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.286913968, 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:16.026 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.285853309, 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:16.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.285659485, 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:16.031 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:16.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:16.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.285582851000001, 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:16.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:16.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.285511648, 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:16.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:16.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:16.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.047 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.285196452000001, 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:16.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:16.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.283789716000001, 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:16.052 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:16.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.283535858, 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.057 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:16.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.282951131000001, 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:16.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:16.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.282928879, 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.066 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.281861411000001, 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:16.070 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:16.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:16.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:16.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:16.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:16.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:16.075 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.075 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.075 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.075 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:16.075 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:16.075 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:16.076 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:16.077 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:16.077 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:16.077 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:16.078 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:16.078 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:16.078 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:16.079 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:16.079 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:16.071+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:16.177 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:16.175+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:16.236 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:16.236 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:16.256 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:16.278 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:16.275+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:16.293 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-20T21:03:16.299 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-20T21:03:16.379 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:16.375+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:16.410 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-09-20T21:03:16.410 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:16.410 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:16.432 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:16.480 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:16.475+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:16.581 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:16.579+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:16.587 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:16.588 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:16.609 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:16.682 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:16.675+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:16.763 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:16.763 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:16.782 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:16.783 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:16.779+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:16.887 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:16.883+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:16.927 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:16.927 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:16.947 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:16.988 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:16.987+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:17.087 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:17.083+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:17.139 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:17.139 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:17.157 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:17.203 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:17.199+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:17.289 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:17.287+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:17.311 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:17.311 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:17.329 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:17.416 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:17.411+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:17.491 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:17.483+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:17.521 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:17.521 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:17.541 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:17.591 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:17.587+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:17.692 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:17.691+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:17.729 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:17.729 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:17.748 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:17.792 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:17.787+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:17.895 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:17.891+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:17.923 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:18.008 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:18.007+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:18.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:03:18.095 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:18.091+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:18.131 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:18.220 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:18.219+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:18.236 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:18.255 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:18.258 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:18.258 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:18.297 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:18.295+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:18.318 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:03:18.332 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:18.332 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:18.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:18.332 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:18.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.333 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:18.333 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:18.333 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.134133101, 2024-09-20T21:03:18.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:18.333 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.334 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.334 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.334 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:18.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:18.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:18.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:18.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:18.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:18.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:18.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:18.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:18.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:18.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:18.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:18.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:18.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:18.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:18.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:18.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:18.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.13390857, 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.344 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.654214182, 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.350 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:18.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:18.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.653879957000001, 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:18.356 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:18.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:18.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:18.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.653621139999998, 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:18.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.652006223000001, 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:18.366 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:18.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:18.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.649688303000001, 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:18.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:18.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:18.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.647660210000002, 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.647535569999999, 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.382 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.645527253000001, 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.387 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:18.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:18.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.644466594000001, 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.391 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:18.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:18.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.644272770000001, 2024-09-20T21:03:18.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:18.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:18.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:18.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.644196136000001, 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:18.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.644124933000001, 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.406 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:18.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:18.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.643809737000002, 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:18.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:18.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.642403001000002, 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:18.416 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:18.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:18.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:18.421 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.642149143000001, 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:18.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:18.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.641564416000001, 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:18.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:18.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:18.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.641542164000001, 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:18.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:18.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.640474695999998, 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.434 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:18.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:18.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:18.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:18.438 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:18.439 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:18.440 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:18.440 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:18.435+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:18.541 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:18.539+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:18.599 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:18.600 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:18.600 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.600 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252177 5.e 5:78dfed5d:::benchmark_data_smithi112_23632_object120073:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.600 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.588989+0000", 2024-09-20T21:03:18.600 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0086393519999999994, 2024-09-20T21:03:18.600 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0086608190000000002, 2024-09-20T21:03:18.600 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.600 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.600 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252177 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.588989+0000", 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.601 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.588989+0000", 2024-09-20T21:03:18.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.602 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.602 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.602 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.588990+0000", 2024-09-20T21:03:18.602 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6199999999999997e-07 2024-09-20T21:03:18.602 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.588993+0000", 2024-09-20T21:03:18.603 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4029999999999999e-06 2024-09-20T21:03:18.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.603 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.603 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.603 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.589000+0000", 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9750000000000001e-06 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.589004+0000", 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.895e-06 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.591149+0000", 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002144881 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.604 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.591246+0000", 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6463000000000001e-05 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.591356+0000", 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000110277 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.594519+0000", 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0031632420000000001 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.605 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252180 5.e 5:7d046780:::benchmark_data_smithi112_23632_object120076:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.590239+0000", 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0073898740000000003, 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0074670700000000001, 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.606 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252180 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.590239+0000", 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.590239+0000", 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.607 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.590240+0000", 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.85e-07 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.590245+0000", 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1290000000000004e-06 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.590256+0000", 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1344e-05 2024-09-20T21:03:18.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.590265+0000", 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6389999999999998e-06 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.592645+0000", 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002379815 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.592817+0000", 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017259600000000001 2024-09-20T21:03:18.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.592944+0000", 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012724599999999999 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.594961+0000", 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002016262 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252184 5.b 5:d8f5d2ea:::benchmark_data_smithi112_23632_object120080:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.593195+0000", 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0044336180000000003, 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0045824389999999998, 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252184 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.611 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593195+0000", 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593195+0000", 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593196+0000", 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2900000000000002e-07 2024-09-20T21:03:18.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.613 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.613 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.613 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593199+0000", 2024-09-20T21:03:18.613 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.1690000000000001e-06 2024-09-20T21:03:18.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.613 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.613 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.613 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593209+0000", 2024-09-20T21:03:18.613 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.6260000000000007e-06 2024-09-20T21:03:18.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593214+0000", 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1540000000000001e-06 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593262+0000", 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8251000000000003e-05 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.614 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593365+0000", 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102457 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593428+0000", 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3534999999999994e-05 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.597590+0000", 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0041616919999999998 2024-09-20T21:03:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252185 5.8 5:1fa3be17:::benchmark_data_smithi112_23632_object120081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.593228+0000", 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0044011830000000004, 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0046157389999999998, 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.616 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252185 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593228+0000", 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593228+0000", 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.617 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.618 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593228+0000", 2024-09-20T21:03:18.618 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.63e-07 2024-09-20T21:03:18.618 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.618 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.618 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.618 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593231+0000", 2024-09-20T21:03:18.619 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.9210000000000001e-06 2024-09-20T21:03:18.619 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.619 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.619 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.619 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593238+0000", 2024-09-20T21:03:18.619 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0190000000000001e-06 2024-09-20T21:03:18.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593243+0000", 2024-09-20T21:03:18.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2499999999999997e-06 2024-09-20T21:03:18.620 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.620 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.620 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.620 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593278+0000", 2024-09-20T21:03:18.620 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4820999999999997e-05 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593370+0000", 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2318999999999995e-05 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593437+0000", 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6557000000000007e-05 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.621 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252186 5.9 5:95a659c3:::benchmark_data_smithi112_23632_object120082:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.593257+0000", 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0043720779999999997, 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0046259209999999999, 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252186 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.622 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593257+0000", 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593257+0000", 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593257+0000", 2024-09-20T21:03:18.623 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3000000000000001e-07 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593259+0000", 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.2479999999999999e-06 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593266+0000", 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1860000000000003e-06 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.624 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593272+0000", 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.2340000000000002e-06 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.594202+0000", 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00093036300000000002 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.594343+0000", 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000141132 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.625 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252187 5.b 5:d9e10712:::benchmark_data_smithi112_23632_object120083:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.593282+0000", 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0043469559999999999, 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0046356729999999999, 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.626 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252187 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593282+0000", 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593282+0000", 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.627 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593282+0000", 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6499999999999999e-07 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593285+0000", 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.3360000000000002e-06 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593291+0000", 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4069999999999998e-06 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.628 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.593298+0000", 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7290000000000003e-06 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.595163+0000", 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001865306 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.595314+0000", 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000150863 2024-09-20T21:03:18.629 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.595444+0000", 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000130049 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.597808+0000", 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0023636 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.630 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252188 5.f 5:f87a572f:::benchmark_data_smithi112_23632_object120084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.596138+0000", 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001490351, 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018226570000000001, 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252188 2024-09-20T21:03:18.631 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596138+0000", 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596138+0000", 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596139+0000", 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.049e-06 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596144+0000", 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9289999999999997e-06 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596156+0000", 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1829e-05 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.633 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596163+0000", 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1670000000000002e-06 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596217+0000", 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3443999999999999e-05 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596321+0000", 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000103824 2024-09-20T21:03:18.634 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.635 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.635 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.635 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.635 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.635 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252192 5.9 5:9cbd2382:::benchmark_data_smithi112_23632_object120088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.635 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.596191+0000", 2024-09-20T21:03:18.635 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0014373649999999999, 2024-09-20T21:03:18.635 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018074149999999999, 2024-09-20T21:03:18.635 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.635 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252192 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596191+0000", 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.636 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596191+0000", 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596192+0000", 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0699999999999997e-07 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596196+0000", 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7459999999999998e-06 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.637 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596203+0000", 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3919999999999997e-06 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596209+0000", 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9989999999999997e-06 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596287+0000", 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8412999999999996e-05 2024-09-20T21:03:18.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596413+0000", 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012542900000000001 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252193 5.0 5:0df53642:::benchmark_data_smithi112_23632_object120089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.596221+0000", 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001407347, 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0018531839999999999, 2024-09-20T21:03:18.639 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252193 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596221+0000", 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.640 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596221+0000", 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596222+0000", 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5299999999999999e-07 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596224+0000", 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.26e-06 2024-09-20T21:03:18.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596231+0000", 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.81e-06 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596236+0000", 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1780000000000002e-06 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.642 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596277+0000", 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1288000000000002e-05 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596397+0000", 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000120128 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596507+0000", 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000109607 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.643 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252194 5.8 5:1148db2c:::benchmark_data_smithi112_23632_object120090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.596411+0000", 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.001217957, 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017446989999999999, 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252194 2024-09-20T21:03:18.644 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596411+0000", 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596411+0000", 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596411+0000", 2024-09-20T21:03:18.645 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0699999999999997e-07 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596415+0000", 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.331e-06 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596422+0000", 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7370000000000006e-06 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.646 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596427+0000", 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2400000000000001e-06 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596462+0000", 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5166000000000002e-05 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596537+0000", 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5401999999999994e-05 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.647 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.596635+0000", 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7429000000000005e-05 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:252195 5.f 5.aab5cb0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:18.597247+0000", 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00038173100000000001, 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00098547299999999995, 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.648 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 252195 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.597247+0000", 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.597247+0000", 2024-09-20T21:03:18.649 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.597248+0000", 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.597252+0000", 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.1989999999999999e-06 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.650 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.597265+0000", 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673999999999999e-05 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:18.597273+0000", 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7369999999999995e-06 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 11 2024-09-20T21:03:18.651 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:18.653 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:18.651+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:18.656 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:18.754 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:18.751+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:18.808 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:18.808 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:18.808 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:03:18.808 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:03:18.808 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:18.829 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:18.855 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:18.851+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:18.956 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:18.951+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:18.986 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:18.986 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:03:18.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:03:18.986 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:18.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.986 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:18.986 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:18.986 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 126.786426085, 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:18.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:03:18.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:18.992 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 126.786336049, 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:18.993 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:18.994 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:03:18.995 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:03:18.996 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.997 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.998 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:18.999 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 126.786249696, 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.000 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:03:19.001 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.002 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.003 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.004 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.005 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 126.786180887, 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.006 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.007 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:03:19.008 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:03:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.010 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.011 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 126.786148027, 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.012 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.013 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.014 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:03:19.015 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:03:19.016 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.017 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:19.018 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 126.78610601, 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:19.019 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.020 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.022 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.023 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.024 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 126.785980904, 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.025 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.026 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:03:19.027 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.028 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.029 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:03:19.030 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 126.785888555, 2024-09-20T21:03:19.031 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:19.032 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.033 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.034 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.035 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 126.785804183, 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:03:19.036 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.038 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.039 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.040 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.020344726999994, 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.041 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.042 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:19.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.043 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.043 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.043 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:19.043 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:03:19.043 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:03:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.045 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.046 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.047 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.019792721000002, 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.048 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.049 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:19.050 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:03:19.051 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.052 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 88.019165139999998, 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.054 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.055 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.056 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:03:19.057 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.058 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:19.059 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 67.269431244000003, 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:19.060 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.061 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.062 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.063 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:03:19.064 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 67.265080319000006, 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:03:19.065 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.066 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:03:19.067 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:03:19.068 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.069 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.070 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 67.256838247999994, 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.071 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.072 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.073 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:03:19.074 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:03:19.075 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:03:19.076 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 27.307708935000001, 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.077 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:19.078 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.079 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.080 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.081 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.082 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 27.301792368000001, 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.083 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.084 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.085 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:03:19.086 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.087 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.088 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 27.29852275, 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:03:19.089 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.090 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.091 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.092 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.093 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 27.298022229000001, 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.095 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.096 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:03:19.097 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.098 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.099 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.100 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 27.297866942999999, 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:03:19.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:19.106 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:03:19.106 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:03:19.106 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.106 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.106 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.106 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.106 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.106 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:19.108 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:19.103+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:19.108 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:19.209 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:19.203+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:19.257 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:19.258 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:19.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.258 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:253900 5.5 5:afc4d5ee:::benchmark_data_smithi112_23632_object121796:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:19.258 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.252583+0000", 2024-09-20T21:03:19.258 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003319654, 2024-09-20T21:03:19.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033364089999999998, 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 253900 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252583+0000", 2024-09-20T21:03:19.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252583+0000", 2024-09-20T21:03:19.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252584+0000", 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1200000000000001e-06 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252589+0000", 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4689999999999999e-06 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252600+0000", 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0947e-05 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252607+0000", 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6650000000000003e-06 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252642+0000", 2024-09-20T21:03:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4329000000000003e-05 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252720+0000", 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8756000000000003e-05 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:253901 5.5 5:ade08898:::benchmark_data_smithi112_23632_object121797:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.252623+0000", 2024-09-20T21:03:19.263 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003280004, 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033706080000000002, 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 253901 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252623+0000", 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252623+0000", 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252623+0000", 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9999999999999997e-07 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252626+0000", 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.667e-06 2024-09-20T21:03:19.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252633+0000", 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1829999999999997e-06 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252639+0000", 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4269999999999999e-06 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254571+0000", 2024-09-20T21:03:19.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019326460000000001 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254697+0000", 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012571500000000001 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:253903 5.3 5:ca331369:::benchmark_data_smithi112_23632_object121799:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.252649+0000", 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.003254009, 2024-09-20T21:03:19.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034255739999999998, 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 253903 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252649+0000", 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252649+0000", 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252649+0000", 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3300000000000002e-07 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252652+0000", 2024-09-20T21:03:19.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4119999999999999e-06 2024-09-20T21:03:19.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252658+0000", 2024-09-20T21:03:19.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4189999999999999e-06 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252663+0000", 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6809999999999997e-06 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252708+0000", 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5385e-05 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252819+0000", 2024-09-20T21:03:19.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110531 2024-09-20T21:03:19.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.272 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.273 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:253905 5.7 5:e0c8f60c:::benchmark_data_smithi112_23632_object121801:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:19.273 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.252675+0000", 2024-09-20T21:03:19.273 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0032281369999999998, 2024-09-20T21:03:19.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034692899999999999, 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 253905 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252675+0000", 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252675+0000", 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252675+0000", 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5699999999999998e-07 2024-09-20T21:03:19.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252677+0000", 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.306e-06 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252684+0000", 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3069999999999999e-06 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252689+0000", 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9080000000000003e-06 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252752+0000", 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3361999999999994e-05 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252867+0000", 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115474 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.277 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:253906 5.6 5:648f33d0:::benchmark_data_smithi112_23632_object121802:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.252702+0000", 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0032009709999999999, 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0035137359999999999, 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 253906 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252702+0000", 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252702+0000", 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252702+0000", 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1100000000000001e-07 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252705+0000", 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3690000000000001e-06 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252711+0000", 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.793e-06 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252716+0000", 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0470000000000001e-06 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252755+0000", 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8464000000000003e-05 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.252861+0000", 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106093 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:253902 5.e e73/21 5:7e329b33:::benchmark_data_smithi112_23632_object121798:head v 73'15790, mlcod=73'15788)", 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.254615+0000", 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0012875510000000001, 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001674619, 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.282 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254615+0000", 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254615+0000", 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254616+0000", 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6700000000000003e-07 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254623+0000", 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0160000000000003e-06 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254632+0000", 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0820000000000005e-06 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254639+0000", 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8499999999999996e-06 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254724+0000", 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4965999999999999e-05 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254742+0000", 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8589000000000001e-05 2024-09-20T21:03:19.285 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:253904 5.b e73/21 5:ded3b3b2:::benchmark_data_smithi112_23632_object121800:head v 73'16207, mlcod=73'16205)", 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.254653+0000", 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0012501560000000001, 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016804630000000001, 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254653+0000", 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254653+0000", 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254653+0000", 2024-09-20T21:03:19.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8700000000000002e-07 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254656+0000", 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3139999999999999e-06 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254662+0000", 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0499999999999997e-06 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254668+0000", 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7450000000000001e-06 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254802+0000", 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013423299999999999 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254818+0000", 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5676e-05 2024-09-20T21:03:19.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:253909 5.0 e73/69 5:07915c71:::benchmark_data_smithi112_23632_object121805:head v 73'15872, mlcod=73'15867)", 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.254681+0000", 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001221516, 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001715479, 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.290 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254681+0000", 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254681+0000", 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254681+0000", 2024-09-20T21:03:19.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4600000000000001e-07 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254690+0000", 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1499999999999999e-06 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254696+0000", 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4160000000000001e-06 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254700+0000", 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4479999999999996e-06 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254747+0000", 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6110999999999999e-05 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.254767+0000", 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0604000000000001e-05 2024-09-20T21:03:19.293 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:253907 5.b e73/21)", 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.255090+0000", 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000812468, 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0013435890000000001, 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:19.294 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255090+0000", 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255090+0000", 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255091+0000", 2024-09-20T21:03:19.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3300000000000001e-07 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255097+0000", 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5990000000000001e-06 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255107+0000", 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0088000000000001e-05 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255113+0000", 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4069999999999998e-06 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:253910 5.0 e73/69)", 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.255194+0000", 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000708883, 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012713410000000001, 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.297 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255194+0000", 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255194+0000", 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255194+0000", 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6199999999999998e-07 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255198+0000", 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.782e-06 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255205+0000", 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5080000000000002e-06 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.255210+0000", 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.648e-06 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:253912 5.c 5.5512bfac (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.256421+0000", 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9994817, 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4110999999999994e-05, 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.300 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 253912 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256421+0000", 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256421+0000", 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256423+0000", 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.443e-06 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256429+0000", 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6390000000000003e-06 2024-09-20T21:03:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256443+0000", 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3237999999999999e-05 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256454+0000", 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1574e-05 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:253913 5.5 5.f3cc8b65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:19.256484+0000", 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9994183, 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6334000000000004e-05, 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 253913 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256484+0000", 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256484+0000", 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256485+0000", 2024-09-20T21:03:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9400000000000005e-07 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256489+0000", 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0840000000000002e-06 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256499+0000", 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0118999999999999e-05 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:19.256507+0000", 2024-09-20T21:03:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7600000000000002e-06 2024-09-20T21:03:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:03:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 12 2024-09-20T21:03:19.307 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:19.308 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:03:19.309 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:19.310 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:19.307+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:19.410 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:19.407+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:19.455 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:19.456 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:03:19.456 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:03:19.456 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:03:19.456 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:19.476 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:19.524 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:19.523+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:19.612 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:19.607+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:19.672 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:19.672 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:19.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 127.475514132, 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:19.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:19.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:19.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:19.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:19.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:19.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:19.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:19.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:19.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:19.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:19.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:19.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:19.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:19.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:19.680 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 127.475289601, 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:19.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:19.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:19.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:19.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:19.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:19.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.688 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.995595213000001, 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:19.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:19.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:19.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:19.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:19.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:19.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:19.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.695 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.695 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.695 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:19.695 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.995260987999998, 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:19.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:19.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:19.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:19.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:19.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.701 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.995002170999999, 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:19.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:19.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:19.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:19.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:19.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.706 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.993387254000002, 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:19.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:19.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:19.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:19.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:19.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:19.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:19.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.991069333999999, 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:19.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:19.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:19.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.989041240999999, 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.719 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.723 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.988916601, 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.724 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:19.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.986908283999998, 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.729 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:19.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.985847625000002, 2024-09-20T21:03:19.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:19.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:19.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.985653801000002, 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.738 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:19.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.985577166999999, 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.985505964000001, 2024-09-20T21:03:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.985190767999999, 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.983784031999999, 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.983530173999998, 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.982945446999999, 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.982923195000001, 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.981855726999999, 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:19.785 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:19.787 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:19.787 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:19.783+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:19.887 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:19.883+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:19.944 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:19.944 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:19.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.944 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:255623 5.e 5:7805dcbc:::benchmark_data_smithi112_23632_object123519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-20T21:03:19.944 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.936695+0000", 2024-09-20T21:03:19.944 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0054104920000000003, 2024-09-20T21:03:19.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0054332080000000001, 2024-09-20T21:03:19.944 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 255623 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936695+0000", 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936695+0000", 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936697+0000", 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.08e-06 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936702+0000", 2024-09-20T21:03:19.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1000000000000003e-06 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936714+0000", 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2779000000000001e-05 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936722+0000", 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7659999999999998e-06 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.947 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938630+0000", 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0019073950000000001 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938753+0000", 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012340800000000001 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938858+0000", 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000104875 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:255626 5.4 5:21f8f78a:::benchmark_data_smithi112_23632_object123522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.936930+0000", 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0051759140000000002, 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0052778310000000002, 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.949 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 255626 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936930+0000", 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936930+0000", 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936931+0000", 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1200000000000001e-07 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936935+0000", 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0620000000000002e-06 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936946+0000", 2024-09-20T21:03:19.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0841e-05 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.936953+0000", 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.3629999999999996e-06 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938674+0000", 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017209809999999999 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938765+0000", 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.0903999999999996e-05 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938830+0000", 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5043999999999996e-05 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:255625 5.a e74/21 5:587020fb:::benchmark_data_smithi112_23632_object123521:head v 74'16021, mlcod=74'16019)", 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.937160+0000", 2024-09-20T21:03:19.953 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.004945657, 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0051261859999999996, 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.937160+0000", 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.937160+0000", 2024-09-20T21:03:19.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.937161+0000", 2024-09-20T21:03:19.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9499999999999998e-07 2024-09-20T21:03:19.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.937166+0000", 2024-09-20T21:03:19.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3709999999999999e-06 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.937172+0000", 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.7969999999999997e-06 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.937177+0000", 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1120000000000004e-06 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.937237+0000", 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.9549000000000002e-05 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.937261+0000", 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4536e-05 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:255629 5.0 5:0e727af8:::benchmark_data_smithi112_23632_object123525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.938920+0000", 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0031856190000000002, 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003431567, 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 255629 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938920+0000", 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938920+0000", 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938921+0000", 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.066e-06 2024-09-20T21:03:19.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938927+0000", 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3700000000000003e-06 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938937+0000", 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8940000000000005e-06 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.938945+0000", 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8359999999999992e-06 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939118+0000", 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000173802 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939233+0000", 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000114712 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939336+0000", 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010255999999999999 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941896+0000", 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0025600670000000001 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.964 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:255627 5.a e74/21 5:519fd3b8:::benchmark_data_smithi112_23632_object123523:head v 74'16022, mlcod=74'16019)", 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.939216+0000", 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.0028898909999999999, 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003221387, 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939216+0000", 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.965 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939216+0000", 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939217+0000", 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3300000000000002e-07 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939225+0000", 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.0499999999999992e-06 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.966 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939233+0000", 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8960000000000003e-06 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939238+0000", 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6520000000000003e-06 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939288+0000", 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.0207000000000002e-05 2024-09-20T21:03:19.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.939309+0000", 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0886999999999998e-05 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop(client.4448.0:255632 5.a e74/21 5:56eea673:::benchmark_data_smithi112_23632_object123528:head v 74'16023, mlcod=74'16019)", 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.941447+0000", 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00065941399999999999, 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010556630000000001, 2024-09-20T21:03:19.968 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941447+0000", 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941447+0000", 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.969 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941447+0000", 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7400000000000003e-07 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941457+0000", 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5990000000000008e-06 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941467+0000", 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8120000000000002e-06 2024-09-20T21:03:19.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941473+0000", 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7989999999999996e-06 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941522+0000", 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8399000000000002e-05 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941538+0000", 2024-09-20T21:03:19.971 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.6062999999999999e-05 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:255633 5.e 5:7aea32a8:::benchmark_data_smithi112_23632_object123529:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.941623+0000", 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.000482988, 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00094317700000000001, 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.972 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 255633 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941623+0000", 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941623+0000", 2024-09-20T21:03:19.973 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941624+0000", 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.47e-07 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941628+0000", 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0980000000000004e-06 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.974 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941637+0000", 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9500000000000007e-06 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941642+0000", 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9819999999999999e-06 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941690+0000", 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.7824000000000002e-05 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.975 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941802+0000", 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000112477 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941907+0000", 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000105301 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:255635 5.4 5:2f49fa54:::benchmark_data_smithi112_23632_object123531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-20T21:03:19.976 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.941662+0000", 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00044371299999999999, 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00098412200000000003, 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 255635 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941662+0000", 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941662+0000", 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941663+0000", 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.2e-07 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.978 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941665+0000", 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.334e-06 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941672+0000", 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0759999999999997e-06 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941676+0000", 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4819999999999999e-06 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.979 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941727+0000", 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.1712999999999998e-05 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941855+0000", 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000127918 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941962+0000", 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107221 2024-09-20T21:03:19.980 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:255637 5.b 5:d2b76e8a:::benchmark_data_smithi112_23632_object123533:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.941685+0000", 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00042116799999999998, 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010387840000000001, 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:19.981 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 255637 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941685+0000", 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941685+0000", 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.982 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941685+0000", 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0400000000000002e-07 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941688+0000", 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.3640000000000002e-06 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941694+0000", 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8539999999999999e-06 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.983 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941698+0000", 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.754e-06 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941754+0000", 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5575000000000002e-05 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941857+0000", 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010338799999999999 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.984 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.942207+0000", 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034941399999999999 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:255626 5.4 e74/63)", 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.941742+0000", 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00036389099999999998, 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001061593, 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.985 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.986 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:19.986 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.986 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.986 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941742+0000", 2024-09-20T21:03:19.986 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.986 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.986 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941742+0000", 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941743+0000", 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5400000000000001e-07 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941746+0000", 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7170000000000002e-06 2024-09-20T21:03:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941764+0000", 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7229000000000001e-05 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941777+0000", 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3764999999999999e-05 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.988 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_repop_reply(client.4448.0:255623 5.e e74/21)", 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:03:19.941801+0000", 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 0.00030507899999999998, 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0010494040000000001, 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "queued for pg", 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941801+0000", 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.989 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941801+0000", 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941801+0000", 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3799999999999998e-07 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941807+0000", 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.276e-06 2024-09-20T21:03:19.990 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941813+0000", 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.674e-06 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:03:19.941819+0000", 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3210000000000004e-06 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: ], 2024-09-20T21:03:19.991 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 11 2024-09-20T21:03:19.992 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:19.993 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:19.991+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:19.993 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:20.093 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:20.087+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:20.149 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:20.149 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:20.149 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:03:20.150 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:03:20.150 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:20.172 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:20.194 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:20.191+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:20.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:03:20.295 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:20.291+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:20.371 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 128.171905968, 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.372 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:03:20.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:03:20.374 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.375 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.376 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.377 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 128.17181593199999, 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.378 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.379 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:03:20.380 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:03:20.381 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:20.382 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.383 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:20.384 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 128.17172957899999, 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:20.385 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.386 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.387 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:03:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:03:20.389 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 128.17166076999999, 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.391 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.392 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:03:20.393 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:03:20.394 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:03:20.395 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 128.17162791000001, 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:03:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.399 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.400 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.401 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:03:20.402 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 128.17158589300001, 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.403 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.404 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.405 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.406 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:03:20.407 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:03:20.408 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 128.171460787, 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.409 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.410 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:03:20.411 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:03:20.412 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.413 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.414 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 128.171368438, 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:20.415 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:03:20.416 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:03:20.417 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.418 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.419 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 128.171284066, 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:20.420 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.421 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.422 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.423 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 89.405824609999996, 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.425 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:03:20.426 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:03:20.427 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:03:20.428 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:03:20.429 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 89.405272604000004, 2024-09-20T21:03:20.430 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.431 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:03:20.432 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:03:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:03:20.434 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.435 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 89.404645023, 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.436 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:20.438 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:03:20.439 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.440 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.441 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 68.654911127000005, 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:03:20.442 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.443 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.444 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.445 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.446 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.447 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 68.650560201999994, 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.448 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.449 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.450 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.452 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 68.642318130999996, 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.453 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.454 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.455 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.456 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.457 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:03:20.458 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.693188817999999, 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.459 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.460 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.461 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:03:20.462 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:03:20.463 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.464 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.687272251, 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.465 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:03:20.466 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.467 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.468 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.469 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:20.470 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.684002632999999, 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.471 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.472 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.473 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.474 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.475 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.683502111999999, 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.476 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.477 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:03:20.478 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.479 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.480 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.481 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 28.683346826000001, 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:20.482 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.483 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.484 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:03:20.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:20.487 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:20.488 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:20.488 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-20T21:03:20.497 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:20.498 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:20.487+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:20.499 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:20.499 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:20.500 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:20.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:20.501 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:20.502 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:20.502 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:20.590 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:20.587+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:20.598 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-09-20T21:03:20.598 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-09-20T21:03:20.658 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:20.659 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:20.681 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:20.691 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:20.687+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:20.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-09-20T21:03:20.699 DEBUG:teuthology.orchestra.console.smithi161:Waiting for login prompt 2024-09-20T21:03:20.699 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi161 2024-09-20T21:03:20.792 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:20.787+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:20.880 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:20.880 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:20.892 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:20.891+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:20.901 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:20.993 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:20.991+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:21.089 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:21.089 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:21.094 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:21.091+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:21.109 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:21.195 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:21.191+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:21.267 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:21.268 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:21.289 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:21.295 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:21.291+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:21.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:03:21.397 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:21.391+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:21.486 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:21.486 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:21.497 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:21.495+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:21.509 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:21.599 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:21.595+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:21.699 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:21.695+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:21.708 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:21.708 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:21.728 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:21.800 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:21.799+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:21.854 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:21.854 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:21.867 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:21.908 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:21.907+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:22.002 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:21.999+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:22.061 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:22.061 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:22.080 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:22.103 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:22.099+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:22.204 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:22.199+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:22.277 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:22.277 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:22.297 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:22.317 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:03:22.343 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:22.339+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:22.405 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:22.399+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:22.475 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:22.504 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T21:03:22.507 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:22.503+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:22.608 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:22.603+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:22.664 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:22.664 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:22.664 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:22.671 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:22.671 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:22.683 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:22.686 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:22.686 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:22.690 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:22.735 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:22.730+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:22.809 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:22.807+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:22.844 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:22.844 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:03:22.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:03:22.844 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:22.844 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.844 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:22.844 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:22.844 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 130.64459329100001, 2024-09-20T21:03:22.844 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:03:22.844 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:22.845 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:03:22.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:03:22.846 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.846 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.846 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.846 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:03:22.846 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.847 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:03:22.848 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:03:22.849 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.850 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 130.64450325499999, 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.851 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.852 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.853 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.854 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:03:22.855 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:03:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:03:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:03:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:03:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:03:22.857 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 130.64441690199999, 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.858 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:03:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.860 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.861 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:03:22.862 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.863 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.864 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 130.64434809299999, 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:22.865 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.866 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.867 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:03:22.868 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:03:22.869 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:03:22.870 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 130.64431523299999, 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.871 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:22.872 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.874 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.875 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.876 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 130.64427321599999, 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.877 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.878 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:03:22.879 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:03:22.880 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:03:22.881 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.882 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:22.883 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 130.64414811, 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.884 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.885 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.886 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:03:22.887 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:03:22.888 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.889 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 130.644055761, 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.890 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.891 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.892 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:03:22.893 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.894 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 130.643971389, 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.895 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.896 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:03:22.897 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:03:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.878511932999999, 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:03:22.899 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.900 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:03:22.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:03:22.902 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.903 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.904 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.877959927000006, 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.905 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:22.906 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.907 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.908 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:03:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 91.877332346000003, 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.911 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.912 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:22.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.914 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.915 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:03:22.916 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 71.127598449999994, 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.917 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.918 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:03:22.919 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.920 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.921 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 71.123247524999996, 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.924 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.925 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:03:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.927 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.928 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 71.115005453999999, 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.929 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.930 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.931 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:03:22.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:03:22.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.934 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 31.165876140999998, 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.935 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:03:22.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:03:22.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.938 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.939 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 31.159959573999998, 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:03:22.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.942 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.943 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.944 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:03:22.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 31.156689956000001, 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.947 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.948 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.949 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.950 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:03:22.951 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.952 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 31.156189435000002, 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.953 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:03:22.954 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.955 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.956 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.957 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 31.156034149, 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:22.959 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.960 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.961 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:03:22.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:03:22.963 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:22.964 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:22.966 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:22.958+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:22.966 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:23.068 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:23.063+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:23.117 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:23.117 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:23.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.117 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:263443 5.2 5:42254658:::benchmark_data_smithi112_23632_object131339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-20T21:03:23.117 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.107602+0000", 2024-09-20T21:03:23.117 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0062984729999999997, 2024-09-20T21:03:23.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063232469999999997, 2024-09-20T21:03:23.117 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 263443 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.107602+0000", 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.107602+0000", 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.107603+0000", 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0900000000000002e-07 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.107605+0000", 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.283e-06 2024-09-20T21:03:23.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.107612+0000", 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7229999999999998e-06 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.107616+0000", 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9459999999999997e-06 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.107670+0000", 2024-09-20T21:03:23.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3093999999999997e-05 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.107783+0000", 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011369100000000001 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113773+0000", 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059901479999999998 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113906+0000", 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013238900000000001 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:263446 5.4 e75/63 5:20741565:::benchmark_data_smithi112_23632_object131342:head v 75'16686, mlcod=75'16683)", 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.109625+0000", 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0042753469999999997, 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0043502310000000004, 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.122 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109625+0000", 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109625+0000", 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109626+0000", 2024-09-20T21:03:23.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1099999999999996e-07 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109629+0000", 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5860000000000001e-06 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109636+0000", 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2639999999999997e-06 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109640+0000", 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0339999999999998e-06 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109688+0000", 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8779000000000002e-05 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109707+0000", 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9063999999999999e-05 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:263447 5.a 5:563b49aa:::benchmark_data_smithi112_23632_object131343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.109724+0000", 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.004176908, 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0042852250000000001, 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 263447 2024-09-20T21:03:23.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109724+0000", 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109724+0000", 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109724+0000", 2024-09-20T21:03:23.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8899999999999999e-07 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109727+0000", 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1190000000000001e-06 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109734+0000", 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5490000000000003e-06 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.109738+0000", 2024-09-20T21:03:23.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2969999999999997e-06 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.110548+0000", 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00080944899999999995 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.110649+0000", 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101059 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:23.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.110747+0000", 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8251000000000005e-05 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113906+0000", 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0031586729999999999 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:263448 5.e e75/21 5:7fe0a480:::benchmark_data_smithi112_23632_object131344:head v 75'16383, mlcod=75'16380)", 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.111120+0000", 2024-09-20T21:03:23.130 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0027804850000000001, 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00293042, 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111120+0000", 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111120+0000", 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111121+0000", 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0800000000000004e-07 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111125+0000", 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6090000000000003e-06 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111136+0000", 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0446e-05 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111142+0000", 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5030000000000002e-06 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111185+0000", 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3099000000000002e-05 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111201+0000", 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5933000000000001e-05 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:263449 5.2 5:4ecf8110:::benchmark_data_smithi112_23632_object131345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.111858+0000", 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002042089, 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022230829999999998, 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.134 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 263449 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111858+0000", 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111858+0000", 2024-09-20T21:03:23.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111860+0000", 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.215e-06 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111864+0000", 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5750000000000002e-06 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111875+0000", 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.11e-05 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111884+0000", 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7779999999999996e-06 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.111926+0000", 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.214e-05 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112007+0000", 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1018000000000003e-05 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:263453 5.c 5:34acf6c2:::benchmark_data_smithi112_23632_object131349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.112125+0000", 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001775862, 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002022434, 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.138 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 263453 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112125+0000", 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112125+0000", 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112125+0000", 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5000000000000002e-07 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112129+0000", 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8659999999999999e-06 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112137+0000", 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4250000000000001e-06 2024-09-20T21:03:23.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112141+0000", 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5689999999999998e-06 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112177+0000", 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5689000000000003e-05 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112273+0000", 2024-09-20T21:03:23.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6262999999999996e-05 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:263454 5.7 5:e96b5037:::benchmark_data_smithi112_23632_object131350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.112233+0000", 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0016672099999999999, 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019788399999999999, 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 263454 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112233+0000", 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112233+0000", 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112234+0000", 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9299999999999997e-07 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112237+0000", 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.326e-06 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112246+0000", 2024-09-20T21:03:23.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6670000000000002e-06 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112252+0000", 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112301+0000", 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9299999999999999e-05 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112404+0000", 2024-09-20T21:03:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102651 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:263451 5.b e75/21 5:da16d0c1:::benchmark_data_smithi112_23632_object131347:head v 75'16818, mlcod=75'16816)", 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.112519+0000", 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0013819419999999999, 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001762312, 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112519+0000", 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112519+0000", 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112519+0000", 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8599999999999998e-07 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112525+0000", 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0039999999999996e-06 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112535+0000", 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5279999999999992e-06 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112541+0000", 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2219999999999999e-06 2024-09-20T21:03:23.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112738+0000", 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019680899999999999 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.112762+0000", 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4479999999999999e-05 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.149 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:263456 5.c 5:3bcd2f85:::benchmark_data_smithi112_23632_object131352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.113246+0000", 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00065494299999999995, 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010967990000000001, 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 263456 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113246+0000", 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113246+0000", 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113246+0000", 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0999999999999997e-07 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113251+0000", 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1860000000000002e-06 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113259+0000", 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113266+0000", 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7549999999999997e-06 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114132+0000", 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00086639099999999999 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114237+0000", 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105462 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:263452 5.e e75/21 5:7e4a503e:::benchmark_data_smithi112_23632_object131348:head v 75'16384, mlcod=75'16380)", 2024-09-20T21:03:23.153 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.113377+0000", 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00052347799999999996, 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010322199999999999, 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113377+0000", 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113377+0000", 2024-09-20T21:03:23.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113378+0000", 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2200000000000004e-07 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113385+0000", 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1189999999999999e-06 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113393+0000", 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8699999999999992e-06 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113398+0000", 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7420000000000003e-06 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113567+0000", 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016825499999999999 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113577+0000", 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0169e-05 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:263457 5.7 5:e4301130:::benchmark_data_smithi112_23632_object131353:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.113482+0000", 2024-09-20T21:03:23.157 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.000418284, 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098450800000000004, 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 263457 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113482+0000", 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113482+0000", 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113483+0000", 2024-09-20T21:03:23.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5300000000000004e-07 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113487+0000", 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6729999999999998e-06 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113496+0000", 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0280000000000006e-06 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.113502+0000", 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5169999999999996e-06 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114149+0000", 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064653499999999995 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114256+0000", 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107336 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:263460 5.1 5:8263645f:::benchmark_data_smithi112_23632_object131356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.114051+0000", 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9998493, 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00047708100000000002, 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 263460 2024-09-20T21:03:23.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114051+0000", 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114051+0000", 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114052+0000", 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5099999999999999e-07 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114055+0000", 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114064+0000", 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7479999999999999e-06 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114070+0000", 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2910000000000004e-06 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114129+0000", 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8588000000000002e-05 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114250+0000", 2024-09-20T21:03:23.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000120934 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:263459 5.0 e75/69 5:03a85b54:::benchmark_data_smithi112_23632_object131355:head v 75'16458, mlcod=75'16456)", 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:03:23.114205+0000", 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9996953, 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038198000000000003, 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114205+0000", 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114205+0000", 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114206+0000", 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1799999999999995e-07 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114210+0000", 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1819999999999999e-06 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114216+0000", 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4570000000000002e-06 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114221+0000", 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5029999999999999e-06 2024-09-20T21:03:23.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114265+0000", 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3982e-05 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:03:23.114278+0000", 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2894999999999999e-05 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-20T21:03:23.169 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 13 2024-09-20T21:03:23.170 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:23.171 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:23.171 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:23.162+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:23.271 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:23.266+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:23.367 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:23.367 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:03:23.367 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:03:23.367 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:03:23.367 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:23.372 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:23.371+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:23.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:23.424 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Removed 132101 objects 2024-09-20T21:03:23.424 INFO:tasks.radosbench.radosbench.0.smithi112.stdout:Clean up completed and total clean up time :55.1654 2024-09-20T21:03:23.476 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:23.475+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:23.540 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 131.34119377100001, 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:23.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:23.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 131.34096923999999, 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.547 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:23.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:23.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:23.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.861274852000001, 2024-09-20T21:03:23.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.860940627000002, 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.559 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:23.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.860681809999999, 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.859066893000001, 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.856748972999998, 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.854720879999999, 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.854596239999999, 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.852587923000002, 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.851527264000001, 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.851333440000001, 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.851256805999999, 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.851185603000001, 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.850870406999999, 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.849463670999999, 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.849209813000002, 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.848625085999998, 2024-09-20T21:03:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.848602834000001, 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.847535365999999, 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:23.643 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:23.645 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:23.645 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:23.642+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:23.746 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:23.738+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:23.777 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:23.777 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:23.777 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 0 2024-09-20T21:03:23.777 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:23.792 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:23.846 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:23.843+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:23.947 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:23.943+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:23.962 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:23.962 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:23.963 INFO:teuthology.orchestra.run.smithi203.stdout: "complaint_time": 30, 2024-09-20T21:03:23.963 INFO:teuthology.orchestra.run.smithi203.stdout: "num_blocked_ops": 0 2024-09-20T21:03:23.963 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:23.977 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:24.049 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:24.047+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:24.099 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:24.099 INFO:teuthology.orchestra.run.smithi203.stdout: "size": 20, 2024-09-20T21:03:24.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 600, 2024-09-20T21:03:24.099 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [ 2024-09-20T21:03:24.099 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.099 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.099 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:24.099 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 131.897837794, 2024-09-20T21:03:24.099 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040089310000000003, 2024-09-20T21:03:24.099 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196071+0000", 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.100 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196073+0000", 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.007e-06 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196084+0000", 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0869999999999999e-05 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196105+0000", 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1132999999999999e-05 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.101 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196123+0000", 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.732e-05 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196273+0000", 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015015199999999999 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196290+0000", 2024-09-20T21:03:24.102 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.7119999999999999e-05 2024-09-20T21:03:24.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.103 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213800+0000", 2024-09-20T21:03:24.103 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.017510421000000002 2024-09-20T21:03:24.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.103 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.103 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214149+0000", 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00034827099999999999 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214649+0000", 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00050005299999999998 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219815+0000", 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00516593 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.104 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235346+0000", 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015531076 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235485+0000", 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013886599999999999 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236161+0000", 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00067609099999999997 2024-09-20T21:03:24.105 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 131.89774775800001, 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.040646873, 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.106 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196161+0000", 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196162+0000", 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1699999999999997e-07 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.107 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196168+0000", 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6230000000000002e-06 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196181+0000", 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2673e-05 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196190+0000", 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.8699999999999998e-06 2024-09-20T21:03:24.108 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196556+0000", 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000366664 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196569+0000", 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2639999999999999e-05 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215886+0000", 2024-09-20T21:03:24.109 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.019316788000000001 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216093+0000", 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000207538 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.216468+0000", 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00037484699999999998 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.110 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.220076+0000", 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036076760000000002 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236463+0000", 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016387632999999999 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236657+0000", 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000193532 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.111 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.236808+0000", 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015147199999999999 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 131.89766140500001, 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041943040000000001, 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.112 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196248+0000", 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196249+0000", 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3699999999999999e-07 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196275+0000", 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.6336e-05 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196289+0000", 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3869999999999999e-05 2024-09-20T21:03:24.114 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196302+0000", 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.279e-05 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196473+0000", 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000171602 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196487+0000", 2024-09-20T21:03:24.115 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3482999999999999e-05 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217595+0000", 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.02110838 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217979+0000", 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000383731 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218160+0000", 2024-09-20T21:03:24.116 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000181495 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222179+0000", 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040185359999999996 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237773+0000", 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015594076 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.117 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238022+0000", 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000249418 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238191+0000", 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000168386 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:24.118 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 131.89759259600001, 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.042359687, 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:24.119 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196317+0000", 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8000000000000005e-07 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196322+0000", 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6299999999999997e-06 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.120 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196332+0000", 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.5969999999999998e-06 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196340+0000", 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.9999999999999996e-06 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196588+0000", 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024838099999999999 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.121 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196599+0000", 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1184e-05 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218539+0000", 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021940202999999998 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218653+0000", 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000113379 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.218868+0000", 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00021566200000000001 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222193+0000", 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003324825 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238298+0000", 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.016104895000000001 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.123 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238540+0000", 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000241692 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.238676+0000", 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013645899999999999 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.124 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 131.89755973600001, 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037696888999999997, 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.125 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196349+0000", 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196350+0000", 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196354+0000", 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.3799999999999998e-06 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.126 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196363+0000", 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1439999999999992e-06 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196370+0000", 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2960000000000001e-06 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196503+0000", 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013281299999999999 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.127 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.5455999999999999e-05 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.212035+0000", 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015516774000000001 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213039+0000", 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001004125 2024-09-20T21:03:24.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.213395+0000", 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00035600699999999998 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219566+0000", 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0061710289999999998 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233778+0000", 2024-09-20T21:03:24.129 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.01421179 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.233930+0000", 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015183199999999999 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234046+0000", 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116543 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 131.89751771900001, 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038664848000000002, 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196391+0000", 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196392+0000", 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196398+0000", 2024-09-20T21:03:24.132 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3859999999999998e-06 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196409+0000", 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1704e-05 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196422+0000", 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2683e-05 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.133 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196601+0000", 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017874199999999999 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196608+0000", 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.2699999999999999e-06 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.214895+0000", 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.018286848000000001 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.134 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215016+0000", 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000121136 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.215888+0000", 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00087197700000000002 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.219957+0000", 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.004069161 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234300+0000", 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.014342696 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234953+0000", 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00065346499999999999 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235056+0000", 2024-09-20T21:03:24.136 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010308 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 131.89739261299999, 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.041295543999999997, 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.137 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:24.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.138 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.138 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.138 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196517+0000", 2024-09-20T21:03:24.138 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196518+0000", 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196527+0000", 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.9069999999999996e-06 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196547+0000", 2024-09-20T21:03:24.139 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.0389000000000001e-05 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196562+0000", 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.4983e-05 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196670+0000", 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000107576 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.140 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196680+0000", 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0447e-05 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217017+0000", 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.020336745999999999 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217193+0000", 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017561899999999999 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.141 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.217393+0000", 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00020023799999999999 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.222157+0000", 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0047641209999999996 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237443+0000", 2024-09-20T21:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.015285981000000001 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237696+0000", 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00025266500000000001 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.237812+0000", 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000116506 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.143 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 131.89730026399999, 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.037563599000000003, 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:24.144 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196609+0000", 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196610+0000", 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3659999999999999e-06 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196617+0000", 2024-09-20T21:03:24.145 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.0600000000000002e-06 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196637+0000", 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.9219999999999999e-05 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196658+0000", 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.1503000000000001e-05 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.146 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196761+0000", 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000102693 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196770+0000", 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7200000000000001e-06 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203354+0000", 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.006583925 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.147 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.203676+0000", 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00032156799999999999 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.234173+0000", 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030496544 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.148 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 131.89721589199999, 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038314846999999999, 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "started", 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.149 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196693+0000", 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196694+0000", 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.2699999999999998e-07 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196698+0000", 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.89e-06 2024-09-20T21:03:24.150 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196709+0000", 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1270000000000001e-05 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196717+0000", 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7500000000000003e-06 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196803+0000", 2024-09-20T21:03:24.151 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6266000000000004e-05 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op must wait for map", 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.196812+0000", 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7760000000000003e-06 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204543+0000", 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0077309429999999997 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.152 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.204812+0000", 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00026914499999999999 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:12.235008+0000", 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.030195980000000001 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62101 5.8 5:186de704:::benchmark_data_smithi112_23632_object62100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 93.131756436000003, 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.028015121, 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62101 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:24.154 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962153+0000", 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1500000000000004e-07 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.155 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962219+0000", 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5188e-05 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962226+0000", 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.4220000000000003e-06 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962231+0000", 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4209999999999997e-06 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.156 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962279+0000", 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.8238999999999997e-05 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962418+0000", 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000139102 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962543+0000", 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012524500000000001 2024-09-20T21:03:24.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967431+0000", 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048883099999999999 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990111+0000", 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022679965999999999 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990144+0000", 2024-09-20T21:03:24.158 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.2369999999999997e-05 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990168+0000", 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4142999999999999e-05 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62102 5.0 5:07ebbe18:::benchmark_data_smithi112_23632_object62101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 93.131204429999997, 2024-09-20T21:03:24.159 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027509593999999998, 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62102 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962705+0000", 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962706+0000", 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1200000000000002e-07 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962787+0000", 2024-09-20T21:03:24.161 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1273999999999995e-05 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962795+0000", 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.5169999999999999e-06 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.962800+0000", 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.6040000000000003e-06 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.162 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963105+0000", 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000304536 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963250+0000", 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000145115 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963396+0000", 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00014596499999999999 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.163 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.967436+0000", 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0040403000000000001 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990149+0000", 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.022713403 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990190+0000", 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0343000000000003e-05 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.164 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990214+0000", 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4725000000000001e-05 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:62105 5.8 5:1ffaef3a:::benchmark_data_smithi112_23632_object62104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 93.130576848999993, 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.027025598000000001, 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.165 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 62105 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.166 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963332+0000", 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963333+0000", 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.8999999999999996e-07 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963411+0000", 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.8437999999999997e-05 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.167 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963425+0000", 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.3523000000000001e-05 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.963432+0000", 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7610000000000002e-06 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965053+0000", 2024-09-20T21:03:24.168 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.001621132 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965212+0000", 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015940999999999999 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.965377+0000", 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00016463400000000001 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.169 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.968621+0000", 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003243807 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990266+0000", 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.021645340999999998 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990319+0000", 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3010999999999998e-05 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.170 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:01:50.990358+0000", 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8850999999999998e-05 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102559 5.b 5:d29932d5:::benchmark_data_smithi112_23632_object102558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.380842952999998, 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.038936694000000001, 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.171 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102559 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.172 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713066+0000", 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713067+0000", 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0699999999999998e-07 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713107+0000", 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0680999999999999e-05 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.173 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713115+0000", 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5100000000000001e-06 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713118+0000", 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.6289999999999999e-06 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713163+0000", 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4478999999999999e-05 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.174 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713344+0000", 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018080099999999999 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.713498+0000", 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00015451199999999999 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.716848+0000", 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.003349262 2024-09-20T21:03:24.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751937+0000", 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.035089745999999998 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.751975+0000", 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.7591e-05 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.752003+0000", 2024-09-20T21:03:24.176 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8076e-05 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102569 5.0 5:0450bc6d:::benchmark_data_smithi112_23632_object102568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.376492028000001, 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.039218417999999998, 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.177 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102569 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717417+0000", 2024-09-20T21:03:24.178 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717418+0000", 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717473+0000", 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.5161000000000003e-05 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717484+0000", 2024-09-20T21:03:24.179 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0954e-05 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717490+0000", 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.8510000000000004e-06 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717540+0000", 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.9894e-05 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.180 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717662+0000", 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012216399999999999 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.717791+0000", 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00012922699999999999 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.722617+0000", 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0048259990000000001 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.181 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756408+0000", 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.033790863999999997 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756565+0000", 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000156613 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.756636+0000", 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.1061000000000003e-05 2024-09-20T21:03:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:102581 5.e 5:73ca2a9f:::benchmark_data_smithi112_23632_object102580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 72.368249957000003, 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.032414824000000002, 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.183 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 102581 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725659+0000", 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.184 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725660+0000", 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.6199999999999998e-07 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725747+0000", 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7045000000000004e-05 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725757+0000", 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.0516999999999999e-05 2024-09-20T21:03:24.185 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725761+0000", 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.8589999999999998e-06 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725796+0000", 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.4622000000000002e-05 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725884+0000", 2024-09-20T21:03:24.186 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.7986999999999996e-05 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.725967+0000", 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3485000000000005e-05 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.728687+0000", 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0027192430000000001 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.187 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.757919+0000", 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.029232687 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758010+0000", 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.1168999999999994e-05 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:11.758074+0000", 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3647999999999998e-05 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.188 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191424 5.0 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 32.419120644000003, 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10879338, 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191424 2024-09-20T21:03:24.189 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.190 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674789+0000", 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7099999999999998e-07 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674791+0000", 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.685e-06 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674795+0000", 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.4889999999999997e-06 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.191 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674801+0000", 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0109999999999997e-06 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674846+0000", 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.5391e-05 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.674949+0000", 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010307 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.192 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.675015+0000", 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.5343000000000001e-05 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.677566+0000", 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.002551673 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783432+0000", 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105866004 2024-09-20T21:03:24.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783519+0000", 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.6995000000000003e-05 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.783582+0000", 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.2447999999999996e-05 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191436 5.0 5:0197d559:::benchmark_data_smithi112_23632_object59332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 32.413204077000003, 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.105824681, 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191436 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.195 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680705+0000", 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680706+0000", 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.7699999999999992e-07 2024-09-20T21:03:24.196 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680710+0000", 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.0940000000000001e-06 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680722+0000", 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.2125e-05 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680729+0000", 2024-09-20T21:03:24.197 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.6139999999999997e-06 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680790+0000", 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0652999999999997e-05 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.680924+0000", 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00013459499999999999 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.198 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.681002+0000", 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.7836999999999994e-05 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684433+0000", 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0034306649999999998 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786247+0000", 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.101813852 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.199 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786426+0000", 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00017941800000000001 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786530+0000", 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00010385100000000001 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.200 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191442 5.b 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 32.409934458999999, 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.098644488000000002, 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191442 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.201 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683975+0000", 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683976+0000", 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.409e-06 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683982+0000", 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.818e-06 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.683993+0000", 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 1.1387e-05 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684002+0000", 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.3440000000000001e-06 2024-09-20T21:03:24.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.9038000000000001e-05 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684134+0000", 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.3504999999999993e-05 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.204 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684216+0000", 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.1755999999999994e-05 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687880+0000", 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0036643639999999998 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782559+0000", 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.094678353000000007 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.205 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782595+0000", 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 3.5908000000000002e-05 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.782619+0000", 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.4606000000000001e-05 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191445 5.0 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.206 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 32.409433937999999, 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.102506476, 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191445 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.207 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684475+0000", 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684476+0000", 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.4099999999999999e-07 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.208 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684479+0000", 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.8609999999999998e-06 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684486+0000", 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 7.5680000000000002e-06 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684492+0000", 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 5.3589999999999999e-06 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.209 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684584+0000", 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.2291000000000001e-05 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684769+0000", 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00018473400000000001 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684836+0000", 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.7705000000000003e-05 2024-09-20T21:03:24.210 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.687060+0000", 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0022241269999999998 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786642+0000", 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.099581346000000001 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.211 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786883+0000", 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.00024114699999999999 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.786982+0000", 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 9.8796999999999996e-05 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: "description": "osd_op(client.4448.0:191448 5.b 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: "initiated_at": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:24.212 INFO:teuthology.orchestra.run.smithi203.stdout: "age": 32.409278651999998, 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.10067372300000001, 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "continuous": false, 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "type_data": { 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "client_info": { 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "client": "client.4448", 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "tid": 191448 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "events": [ 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "initiated", 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.213 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "header_read", 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "throttled", 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684631+0000", 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.3e-07 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "all_read", 2024-09-20T21:03:24.214 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684634+0000", 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 2.7010000000000001e-06 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "dispatched", 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684640+0000", 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.4690000000000002e-06 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.684645+0000", 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 4.3730000000000003e-06 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "reached_pg", 2024-09-20T21:03:24.215 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686308+0000", 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0016632319999999999 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "started", 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686416+0000", 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.000108118 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "waiting for subops from 0", 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.686484+0000", 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.792e-05 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.216 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "op_commit", 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.688212+0000", 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.0017277760000000001 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785159+0000", 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 0.096947307999999996 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "commit_sent", 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785244+0000", 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 8.4528000000000001e-05 2024-09-20T21:03:24.217 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-20T21:03:24.218 INFO:teuthology.orchestra.run.smithi203.stdout: { 2024-09-20T21:03:24.218 INFO:teuthology.orchestra.run.smithi203.stdout: "event": "done", 2024-09-20T21:03:24.218 INFO:teuthology.orchestra.run.smithi203.stdout: "time": "2024-09-20T21:02:51.785304+0000", 2024-09-20T21:03:24.218 INFO:teuthology.orchestra.run.smithi203.stdout: "duration": 6.0668000000000003e-05 2024-09-20T21:03:24.218 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.218 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.218 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.218 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-20T21:03:24.218 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-20T21:03:24.218 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:24.219 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:24.214+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:24.220 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:24.321 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:24.319+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:24.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T21:03:24.350 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:03:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-20T21:03:24.350 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:24.364 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:24.422 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:24.418+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:24.521 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:24.521 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-20T21:03:24.521 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-20T21:03:24.521 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-20T21:03:24.521 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:24.523 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:24.514+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:24.534 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:24.623 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:24.619+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:24.650 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-20T21:03:24.650 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-20T21:03:24.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-20T21:03:24.650 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-20T21:03:24.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 132.453630129, 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041035752000000002, 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194366+0000", 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194368+0000", 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9630000000000001e-06 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194378+0000", 2024-09-20T21:03:24.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6770000000000007e-06 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194401+0000", 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-05 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194418+0000", 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7246000000000001e-05 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194583+0000", 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164945 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194623+0000", 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9583999999999999e-05 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215752+0000", 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.021129779000000001 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215958+0000", 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000205711 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.216911+0000", 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00095335000000000005 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.227196+0000", 2024-09-20T21:03:24.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010284662999999999 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235262+0000", 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080662949999999994 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235345+0000", 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2925999999999999e-05 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.235402+0000", 2024-09-20T21:03:24.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6372999999999997e-05 2024-09-20T21:03:24.657 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.657 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.657 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.657 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T21:03:24.657 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:24.657 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 132.45340559799999, 2024-09-20T21:03:24.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.044036648999999997, 2024-09-20T21:03:24.658 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.658 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.658 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.658 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194590+0000", 2024-09-20T21:03:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194592+0000", 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3170000000000001e-06 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194600+0000", 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1629999999999996e-06 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194621+0000", 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0713999999999999e-05 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194636+0000", 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5622999999999999e-05 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194732+0000", 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6028999999999998e-05 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting_for_map not empty", 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.194745+0000", 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2723e-05 2024-09-20T21:03:24.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.214993+0000", 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020248428999999998 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215202+0000", 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000209082 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.215788+0000", 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058524900000000003 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.222387+0000", 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065992189999999999 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238453+0000", 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016065992000000001 2024-09-20T21:03:24.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238557+0000", 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103656 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:01:12.238627+0000", 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0452999999999998e-05 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191419 5.8 5:19c0df77:::benchmark_data_smithi112_23632_object59315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.973711209999998, 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111212272, 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191419 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.665 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674285+0000", 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9900000000000001e-07 2024-09-20T21:03:24.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674324+0000", 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8321000000000001e-05 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674332+0000", 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1799999999999996e-06 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674337+0000", 2024-09-20T21:03:24.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.553e-06 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676958+0000", 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026201979999999998 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677147+0000", 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018918099999999999 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.677253+0000", 2024-09-20T21:03:24.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105785 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685819+0000", 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0085666869999999999 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785421+0000", 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099601625999999999 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785463+0000", 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2101000000000002e-05 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785497+0000", 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4140999999999997e-05 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191426 5.8 5:1f1ff46a:::benchmark_data_smithi112_23632_object59322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.973376985000002, 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.110950438, 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191426 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674619+0000", 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6300000000000001e-07 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674621+0000", 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1009999999999999e-06 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674628+0000", 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3770000000000001e-06 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674633+0000", 2024-09-20T21:03:24.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8720000000000001e-06 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679482+0000", 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048494890000000002 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679596+0000", 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011424700000000001 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.679708+0000", 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111184 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685855+0000", 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061475849999999997 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785505+0000", 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099649858999999993 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785540+0000", 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5182000000000003e-05 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785569+0000", 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9179e-05 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191424 5.0 e59/21 5:071cfc6d:::benchmark_data_smithi112_23632_object59320:head v 59'11891, mlcod=59'11889)", 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.973118167999999, 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10786546800000001, 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674878+0000", 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9900000000000002e-07 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674882+0000", 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4319999999999999e-06 2024-09-20T21:03:24.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674888+0000", 2024-09-20T21:03:24.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1279999999999996e-06 2024-09-20T21:03:24.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.674892+0000", 2024-09-20T21:03:24.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1559999999999997e-06 2024-09-20T21:03:24.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676400+0000", 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015085859999999999 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676413+0000", 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2228999999999999e-05 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782566+0000", 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.106153601 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782743+0000", 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017703700000000001 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191428 5.8 5:13aaf34b:::benchmark_data_smithi112_23632_object59324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:24.683 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.971503251000001, 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10915617800000001, 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191428 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:24.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676493+0000", 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676494+0000", 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5629999999999999e-06 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676500+0000", 2024-09-20T21:03:24.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1380000000000004e-06 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676513+0000", 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2213e-05 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.676520+0000", 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4420000000000001e-06 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681885+0000", 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053647219999999997 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684161+0000", 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0022766129999999998 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5034000000000001e-05 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782590+0000", 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098363896000000006 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785584+0000", 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029936670000000002 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785620+0000", 2024-09-20T21:03:24.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5843000000000002e-05 2024-09-20T21:03:24.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785649+0000", 2024-09-20T21:03:24.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9047000000000002e-05 2024-09-20T21:03:24.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191433 5.8 5:1fc6dd92:::benchmark_data_smithi112_23632_object59329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.969185330999998, 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.111116759, 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191433 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678811+0000", 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678812+0000", 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9500000000000001e-07 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678819+0000", 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4869999999999996e-06 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678830+0000", 2024-09-20T21:03:24.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0798999999999999e-05 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.678836+0000", 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6000000000000003e-06 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782772+0000", 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.103936005 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782930+0000", 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015782200000000001 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.783075+0000", 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144797 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.787812+0000", 2024-09-20T21:03:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047367779999999996 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789741+0000", 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019294620000000001 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789855+0000", 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113647 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789927+0000", 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2466999999999996e-05 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191436 5.0 e59/21 5:0197d559:::benchmark_data_smithi112_23632_object59332:head v 59'11892, mlcod=59'11889)", 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.967157237999999, 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.104842249, 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.696 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680839+0000", 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0399999999999996e-07 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680845+0000", 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7749999999999998e-06 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680852+0000", 2024-09-20T21:03:24.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2570000000000001e-06 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680858+0000", 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6640000000000003e-06 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685796+0000", 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004937772 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685815+0000", 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9296e-05 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785650+0000", 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099835339999999995 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785681+0000", 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0540999999999998e-05 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.700 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191440 5.c 5:32de6daa:::benchmark_data_smithi112_23632_object59336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.967032598000003, 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101021948, 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191440 2024-09-20T21:03:24.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680963+0000", 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680964+0000", 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8400000000000003e-07 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680969+0000", 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2880000000000003e-06 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680978+0000", 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4220000000000006e-06 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.680985+0000", 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2640000000000002e-06 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681033+0000", 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7715e-05 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.681137+0000", 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104394 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781814+0000", 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100677083 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781903+0000", 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8615000000000005e-05 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781985+0000", 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2282999999999998e-05 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191426 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.965024280999998, 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102604868, 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.706 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682972+0000", 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682973+0000", 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0410000000000001e-06 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682978+0000", 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8579999999999999e-06 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.682996+0000", 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7952e-05 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.683003+0000", 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9140000000000008e-06 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685844+0000", 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028407699999999998 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.685850+0000", 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5809999999999996e-06 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785577+0000", 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099726752000000002 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191442 5.b e59/21 5:de24a5c1:::benchmark_data_smithi112_23632_object59338:head v 59'12226, mlcod=59'12224)", 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.963963622000001, 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097971785000000006, 2024-09-20T21:03:24.710 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684032+0000", 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684033+0000", 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3900000000000004e-07 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684041+0000", 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7090000000000002e-06 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684070+0000", 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9373000000000002e-05 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684076+0000", 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.801e-06 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684219+0000", 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014313800000000001 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684240+0000", 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1128000000000002e-05 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781911+0000", 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097670748000000002 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782004+0000", 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-20T21:03:24.714 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191444 5.4 5:26873b61:::benchmark_data_smithi112_23632_object59340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.963769798000001, 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097884269999999995, 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.715 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191444 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684226+0000", 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684228+0000", 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3710000000000001e-06 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684232+0000", 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5249999999999999e-06 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684242+0000", 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7990000000000005e-06 2024-09-20T21:03:24.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684249+0000", 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3309999999999998e-06 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4333999999999997e-05 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684491+0000", 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016781599999999999 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684608+0000", 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116141 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781815+0000", 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.097207699999999994 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781995+0000", 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017962300000000001 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782075+0000", 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0411e-05 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782110+0000", 2024-09-20T21:03:24.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5219000000000003e-05 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191446 5.c 5:37b18a74:::benchmark_data_smithi112_23632_object59342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.963693163999999, 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10257213, 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:24.721 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191446 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684303+0000", 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684304+0000", 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000002e-07 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684307+0000", 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3739999999999998e-06 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684318+0000", 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0744000000000001e-05 2024-09-20T21:03:24.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684324+0000", 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6420000000000001e-06 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686304+0000", 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001979874 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686379+0000", 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5017000000000004e-05 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786719+0000", 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.100340214 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786805+0000", 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6017e-05 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.786875+0000", 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9491000000000003e-05 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191447 5.8 5:15f371bc:::benchmark_data_smithi112_23632_object59343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.963621961000001, 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.109025551, 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.726 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191447 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684374+0000", 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684375+0000", 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3399999999999999e-07 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684378+0000", 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4079999999999998e-06 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684386+0000", 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0579999999999998e-06 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684392+0000", 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785732+0000", 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101339662 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785834+0000", 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102039 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785945+0000", 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111313 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789293+0000", 2024-09-20T21:03:24.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003347942 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793280+0000", 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0039871389999999998 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793345+0000", 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5267999999999999e-05 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.793400+0000", 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4382000000000002e-05 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191445 5.0 e59/21 5:0b93f812:::benchmark_data_smithi112_23632_object59341:head v 59'11893, mlcod=59'11889)", 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.963306764999999, 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101017022, 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.732 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684689+0000", 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684690+0000", 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1099999999999995e-07 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684695+0000", 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7929999999999997e-06 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684702+0000", 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7400000000000004e-06 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.684708+0000", 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6470000000000003e-06 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687519+0000", 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0028106630000000001 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.687531+0000", 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2191000000000001e-05 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785683+0000", 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098152244 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785706+0000", 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3133e-05 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191449 5.1 5:8df85127:::benchmark_data_smithi112_23632_object59345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.961900028999999, 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.099271290999999998, 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191449 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686096+0000", 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686097+0000", 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6300000000000004e-07 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686101+0000", 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0790000000000002e-06 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686109+0000", 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9480000000000008e-06 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686114+0000", 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6500000000000004e-06 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781704+0000", 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095590657999999995 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781858+0000", 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015348 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785231+0000", 2024-09-20T21:03:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0033731299999999998 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785286+0000", 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5244000000000002e-05 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.785367+0000", 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1238999999999999e-05 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4448.0:191448 5.b e59/21 5:d0623dfc:::benchmark_data_smithi112_23632_object59344:head v 59'12227, mlcod=59'12224)", 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.961646170999998, 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098251028000000004, 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686350+0000", 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686351+0000", 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0100000000000004e-07 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686358+0000", 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4209999999999998e-06 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686367+0000", 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0939999999999997e-06 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686372+0000", 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9620000000000001e-06 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686413+0000", 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0859000000000003e-05 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686432+0000", 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9352e-05 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784505+0000", 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.098072569999999998 2024-09-20T21:03:24.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.784601+0000", 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6069000000000005e-05 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191428 5.8 e59/38 ondisk, result = 0)", 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.961061444000002, 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095662095000000003, 2024-09-20T21:03:24.747 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686935+0000", 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000004e-07 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686938+0000", 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.083e-06 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686945+0000", 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3459999999999999e-06 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686949+0000", 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9169999999999999e-06 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782578+0000", 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.095629119999999998 2024-09-20T21:03:24.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782585+0000", 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3579999999999997e-06 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782597+0000", 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.168e-05 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4448.0:191444 5.4 e59/38 ondisk, result = 0)", 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.961039192000001, 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094867988, 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686957+0000", 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.67e-07 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686958+0000", 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.398e-06 2024-09-20T21:03:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686962+0000", 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2459999999999999e-06 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.686964+0000", 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3240000000000001e-06 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781800+0000", 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.094836155000000005 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781808+0000", 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1470000000000001e-06 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781825+0000", 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6551000000000001e-05 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.755 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4448.0:191450 5.6 5:6bcdebff:::benchmark_data_smithi112_23632_object59346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.959971723999999, 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101901667, 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "continuous": false, 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4448", 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.112:0/265161548", 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 191450 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.756 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688024+0000", 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688025+0000", 2024-09-20T21:03:24.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9999999999999997e-07 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.688028+0000", 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3720000000000001e-06 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781703+0000", 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.093674799000000003 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-20T21:03:24.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.781714+0000", 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1158999999999999e-05 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782054+0000", 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034004899999999998 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.782177+0000", 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012224299999999999 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789767+0000", 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075901529999999997 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789826+0000", 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9483e-05 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-20T21:02:51.789926+0000", 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9709000000000004e-05 2024-09-20T21:03:24.760 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.761 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.761 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.761 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-20T21:03:24.761 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-20T21:03:24.761 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-20T21:03:24.761 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T21:03:24.763 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:24.763 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:24.759+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:24.864 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:24.863+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:24.893 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-20T21:03:24.893 INFO:teuthology.orchestra.run.smithi203.stdout: "ops": [], 2024-09-20T21:03:24.893 INFO:teuthology.orchestra.run.smithi203.stdout: "num_ops": 0 2024-09-20T21:03:24.893 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-20T21:03:24.907 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:24.910 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-20T21:03:24.910 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T21:03:24.911 INFO:teuthology.orchestra.run.smithi112.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-20T21:03:24.928 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-20T21:03:24.929 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T21:03:24.931 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T21:03:24.932 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T21:03:24.964 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:24.958+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:25.025 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:25.025 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:25.039 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:25.083 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:25.078+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:25.107 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-20T21:03:25.108 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-20T21:03:25.166 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:25.163+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:25.208 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:25.208 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:25.223 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:25.266 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:25.258+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:25.336 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-20T21:03:25.355 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:25.355 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:25.367 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:25.363+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:25.369 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:25.467 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:25.462+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:25.538 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:25.539 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:25.554 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:25.569 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:25.562+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:25.670 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:25.662+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:25.675 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:25.675 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:25.691 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:25.770 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:25.762+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:25.823 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:25.823 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:25.837 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:25.879 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:25.874+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:25.972 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:25.970+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:26.003 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:26.003 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:26.017 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:26.072 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:26.070+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:26.134 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:26.134 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:26.148 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T21:03:26.173 INFO:tasks.ceph.osd.2.smithi203.stderr:2024-09-20T21:03:26.166+0000 7f895ace4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22966) UID: 0 2024-09-20T21:03:26.273 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-20T21:03:26.270+0000 7f19c5168640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22917) UID: 0 2024-09-20T21:03:26.280 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:26.281 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:26.295 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T21:03:26.345 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'unique_pool_0' removed 2024-09-20T21:03:26.371 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-20T21:03:26.387 INFO:tasks.thrashosds:joining thrashosds 2024-09-20T21:03:26.486 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:26.486 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:26.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T21:03:26.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-09-20T21:03:26.615 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:26.615 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:26.630 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T21:03:26.763 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:26.764 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:26.777 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T21:03:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:26.907 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T21:03:27.023 INFO:teuthology.orchestra.run.smithi203.stdout:ERROR: (22) Invalid argument 2024-09-20T21:03:27.023 INFO:teuthology.orchestra.run.smithi203.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T21:03:27.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T21:03:28.378 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-20T21:03:28.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T21:03:29.382 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-20T21:03:32.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2024-09-20T21:03:38.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-09-20T21:03:43.923 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-09-20T21:03:49.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-09-20T21:03:55.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-09-20T21:04:01.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-09-20T21:04:07.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~99s 2024-09-20T21:04:12.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-09-20T21:04:18.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-09-20T21:04:24.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-09-20T21:04:30.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~123s 2024-09-20T21:04:36.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~129s 2024-09-20T21:04:41.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~134s 2024-09-20T21:04:47.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-09-20T21:04:53.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~146s 2024-09-20T21:04:59.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~152s 2024-09-20T21:05:05.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~158s 2024-09-20T21:05:11.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~163s 2024-09-20T21:05:16.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~169s 2024-09-20T21:05:17.205 DEBUG:teuthology.orchestra.console.smithi161:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 72 51 GUID: 00000000 0000 0000 0000 0CC47AD9367C DHCP.\                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ CLIENT IP: 172.21.15.161 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:72:51)... Configuring (net0 0c:c4:7a:88:72:51).... Configuring (net0 0c:c4:7a:88:72:51)..... Configuring (net0 0c:c4:7a:88:72:51)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-122-generic ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-122-generic (buildd@lcy02-amd64-034) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 (Ubuntu 5.15.0-122.132-generic 5.15.163) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.674 MHz processor [ 0.000427] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000608] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001907] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008295] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008310] Using GB pages for direct mapping [ 0.008475] RAMDISK: [mem 0x300c3000-0x34058fff] [ 0.008480] ACPI: Early table checksum verification disabled [ 0.008483] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008487] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008492] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008498] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008501] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008503] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008506] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008509] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008512] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008515] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008518] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008521] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008523] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008526] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008529] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008532] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008535] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008538] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008541] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008544] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008546] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008549] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008552] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008555] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008556] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008557] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008558] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008559] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008560] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008561] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008562] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008563] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008564] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008565] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008566] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008567] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008568] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008569] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008570] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008571] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008572] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008573] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008574] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008575] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008670] No NUMA configuration found [ 0.008671] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008680] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.009013] Zone ranges: [ 0.009014] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.009016] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.009018] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.009020] Device empty [ 0.009021] Movable zone start for each node [ 0.009024] Early memory node ranges [ 0.009024] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.009026] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.009027] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.009032] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.009036] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009072] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080729] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080844] ACPI: PM-Timer IO Port: 0x408 [ 0.080852] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080854] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080855] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080856] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080857] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080857] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080858] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080859] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080868] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080873] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080875] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080877] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080880] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080882] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080885] TSC deadline timer available [ 0.080887] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080897] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080899] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080900] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080902] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080903] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080904] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080905] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080906] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080907] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080908] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080909] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080911] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080912] Booting paravirtualized kernel on bare hardware [ 0.080915] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080922] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.081137] percpu: Embedded 62 pages/cpu s217088 r8192 d28672 u262144 [ 0.081168] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.081170] Policy zone: Normal [ 0.081172] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.081231] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic", will be passed to user space. [ 0.083387] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084532] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084626] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.171172] Memory: 32672656K/33438012K available (16392K kernel code, 4397K rwdata, 10964K rodata, 3368K init, 18700K bss, 765096K reserved, 0K cma-reserved) [ 0.171454] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.171469] Kernel/User page tables isolation: enabled [ 0.171501] ftrace: allocating 50768 entries in 199 pages [ 0.191725] ftrace: allocated 199 pages with 5 groups [ 0.191851] rcu: Hierarchical RCU implementation. [ 0.191853] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.191854] Rude variant of Tasks RCU enabled. [ 0.191855] Tracing variant of Tasks RCU enabled. [ 0.191856] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.191857] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.195319] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.195517] random: crng init done [ 0.200380] Console: colour VGA+ 80x25 [ 0.211611] printk: console [tty0] enabled [ 1.198634] printk: console [ttyS1] enabled [ 1.202893] ACPI: Core revision 20210730 [ 1.207053] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.216274] APIC: Switch to symmetric I/O mode setup [ 1.221312] DMAR: Host address width 46 [ 1.225216] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.231695] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.239785] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.246125] DMAR: ATSR flags: 0x0 [ 1.249510] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.255850] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.262274] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.268697] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.274164] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.274165] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.289350] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.294727] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.301008] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.324284] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32721cabb57, max_idle_ns: 440795215156 ns [ 1.334889] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.34 BogoMIPS (lpj=13998696) [ 1.338905] CPU0: Thermal monitoring enabled (TM1) [ 1.342940] process: using mwait in idle threads [ 1.346888] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.350887] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.354889] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.358888] Spectre V2 : Mitigation: Retpolines [ 1.362887] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.366887] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.370887] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.374888] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.378887] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.382887] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.386890] MDS: Mitigation: Clear CPU buffers [ 1.390887] TAA: Mitigation: Clear CPU buffers [ 1.394887] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.398892] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.402887] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.406887] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.410887] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.414887] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.436923] Freeing SMP alternatives memory: 44K [ 1.438888] pid_max: default: 32768 minimum: 301 [ 1.442908] LSM: Security Framework initializing [ 1.446895] landlock: Up and running. [ 1.450619] Yama: becoming mindful. [ 1.450904] AppArmor: AppArmor initialized [ 1.454947] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.458927] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.463246] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.466892] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.470995] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.474888] ... version: 3 [ 1.478887] ... bit width: 48 [ 1.482887] ... generic registers: 4 [ 1.486887] ... value mask: 0000ffffffffffff [ 1.490887] ... max period: 00007fffffffffff [ 1.494887] ... fixed-purpose events: 3 [ 1.498887] ... event mask: 000000070000000f [ 1.502948] signal: max sigframe size: 1776 [ 1.506902] rcu: Hierarchical SRCU implementation. [ 1.511610] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.514952] smp: Bringing up secondary CPUs ... [ 1.518969] x86: Booting SMP configuration: [ 1.522890] .... node #0, CPUs: #1 #2 #3 #4 [ 1.531053] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.538887] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.542887] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.546987] #5 #6 #7 [ 1.547543] smp: Brought up 1 node, 8 CPUs [ 1.554890] smpboot: Max logical packages: 1 [ 1.558887] smpboot: Total of 8 processors activated (55994.78 BogoMIPS) [ 1.567203] devtmpfs: initialized [ 1.570305] x86/mm: Memory block size: 128MB [ 1.572478] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.574963] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.578897] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.582933] pinctrl core: initialized pinctrl subsystem [ 1.586978] PM: RTC time: 21:04:49, date: 2024-09-20 [ 1.590992] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.595219] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.599187] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.603219] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.606897] audit: initializing netlink subsys (disabled) [ 1.610907] audit: type=2000 audit(1726866288.352:1): state=initialized audit_enabled=0 res=1 [ 1.611003] thermal_sys: Registered thermal governor 'fair_share' [ 1.614889] thermal_sys: Registered thermal governor 'bang_bang' [ 1.618887] thermal_sys: Registered thermal governor 'step_wise' [ 1.622887] thermal_sys: Registered thermal governor 'user_space' [ 1.626887] thermal_sys: Registered thermal governor 'power_allocator' [ 1.630893] EISA bus registered [ 1.638095] cpuidle: using governor ladder [ 1.638889] cpuidle: using governor menu [ 1.642903] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.646888] ACPI: bus type PCI registered [ 1.650888] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.654941] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.658889] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.662900] PCI: Using configuration type 1 for base access [ 1.667906] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.670904] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.674888] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.678961] ACPI: Added _OSI(Module Device) [ 1.682889] ACPI: Added _OSI(Processor Device) [ 1.686895] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.690887] ACPI: Added _OSI(Processor Aggregator Device) [ 1.694887] ACPI: Added _OSI(Linux-Dell-Video) [ 1.698887] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.702887] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.751997] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.758366] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.763033] ACPI: Dynamic OEM Table Load: [ 1.792654] ACPI: Interpreter enabled [ 1.794899] ACPI: PM: (supports S0 S4 S5) [ 1.798888] ACPI: Using IOAPIC for interrupt routing [ 1.802909] HEST: Enabling Firmware First mode for corrected errors. [ 1.806966] HEST: Table parsing has been initialized. [ 1.811036] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.814889] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.818887] PCI: Using E820 reservations for host bridge windows [ 1.823571] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.858180] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.858890] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.864863] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.871883] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.874888] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.878919] PCI host bridge to bus 0000:ff [ 1.882888] pci_bus 0000:ff: root bus resource [bus ff] [ 1.886897] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.890952] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.894940] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.898942] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.902940] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.906939] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.910938] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.914939] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.918943] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.922939] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.926938] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.930939] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.934938] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.938940] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.942941] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.946939] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.950941] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.954938] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.958939] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.962912] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.966950] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.970989] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.974952] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.978951] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.982954] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.986952] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.990951] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.994941] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.998942] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.002952] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.006952] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.010953] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.014953] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.018941] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.022941] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.026940] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.030942] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.034951] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.038951] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.042953] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.046955] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.050945] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.054942] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.058941] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.062944] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.066940] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.070941] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.074944] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.078946] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.082939] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.086939] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.090940] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.094913] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.098941] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.102940] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.110942] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.114890] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.119210] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.123335] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.126887] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.131175] PCI host bridge to bus 0000:00 [ 2.134889] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.138887] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.142887] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.146887] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.150887] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.154887] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.158887] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.162993] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.167096] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.170953] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.175058] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.178952] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.183050] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.186952] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.191048] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.194906] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.199081] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.202906] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.207078] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.210906] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.215078] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.218906] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.223079] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.226906] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.231080] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.234906] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.239079] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.242906] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.247077] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.250907] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.255032] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.259106] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.263035] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.267056] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.270902] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.275126] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.279179] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.282909] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.286899] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.290899] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.294898] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.298899] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.302899] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.306927] pci 0000:00:11.4: PME# supported from D3hot [ 2.311040] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.314913] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.318963] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.323034] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.326913] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.330964] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.335031] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.338913] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.342964] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.347049] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.350910] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.354992] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.359041] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.362977] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.367048] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.370980] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.375047] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.378979] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.383056] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.386910] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.390992] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.395043] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.399160] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.402907] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.406897] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.410897] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.414897] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.418897] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.422898] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.426921] pci 0000:00:1f.2: PME# supported from D3hot [ 2.431029] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.434913] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.438919] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.443098] acpiphp: Slot [1] registered [ 2.446904] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.451062] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.454908] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.458929] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.462890] pci 0000:02:00.0: enabling Extended Tags [ 2.466991] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.470889] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.475063] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.478909] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.482896] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.486910] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.490897] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.494928] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.498908] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.502888] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.506900] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.510887] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.515049] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.518909] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.522896] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.526910] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.530896] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.534928] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.538904] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.542887] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.546900] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.550888] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.555021] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.558888] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.562888] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.566889] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.570918] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.574953] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.578975] pci 0000:05:00.0: enabling Extended Tags [ 2.582964] pci 0000:05:00.0: supports D1 D2 [ 2.586887] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.590991] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.594889] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.598889] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.602935] pci_bus 0000:06: extended config space not accessible [ 2.606916] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.610920] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.614904] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.618904] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.622971] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.626929] pci 0000:06:00.0: supports D1 D2 [ 2.630887] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.634997] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.638893] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.642890] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.646984] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.650914] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.654915] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.658901] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.663022] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.666925] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.670888] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.674913] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.678887] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.683062] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.686914] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.690915] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.694902] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.699017] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.702924] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.706887] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.710913] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.714887] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.719042] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.722889] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.726889] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.730891] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.735776] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.738936] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.742934] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.746933] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.750934] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.754887] ACPI: PCI: Interrupt link LNKE disabled [ 2.758935] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.762887] ACPI: PCI: Interrupt link LNKF disabled [ 2.766933] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.770887] ACPI: PCI: Interrupt link LNKG disabled [ 2.774933] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.778887] ACPI: PCI: Interrupt link LNKH disabled [ 2.783072] iommu: Default domain type: Translated [ 2.786888] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.791015] SCSI subsystem initialized [ 2.794899] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.798886] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.798888] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.802887] vgaarb: loaded [ 2.805666] ACPI: bus type USB registered [ 2.806897] usbcore: registered new interface driver usbfs [ 2.810892] usbcore: registered new interface driver hub [ 2.814891] usbcore: registered new device driver usb [ 2.818905] pps_core: LinuxPPS API ver. 1 registered [ 2.822887] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.826890] PTP clock support registered [ 2.830902] EDAC MC: Ver: 3.0.0 [ 2.834198] NetLabel: Initializing [ 2.834888] NetLabel: domain hash size = 128 [ 2.838887] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.842898] NetLabel: unlabeled traffic allowed by default [ 2.846896] PCI: Using ACPI for IRQ routing [ 2.856124] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.858888] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.864927] clocksource: Switched to clocksource tsc-early [ 2.877106] VFS: Disk quotas dquot_6.6.0 [ 2.881108] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.888152] AppArmor: AppArmor Filesystem Enabled [ 2.892950] pnp: PnP ACPI init [ 2.896517] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.902509] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.908499] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.914486] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.920468] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.926455] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.932438] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.939121] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.945804] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.952487] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.959170] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.965854] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.972537] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.979421] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.985407] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.991394] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.997375] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.003357] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.010274] pnp: PnP ACPI: found 5 devices [ 3.019829] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.028826] NET: Registered PF_INET protocol family [ 3.033939] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.043229] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.052050] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.060040] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.068448] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.075979] TCP: Hash tables configured (established 262144 bind 65536) [ 3.082806] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.090587] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.097604] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.105059] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.110788] NET: Registered PF_XDP protocol family [ 3.115666] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.127241] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.135154] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.140198] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.145233] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.152100] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.159753] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.167754] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.175493] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.183581] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.191231] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.199235] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.206974] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.215061] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.222715] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.230716] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.238455] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.246543] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.254196] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.262196] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.269935] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.278022] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.283052] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.289212] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.296069] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.303903] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.308951] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.313980] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.320143] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.327010] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.332304] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.338464] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.345330] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.353157] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.361073] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.368907] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.376822] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.381847] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.388010] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.394863] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.410358] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.416607] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.422855] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.429792] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.436733] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.443678] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.450619] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.456954] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.462588] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.468918] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.476226] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.481863] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.488192] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.493826] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.500157] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.505796] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.512125] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.519648] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.547524] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 20094 usecs [ 3.575520] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 20013 usecs [ 3.583023] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.589577] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.589586] Trying to unpack rootfs image as initramfs... [ 3.596082] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.610035] Initialise system trusted keyrings [ 3.614561] Key type blacklist registered [ 3.618690] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.626151] zbud: loaded [ 3.628953] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.634996] fuse: init (API version 7.34) [ 3.639232] integrity: Platform Keyring initialized [ 3.652033] Key type asymmetric registered [ 3.656204] Asymmetric key parser 'x509' registered [ 3.661174] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.668714] io scheduler mq-deadline registered [ 3.673805] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.679849] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.685866] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.691838] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.697809] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.703765] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.709726] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.716639] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.722396] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.730867] ACPI: button: Power Button [PWRB] [ 3.735325] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.742838] ACPI: button: Power Button [PWRF] [ 3.748414] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.755991] pstore: Registered erst as persistent store backend [ 3.762111] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.789049] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.817946] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.827539] Linux agpgart interface v0.103 [ 3.833465] loop: module loaded [ 3.836902] tun: Universal TUN/TAP device driver, 1.6 [ 3.842042] PPP generic driver version 2.4.2 [ 3.846426] VFIO - User Level meta-driver version: 0.3 [ 3.851745] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.858346] ehci-pci: EHCI PCI platform driver [ 3.863013] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.868314] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.875807] ehci-pci 0000:00:1a.0: debug port 2 [ 3.884324] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.903409] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.909275] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.917628] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.924940] usb usb1: Product: EHCI Host Controller [ 3.929884] usb usb1: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 3.936401] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.936963] Freeing initrd memory: 65112K [ 3.941218] hub 1-0:1.0: USB hub found [ 3.948984] hub 1-0:1.0: 2 ports detected [ 3.953305] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.958603] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.966092] ehci-pci 0000:00:1d.0: debug port 2 [ 3.974592] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.995478] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.001327] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.009675] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.016980] usb usb2: Product: EHCI Host Controller [ 4.021921] usb usb2: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 4.028425] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.033205] hub 2-0:1.0: USB hub found [ 4.037023] hub 2-0:1.0: 2 ports detected [ 4.041210] ehci-platform: EHCI generic platform driver [ 4.046511] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.052759] ohci-pci: OHCI PCI platform driver [ 4.057287] ohci-platform: OHCI generic platform driver [ 4.062579] uhci_hcd: USB Universal Host Controller Interface driver [ 4.069050] i8042: PNP: No PS/2 controller found. [ 4.073879] mousedev: PS/2 mouse device common for all mice [ 4.079595] rtc_cmos 00:00: RTC can wake from S4 [ 4.084500] rtc_cmos 00:00: registered as rtc0 [ 4.089041] rtc_cmos 00:00: setting system clock to 2024-09-20T21:04:52 UTC (1726866292) [ 4.097235] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.104012] i2c_dev: i2c /dev entries driver [ 4.108514] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.120789] device-mapper: uevent: version 1.0.3 [ 4.125540] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.134083] platform eisa.0: Probing EISA bus 0 [ 4.138676] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.145528] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.152035] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.158538] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.165046] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.171548] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.178056] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.184559] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.191068] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.197577] platform eisa.0: EISA: Detected 0 cards [ 4.202528] intel_pstate: Intel P-state driver initializing [ 4.209097] ledtrig-cpu: registered to indicate activity on CPUs [ 4.215322] drop_monitor: Initializing network drop monitor service [ 4.221763] NET: Registered PF_INET6 protocol family [ 4.233759] Segment Routing with IPv6 [ 4.237494] In-situ OAM (IOAM) with IPv6 [ 4.241494] NET: Registered PF_PACKET protocol family [ 4.246654] Key type dns_resolver registered [ 4.251544] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.257524] microcode: Microcode Update Driver: v2.2. [ 4.257601] resctrl: L3 allocation detected [ 4.266964] resctrl: L3 monitoring detected [ 4.271216] IPI shorthand broadcast: enabled [ 4.275558] sched_clock: Marking stable (3212171165, 1063375259)->(5263127526, -987581102) [ 4.284126] registered taskstats version 1 [ 4.288463] Loading compiled-in X.509 certificates [ 4.291411] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.293901] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.310403] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.320646] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.330729] blacklist: Loading compiled-in revocation X.509 certificates [ 4.337538] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.347472] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.358015] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.368894] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.379441] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.379440] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.390230] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.407616] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.418422] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.430207] zswap: loaded using pool lzo/zbud [ 4.434872] Key type .fscrypt registered [ 4.438864] Key type fscrypt-provisioning registered [ 4.443985] pstore: Using crash dump compression: deflate [ 4.452151] Key type encrypted registered [ 4.456227] AppArmor: AppArmor sha1 policy hashing enabled [ 4.459779] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.461795] ima: No TPM chip found, activating TPM-bypass! [ 4.477736] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.483297] Loading compiled-in module X.509 certificates [ 4.490927] hub 1-1:1.0: USB hub found [ 4.496458] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.503199] hub 1-1:1.0: 6 ports detected [ 4.509839] ima: Allocated hash algorithm: sha1 [ 4.509860] ima: No architecture policies found [ 4.523154] evm: Initialising EVM extended attributes: [ 4.528361] evm: security.selinux [ 4.531751] evm: security.SMACK64 [ 4.535130] evm: security.SMACK64EXEC [ 4.538852] evm: security.SMACK64TRANSMUTE [ 4.543013] evm: security.SMACK64MMAP [ 4.546740] evm: security.apparmor [ 4.550208] evm: security.ima [ 4.553239] evm: security.capability [ 4.556882] evm: HMAC attrs: 0x1 [ 4.560485] PM: Magic number: 8:264:96 [ 4.564619] memory memory249: hash matches [ 4.569010] RAS: Correctable Errors collector initialized. [ 4.574571] clk: Disabling unused clocks [ 4.579490] Freeing unused decrypted memory: 2036K [ 4.579788] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.592617] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.600063] hub 2-1:1.0: USB hub found [ 4.600222] Freeing unused kernel image (initmem) memory: 3368K [ 4.604043] hub 2-1:1.0: 8 ports detected [ 4.613954] Write protecting the kernel read-only data: 30720k [ 4.619861] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.619865] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.636224] clocksource: Switched to clocksource tsc [ 4.641628] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.648546] Freeing unused kernel image (rodata/data gap) memory: 1324K [ 4.694062] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.700566] x86/mm: Checking user space page tables [ 4.743051] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.749563] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.899141] dca service started, version 1.12.1 [ 4.907456] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.907462] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 4.911884] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.911888] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.912898] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.920459] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 4.936578] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.942035] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 4.948033] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.963804] scsi host0: ahci [ 4.966286] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.971935] scsi host1: ahci [ 4.974523] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.982123] scsi host2: ahci [ 4.984982] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.991394] scsi host3: ahci [ 4.994225] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.002638] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.005510] usb usb3: Product: xHCI Host Controller [ 5.005511] usb usb3: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 5.012819] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.020299] usb usb3: SerialNumber: 0000:00:14.0 [ 5.025241] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.031868] hub 3-0:1.0: USB hub found [ 5.039235] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.043945] hub 3-0:1.0: 15 ports detected [ 5.051688] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.058569] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.062696] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.066852] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.098418] usb usb4: Product: xHCI Host Controller [ 5.103356] usb usb4: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 5.109859] usb usb4: SerialNumber: 0000:00:14.0 [ 5.114654] hub 4-0:1.0: USB hub found [ 5.114740] nvme nvme0: pci function 0000:02:00.0 [ 5.114890] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.114892] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.118489] hub 4-0:1.0: 6 ports detected [ 5.118606] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.118608] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.143731] scsi host4: ahci [ 5.145205] nvme nvme0: 8/0/0 default/read/poll queues [ 5.151284] scsi host5: ahci [ 5.161681] scsi host6: ahci [ 5.164761] scsi host7: ahci [ 5.167861] scsi host8: ahci [ 5.170935] scsi host9: ahci [ 5.172561] igb 0000:07:00.0: added PHC on eth0 [ 5.173934] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 35 [ 5.178516] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.185976] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 35 [ 5.192925] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:36:7c [ 5.200423] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 35 [ 5.207698] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.215104] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 35 [ 5.220315] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.227812] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 35 [ 5.227814] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 35 [ 5.291894] igb 0000:07:00.1: added PHC on eth1 [ 5.296506] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.303446] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:36:7d [ 5.310727] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.315929] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.366519] ata2: SATA link down (SStatus 0 SControl 300) [ 5.372026] ata4: SATA link down (SStatus 0 SControl 300) [ 5.377537] ata3: SATA link down (SStatus 0 SControl 300) [ 5.383032] ata1: SATA link down (SStatus 0 SControl 300) [ 5.395465] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.555699] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.564074] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.564097] ata7: SATA link down (SStatus 0 SControl 300) [ 5.571871] hub 3-12:1.0: USB hub found [ 5.576907] ata6: SATA link down (SStatus 0 SControl 300) [ 5.580872] hub 3-12:1.0: 4 ports detected [ 5.586297] ata10: SATA link down (SStatus 0 SControl 300) [ 5.596001] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.602275] ata8: SATA link down (SStatus 0 SControl 300) [ 5.607775] ata9: SATA link down (SStatus 0 SControl 300) [ 5.613465] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.620417] ata5.00: NCQ Send/Recv Log not supported [ 5.625469] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.633998] ata5.00: NCQ Send/Recv Log not supported [ 5.639047] ata5.00: configured for UDMA/133 [ 5.643536] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.652078] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.652218] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.665236] sd 4:0:0:0: [sda] Write Protect is off [ 5.670108] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.698569] sda: sda1 [ 5.701123] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.708922] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.731727] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.899453] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.031810] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.040364] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.060179] hid: raw HID events driver (C) Jiri Kosina [ 6.070351] usbcore: registered new interface driver usbhid [ 6.076007] usbhid: USB HID core driver [ 6.081919] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.151627] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.163637] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.175548] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.295847] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.306223] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.314829] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.321077] ixgbe 0000:03:00.0: 0c:c4:7a:88:72:50 [ 6.328885] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.499730] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.510104] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.518708] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.525826] ixgbe 0000:03:00.1: 0c:c4:7a:88:72:51 [ 6.533597] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.541721] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.568472] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 199164/61054976 files, 6689705/244190336 blocks done. [ 13.720557] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.582287] systemd[1]: Inserted module 'autofs4' [ 14.687953] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.735549] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.784176] systemd[1]: Hostname set to . [ 16.093425] systemd[1]: Queued start job for default target Graphical Interface. [ 16.102164] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.124066] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.148131] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.171596] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.191642] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.215859] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.243575] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.271530] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.299522] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.327545] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.355519] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.383534] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.411617] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.435553] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.455551] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.479653] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.503775] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.529576] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.551820] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.571744] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.595640] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.619954] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.639743] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.659793] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.679885] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.703815] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.723719] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.745212] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.765207] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.788947] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.813179] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.833294] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 16.855229] systemd[1]: Starting Journal Service... [ 16.857840] RPC: Registered named UNIX socket transport module. [ 16.866185] RPC: Registered udp transport module. [ 16.866186] RPC: Registered tcp transport module. [ 16.866186] RPC: Registered tcp NFSv4.1 backchannel transport module. Starting Journal Service... [ 16.895644] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.906983] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 16.929583] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 16.952162] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 16.980574] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.008206] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.028187] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 17.048373] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.072111] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.092352] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.116323] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.140382] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.159485] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.169234] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.179593] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.200173] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.224185] systemd[1]: Starting Coldplug All udev Devices... [ 17.227578] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. Starting Coldplug All udev Devices... [ 17.253124] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ 17.266904] lp: driver loaded but no devices found [ OK ] Mounted Huge Pages File System. [ 17.284301] Loading iSCSI transport class v2.0-870. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 17.593991] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... Startin[ 17.669389] systemd-journald[366]: Received client request to flush runtime journal. g Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ 17.863914] systemd-journald[366]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Create System Users. [ OK ] Finished Apply Kernel Variables. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. Starting Create Volatile Files and Directories... [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Started RPC bind portmap service. [ OK ] Found device /dev/ttyS1. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. Starting LVM event activation on device 259:0... [ OK ] Started Network Configuration. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started ifup for enp3s0f1. [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Started User Login Management. [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started ntp-systemd-netif.service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -v '127.0.0.1\|127.0.1.1' ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' Starting NFS status monitor for NFSv2/3 locking.... + myips=172.21.15.161 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Started Network Time Service. [ OK ] Finished Permit User Sessions. [ OK ] Finished Ubuntu FAN network setup. + '[' 172.21.15.161 '!=' '' ']' + set -e + '[' -n 172.21.15.161 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.161 -nq -c1 172.21.0.1 [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... ++ dig +short -x 172.21.15.161 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started Notify NFS peers of a restart. [ OK ] Started LSB: radosgw RESTful rados gateway. + newhostname=smithi161.front.sepia.ceph.com + '[' -n smithi161.front.sepia.ceph.com ']' + hostname smithi161.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi161 + echo smithi161 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.161 smithi161.front.sepia.ceph.com smithi161/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK [ Starting Set console scheme... [ OK ] Started (i)SCSI target daemon. [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started The Apache HTTP Server. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. Ubuntu 22.04.1 LTS smithi161.front.sepia.ceph.com ttyS1 2024-09-20T21:05:17.206 DEBUG:teuthology.orchestra.console.smithi161:expect after: smithi161 login: 2024-09-20T21:05:17.258 DEBUG:teuthology.orchestra.console.smithi161:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 72 51 GUID: 00000000 0000 0000 0000 0CC47AD9367C DHCP.\                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ CLIENT IP: 172.21.15.161 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:72:51)... Configuring (net0 0c:c4:7a:88:72:51).... Configuring (net0 0c:c4:7a:88:72:51)..... Configuring (net0 0c:c4:7a:88:72:51)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-122-generic ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-122-generic (buildd@lcy02-amd64-034) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 (Ubuntu 5.15.0-122.132-generic 5.15.163) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.674 MHz processor [ 0.000427] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000608] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001907] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008295] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008310] Using GB pages for direct mapping [ 0.008475] RAMDISK: [mem 0x300c3000-0x34058fff] [ 0.008480] ACPI: Early table checksum verification disabled [ 0.008483] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008487] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008492] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008498] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008501] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008503] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008506] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008509] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008512] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008515] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008518] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008521] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008523] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008526] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008529] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008532] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008535] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008538] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008541] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008544] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008546] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008549] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008552] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008555] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008556] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008557] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008558] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008559] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008560] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008561] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008562] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008563] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008564] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008565] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008566] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008567] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008568] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008569] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008570] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008571] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008572] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008573] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008574] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008575] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008670] No NUMA configuration found [ 0.008671] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008680] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.009013] Zone ranges: [ 0.009014] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.009016] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.009018] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.009020] Device empty [ 0.009021] Movable zone start for each node [ 0.009024] Early memory node ranges [ 0.009024] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.009026] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.009027] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.009032] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.009036] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009072] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080729] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080844] ACPI: PM-Timer IO Port: 0x408 [ 0.080852] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080854] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080855] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080856] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080857] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080857] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080858] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080859] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080868] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080873] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080875] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080877] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080880] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080882] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080885] TSC deadline timer available [ 0.080887] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080897] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080899] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080900] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080902] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080903] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080904] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080905] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080906] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080907] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080908] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080909] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080911] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080912] Booting paravirtualized kernel on bare hardware [ 0.080915] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080922] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.081137] percpu: Embedded 62 pages/cpu s217088 r8192 d28672 u262144 [ 0.081168] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.081170] Policy zone: Normal [ 0.081172] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.081231] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic", will be passed to user space. [ 0.083387] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084532] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084626] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.171172] Memory: 32672656K/33438012K available (16392K kernel code, 4397K rwdata, 10964K rodata, 3368K init, 18700K bss, 765096K reserved, 0K cma-reserved) [ 0.171454] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.171469] Kernel/User page tables isolation: enabled [ 0.171501] ftrace: allocating 50768 entries in 199 pages [ 0.191725] ftrace: allocated 199 pages with 5 groups [ 0.191851] rcu: Hierarchical RCU implementation. [ 0.191853] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.191854] Rude variant of Tasks RCU enabled. [ 0.191855] Tracing variant of Tasks RCU enabled. [ 0.191856] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.191857] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.195319] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.195517] random: crng init done [ 0.200380] Console: colour VGA+ 80x25 [ 0.211611] printk: console [tty0] enabled [ 1.198634] printk: console [ttyS1] enabled [ 1.202893] ACPI: Core revision 20210730 [ 1.207053] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.216274] APIC: Switch to symmetric I/O mode setup [ 1.221312] DMAR: Host address width 46 [ 1.225216] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.231695] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.239785] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.246125] DMAR: ATSR flags: 0x0 [ 1.249510] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.255850] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.262274] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.268697] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.274164] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.274165] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.289350] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.294727] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.301008] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.324284] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32721cabb57, max_idle_ns: 440795215156 ns [ 1.334889] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.34 BogoMIPS (lpj=13998696) [ 1.338905] CPU0: Thermal monitoring enabled (TM1) [ 1.342940] process: using mwait in idle threads [ 1.346888] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.350887] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.354889] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.358888] Spectre V2 : Mitigation: Retpolines [ 1.362887] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.366887] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.370887] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.374888] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.378887] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.382887] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.386890] MDS: Mitigation: Clear CPU buffers [ 1.390887] TAA: Mitigation: Clear CPU buffers [ 1.394887] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.398892] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.402887] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.406887] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.410887] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.414887] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.436923] Freeing SMP alternatives memory: 44K [ 1.438888] pid_max: default: 32768 minimum: 301 [ 1.442908] LSM: Security Framework initializing [ 1.446895] landlock: Up and running. [ 1.450619] Yama: becoming mindful. [ 1.450904] AppArmor: AppArmor initialized [ 1.454947] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.458927] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.463246] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.466892] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.470995] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.474888] ... version: 3 [ 1.478887] ... bit width: 48 [ 1.482887] ... generic registers: 4 [ 1.486887] ... value mask: 0000ffffffffffff [ 1.490887] ... max period: 00007fffffffffff [ 1.494887] ... fixed-purpose events: 3 [ 1.498887] ... event mask: 000000070000000f [ 1.502948] signal: max sigframe size: 1776 [ 1.506902] rcu: Hierarchical SRCU implementation. [ 1.511610] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.514952] smp: Bringing up secondary CPUs ... [ 1.518969] x86: Booting SMP configuration: [ 1.522890] .... node #0, CPUs: #1 #2 #3 #4 [ 1.531053] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.538887] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.542887] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.546987] #5 #6 #7 [ 1.547543] smp: Brought up 1 node, 8 CPUs [ 1.554890] smpboot: Max logical packages: 1 [ 1.558887] smpboot: Total of 8 processors activated (55994.78 BogoMIPS) [ 1.567203] devtmpfs: initialized [ 1.570305] x86/mm: Memory block size: 128MB [ 1.572478] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.574963] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.578897] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.582933] pinctrl core: initialized pinctrl subsystem [ 1.586978] PM: RTC time: 21:04:49, date: 2024-09-20 [ 1.590992] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.595219] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.599187] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.603219] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.606897] audit: initializing netlink subsys (disabled) [ 1.610907] audit: type=2000 audit(1726866288.352:1): state=initialized audit_enabled=0 res=1 [ 1.611003] thermal_sys: Registered thermal governor 'fair_share' [ 1.614889] thermal_sys: Registered thermal governor 'bang_bang' [ 1.618887] thermal_sys: Registered thermal governor 'step_wise' [ 1.622887] thermal_sys: Registered thermal governor 'user_space' [ 1.626887] thermal_sys: Registered thermal governor 'power_allocator' [ 1.630893] EISA bus registered [ 1.638095] cpuidle: using governor ladder [ 1.638889] cpuidle: using governor menu [ 1.642903] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.646888] ACPI: bus type PCI registered [ 1.650888] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.654941] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.658889] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.662900] PCI: Using configuration type 1 for base access [ 1.667906] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.670904] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.674888] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.678961] ACPI: Added _OSI(Module Device) [ 1.682889] ACPI: Added _OSI(Processor Device) [ 1.686895] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.690887] ACPI: Added _OSI(Processor Aggregator Device) [ 1.694887] ACPI: Added _OSI(Linux-Dell-Video) [ 1.698887] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.702887] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.751997] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.758366] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.763033] ACPI: Dynamic OEM Table Load: [ 1.792654] ACPI: Interpreter enabled [ 1.794899] ACPI: PM: (supports S0 S4 S5) [ 1.798888] ACPI: Using IOAPIC for interrupt routing [ 1.802909] HEST: Enabling Firmware First mode for corrected errors. [ 1.806966] HEST: Table parsing has been initialized. [ 1.811036] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.814889] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.818887] PCI: Using E820 reservations for host bridge windows [ 1.823571] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.858180] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.858890] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.864863] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.871883] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.874888] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.878919] PCI host bridge to bus 0000:ff [ 1.882888] pci_bus 0000:ff: root bus resource [bus ff] [ 1.886897] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.890952] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.894940] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.898942] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.902940] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.906939] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.910938] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.914939] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.918943] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.922939] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.926938] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.930939] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.934938] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.938940] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.942941] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.946939] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.950941] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.954938] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.958939] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.962912] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.966950] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.970989] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.974952] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.978951] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.982954] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.986952] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.990951] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.994941] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.998942] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.002952] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.006952] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.010953] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.014953] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.018941] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.022941] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.026940] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.030942] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.034951] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.038951] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.042953] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.046955] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.050945] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.054942] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.058941] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.062944] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.066940] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.070941] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.074944] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.078946] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.082939] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.086939] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.090940] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.094913] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.098941] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.102940] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.110942] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.114890] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.119210] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.123335] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.126887] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.131175] PCI host bridge to bus 0000:00 [ 2.134889] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.138887] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.142887] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.146887] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.150887] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.154887] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.158887] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.162993] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.167096] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.170953] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.175058] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.178952] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.183050] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.186952] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.191048] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.194906] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.199081] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.202906] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.207078] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.210906] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.215078] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.218906] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.223079] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.226906] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.231080] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.234906] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.239079] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.242906] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.247077] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.250907] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.255032] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.259106] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.263035] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.267056] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.270902] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.275126] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.279179] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.282909] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.286899] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.290899] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.294898] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.298899] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.302899] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.306927] pci 0000:00:11.4: PME# supported from D3hot [ 2.311040] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.314913] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.318963] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.323034] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.326913] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.330964] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.335031] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.338913] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.342964] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.347049] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.350910] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.354992] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.359041] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.362977] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.367048] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.370980] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.375047] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.378979] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.383056] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.386910] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.390992] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.395043] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.399160] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.402907] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.406897] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.410897] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.414897] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.418897] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.422898] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.426921] pci 0000:00:1f.2: PME# supported from D3hot [ 2.431029] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.434913] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.438919] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.443098] acpiphp: Slot [1] registered [ 2.446904] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.451062] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.454908] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.458929] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.462890] pci 0000:02:00.0: enabling Extended Tags [ 2.466991] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.470889] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.475063] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.478909] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.482896] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.486910] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.490897] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.494928] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.498908] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.502888] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.506900] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.510887] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.515049] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.518909] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.522896] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.526910] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.530896] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.534928] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.538904] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.542887] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.546900] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.550888] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.555021] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.558888] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.562888] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.566889] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.570918] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.574953] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.578975] pci 0000:05:00.0: enabling Extended Tags [ 2.582964] pci 0000:05:00.0: supports D1 D2 [ 2.586887] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.590991] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.594889] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.598889] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.602935] pci_bus 0000:06: extended config space not accessible [ 2.606916] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.610920] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.614904] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.618904] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.622971] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.626929] pci 0000:06:00.0: supports D1 D2 [ 2.630887] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.634997] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.638893] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.642890] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.646984] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.650914] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.654915] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.658901] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.663022] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.666925] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.670888] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.674913] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.678887] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.683062] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.686914] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.690915] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.694902] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.699017] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.702924] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.706887] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.710913] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.714887] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.719042] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.722889] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.726889] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.730891] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.735776] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.738936] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.742934] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.746933] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.750934] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.754887] ACPI: PCI: Interrupt link LNKE disabled [ 2.758935] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.762887] ACPI: PCI: Interrupt link LNKF disabled [ 2.766933] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.770887] ACPI: PCI: Interrupt link LNKG disabled [ 2.774933] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.778887] ACPI: PCI: Interrupt link LNKH disabled [ 2.783072] iommu: Default domain type: Translated [ 2.786888] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.791015] SCSI subsystem initialized [ 2.794899] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.798886] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.798888] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.802887] vgaarb: loaded [ 2.805666] ACPI: bus type USB registered [ 2.806897] usbcore: registered new interface driver usbfs [ 2.810892] usbcore: registered new interface driver hub [ 2.814891] usbcore: registered new device driver usb [ 2.818905] pps_core: LinuxPPS API ver. 1 registered [ 2.822887] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.826890] PTP clock support registered [ 2.830902] EDAC MC: Ver: 3.0.0 [ 2.834198] NetLabel: Initializing [ 2.834888] NetLabel: domain hash size = 128 [ 2.838887] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.842898] NetLabel: unlabeled traffic allowed by default [ 2.846896] PCI: Using ACPI for IRQ routing [ 2.856124] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.858888] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.864927] clocksource: Switched to clocksource tsc-early [ 2.877106] VFS: Disk quotas dquot_6.6.0 [ 2.881108] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.888152] AppArmor: AppArmor Filesystem Enabled [ 2.892950] pnp: PnP ACPI init [ 2.896517] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.902509] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.908499] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.914486] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.920468] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.926455] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.932438] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.939121] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.945804] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.952487] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.959170] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.965854] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.972537] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.979421] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.985407] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.991394] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.997375] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.003357] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.010274] pnp: PnP ACPI: found 5 devices [ 3.019829] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.028826] NET: Registered PF_INET protocol family [ 3.033939] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.043229] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.052050] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.060040] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.068448] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.075979] TCP: Hash tables configured (established 262144 bind 65536) [ 3.082806] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.090587] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.097604] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.105059] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.110788] NET: Registered PF_XDP protocol family [ 3.115666] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.127241] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.135154] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.140198] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.145233] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.152100] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.159753] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.167754] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.175493] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.183581] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.191231] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.199235] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.206974] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.215061] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.222715] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.230716] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.238455] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.246543] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.254196] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.262196] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.269935] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.278022] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.283052] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.289212] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.296069] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.303903] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.308951] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.313980] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.320143] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.327010] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.332304] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.338464] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.345330] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.353157] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.361073] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.368907] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.376822] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.381847] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.388010] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.394863] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.410358] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.416607] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.422855] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.429792] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.436733] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.443678] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.450619] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.456954] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.462588] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.468918] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.476226] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.481863] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.488192] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.493826] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.500157] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.505796] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.512125] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.519648] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.547524] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 20094 usecs [ 3.575520] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 20013 usecs [ 3.583023] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.589577] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.589586] Trying to unpack rootfs image as initramfs... [ 3.596082] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.610035] Initialise system trusted keyrings [ 3.614561] Key type blacklist registered [ 3.618690] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.626151] zbud: loaded [ 3.628953] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.634996] fuse: init (API version 7.34) [ 3.639232] integrity: Platform Keyring initialized [ 3.652033] Key type asymmetric registered [ 3.656204] Asymmetric key parser 'x509' registered [ 3.661174] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.668714] io scheduler mq-deadline registered [ 3.673805] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.679849] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.685866] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.691838] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.697809] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.703765] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.709726] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.716639] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.722396] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.730867] ACPI: button: Power Button [PWRB] [ 3.735325] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.742838] ACPI: button: Power Button [PWRF] [ 3.748414] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.755991] pstore: Registered erst as persistent store backend [ 3.762111] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.789049] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.817946] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.827539] Linux agpgart interface v0.103 [ 3.833465] loop: module loaded [ 3.836902] tun: Universal TUN/TAP device driver, 1.6 [ 3.842042] PPP generic driver version 2.4.2 [ 3.846426] VFIO - User Level meta-driver version: 0.3 [ 3.851745] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.858346] ehci-pci: EHCI PCI platform driver [ 3.863013] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.868314] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.875807] ehci-pci 0000:00:1a.0: debug port 2 [ 3.884324] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.903409] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.909275] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.917628] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.924940] usb usb1: Product: EHCI Host Controller [ 3.929884] usb usb1: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 3.936401] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.936963] Freeing initrd memory: 65112K [ 3.941218] hub 1-0:1.0: USB hub found [ 3.948984] hub 1-0:1.0: 2 ports detected [ 3.953305] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.958603] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.966092] ehci-pci 0000:00:1d.0: debug port 2 [ 3.974592] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.995478] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.001327] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.009675] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.016980] usb usb2: Product: EHCI Host Controller [ 4.021921] usb usb2: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 4.028425] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.033205] hub 2-0:1.0: USB hub found [ 4.037023] hub 2-0:1.0: 2 ports detected [ 4.041210] ehci-platform: EHCI generic platform driver [ 4.046511] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.052759] ohci-pci: OHCI PCI platform driver [ 4.057287] ohci-platform: OHCI generic platform driver [ 4.062579] uhci_hcd: USB Universal Host Controller Interface driver [ 4.069050] i8042: PNP: No PS/2 controller found. [ 4.073879] mousedev: PS/2 mouse device common for all mice [ 4.079595] rtc_cmos 00:00: RTC can wake from S4 [ 4.084500] rtc_cmos 00:00: registered as rtc0 [ 4.089041] rtc_cmos 00:00: setting system clock to 2024-09-20T21:04:52 UTC (1726866292) [ 4.097235] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.104012] i2c_dev: i2c /dev entries driver [ 4.108514] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.120789] device-mapper: uevent: version 1.0.3 [ 4.125540] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.134083] platform eisa.0: Probing EISA bus 0 [ 4.138676] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.145528] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.152035] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.158538] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.165046] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.171548] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.178056] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.184559] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.191068] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.197577] platform eisa.0: EISA: Detected 0 cards [ 4.202528] intel_pstate: Intel P-state driver initializing [ 4.209097] ledtrig-cpu: registered to indicate activity on CPUs [ 4.215322] drop_monitor: Initializing network drop monitor service [ 4.221763] NET: Registered PF_INET6 protocol family [ 4.233759] Segment Routing with IPv6 [ 4.237494] In-situ OAM (IOAM) with IPv6 [ 4.241494] NET: Registered PF_PACKET protocol family [ 4.246654] Key type dns_resolver registered [ 4.251544] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.257524] microcode: Microcode Update Driver: v2.2. [ 4.257601] resctrl: L3 allocation detected [ 4.266964] resctrl: L3 monitoring detected [ 4.271216] IPI shorthand broadcast: enabled [ 4.275558] sched_clock: Marking stable (3212171165, 1063375259)->(5263127526, -987581102) [ 4.284126] registered taskstats version 1 [ 4.288463] Loading compiled-in X.509 certificates [ 4.291411] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.293901] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.310403] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.320646] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.330729] blacklist: Loading compiled-in revocation X.509 certificates [ 4.337538] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.347472] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.358015] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.368894] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.379441] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.379440] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.390230] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.407616] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.418422] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.430207] zswap: loaded using pool lzo/zbud [ 4.434872] Key type .fscrypt registered [ 4.438864] Key type fscrypt-provisioning registered [ 4.443985] pstore: Using crash dump compression: deflate [ 4.452151] Key type encrypted registered [ 4.456227] AppArmor: AppArmor sha1 policy hashing enabled [ 4.459779] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.461795] ima: No TPM chip found, activating TPM-bypass! [ 4.477736] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.483297] Loading compiled-in module X.509 certificates [ 4.490927] hub 1-1:1.0: USB hub found [ 4.496458] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.503199] hub 1-1:1.0: 6 ports detected [ 4.509839] ima: Allocated hash algorithm: sha1 [ 4.509860] ima: No architecture policies found [ 4.523154] evm: Initialising EVM extended attributes: [ 4.528361] evm: security.selinux [ 4.531751] evm: security.SMACK64 [ 4.535130] evm: security.SMACK64EXEC [ 4.538852] evm: security.SMACK64TRANSMUTE [ 4.543013] evm: security.SMACK64MMAP [ 4.546740] evm: security.apparmor [ 4.550208] evm: security.ima [ 4.553239] evm: security.capability [ 4.556882] evm: HMAC attrs: 0x1 [ 4.560485] PM: Magic number: 8:264:96 [ 4.564619] memory memory249: hash matches [ 4.569010] RAS: Correctable Errors collector initialized. [ 4.574571] clk: Disabling unused clocks [ 4.579490] Freeing unused decrypted memory: 2036K [ 4.579788] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.592617] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.600063] hub 2-1:1.0: USB hub found [ 4.600222] Freeing unused kernel image (initmem) memory: 3368K [ 4.604043] hub 2-1:1.0: 8 ports detected [ 4.613954] Write protecting the kernel read-only data: 30720k [ 4.619861] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.619865] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.636224] clocksource: Switched to clocksource tsc [ 4.641628] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.648546] Freeing unused kernel image (rodata/data gap) memory: 1324K [ 4.694062] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.700566] x86/mm: Checking user space page tables [ 4.743051] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.749563] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.899141] dca service started, version 1.12.1 [ 4.907456] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.907462] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 4.911884] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.911888] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.912898] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.920459] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 4.936578] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.942035] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 4.948033] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.963804] scsi host0: ahci [ 4.966286] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.971935] scsi host1: ahci [ 4.974523] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.982123] scsi host2: ahci [ 4.984982] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.991394] scsi host3: ahci [ 4.994225] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.002638] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.005510] usb usb3: Product: xHCI Host Controller [ 5.005511] usb usb3: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 5.012819] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.020299] usb usb3: SerialNumber: 0000:00:14.0 [ 5.025241] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.031868] hub 3-0:1.0: USB hub found [ 5.039235] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.043945] hub 3-0:1.0: 15 ports detected [ 5.051688] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.058569] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.062696] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.066852] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.098418] usb usb4: Product: xHCI Host Controller [ 5.103356] usb usb4: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 5.109859] usb usb4: SerialNumber: 0000:00:14.0 [ 5.114654] hub 4-0:1.0: USB hub found [ 5.114740] nvme nvme0: pci function 0000:02:00.0 [ 5.114890] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.114892] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.118489] hub 4-0:1.0: 6 ports detected [ 5.118606] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.118608] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.143731] scsi host4: ahci [ 5.145205] nvme nvme0: 8/0/0 default/read/poll queues [ 5.151284] scsi host5: ahci [ 5.161681] scsi host6: ahci [ 5.164761] scsi host7: ahci [ 5.167861] scsi host8: ahci [ 5.170935] scsi host9: ahci [ 5.172561] igb 0000:07:00.0: added PHC on eth0 [ 5.173934] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 35 [ 5.178516] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.185976] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 35 [ 5.192925] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:36:7c [ 5.200423] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 35 [ 5.207698] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.215104] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 35 [ 5.220315] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.227812] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 35 [ 5.227814] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 35 [ 5.291894] igb 0000:07:00.1: added PHC on eth1 [ 5.296506] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.303446] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:36:7d [ 5.310727] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.315929] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.366519] ata2: SATA link down (SStatus 0 SControl 300) [ 5.372026] ata4: SATA link down (SStatus 0 SControl 300) [ 5.377537] ata3: SATA link down (SStatus 0 SControl 300) [ 5.383032] ata1: SATA link down (SStatus 0 SControl 300) [ 5.395465] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.555699] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.564074] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.564097] ata7: SATA link down (SStatus 0 SControl 300) [ 5.571871] hub 3-12:1.0: USB hub found [ 5.576907] ata6: SATA link down (SStatus 0 SControl 300) [ 5.580872] hub 3-12:1.0: 4 ports detected [ 5.586297] ata10: SATA link down (SStatus 0 SControl 300) [ 5.596001] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.602275] ata8: SATA link down (SStatus 0 SControl 300) [ 5.607775] ata9: SATA link down (SStatus 0 SControl 300) [ 5.613465] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.620417] ata5.00: NCQ Send/Recv Log not supported [ 5.625469] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.633998] ata5.00: NCQ Send/Recv Log not supported [ 5.639047] ata5.00: configured for UDMA/133 [ 5.643536] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.652078] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.652218] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.665236] sd 4:0:0:0: [sda] Write Protect is off [ 5.670108] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.698569] sda: sda1 [ 5.701123] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.708922] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.731727] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.899453] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.031810] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.040364] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.060179] hid: raw HID events driver (C) Jiri Kosina [ 6.070351] usbcore: registered new interface driver usbhid [ 6.076007] usbhid: USB HID core driver [ 6.081919] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.151627] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.163637] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.175548] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.295847] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.306223] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.314829] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.321077] ixgbe 0000:03:00.0: 0c:c4:7a:88:72:50 [ 6.328885] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.499730] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.510104] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.518708] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.525826] ixgbe 0000:03:00.1: 0c:c4:7a:88:72:51 [ 6.533597] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.541721] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.568472] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 199164/61054976 files, 6689705/244190336 blocks done. [ 13.720557] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.582287] systemd[1]: Inserted module 'autofs4' [ 14.687953] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.735549] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.784176] systemd[1]: Hostname set to . [ 16.093425] systemd[1]: Queued start job for default target Graphical Interface. [ 16.102164] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.124066] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.148131] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.171596] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.191642] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.215859] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.243575] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.271530] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.299522] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.327545] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.355519] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.383534] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.411617] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.435553] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.455551] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.479653] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.503775] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.529576] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.551820] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.571744] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.595640] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.619954] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.639743] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.659793] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.679885] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.703815] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.723719] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.745212] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.765207] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.788947] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.813179] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.833294] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 16.855229] systemd[1]: Starting Journal Service... [ 16.857840] RPC: Registered named UNIX socket transport module. [ 16.866185] RPC: Registered udp transport module. [ 16.866186] RPC: Registered tcp transport module. [ 16.866186] RPC: Registered tcp NFSv4.1 backchannel transport module. Starting Journal Service... [ 16.895644] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.906983] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 16.929583] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 16.952162] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 16.980574] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.008206] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.028187] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 17.048373] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.072111] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.092352] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.116323] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.140382] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.159485] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.169234] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.179593] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.200173] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.224185] systemd[1]: Starting Coldplug All udev Devices... [ 17.227578] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. Starting Coldplug All udev Devices... [ 17.253124] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ 17.266904] lp: driver loaded but no devices found [ OK ] Mounted Huge Pages File System. [ 17.284301] Loading iSCSI transport class v2.0-870. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 17.593991] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... Startin[ 17.669389] systemd-journald[366]: Received client request to flush runtime journal. g Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ 17.863914] systemd-journald[366]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Create System Users. [ OK ] Finished Apply Kernel Variables. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. Starting Create Volatile Files and Directories... [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Started RPC bind portmap service. [ OK ] Found device /dev/ttyS1. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. Starting LVM event activation on device 259:0... [ OK ] Started Network Configuration. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started ifup for enp3s0f1. [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Started User Login Management. [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started ntp-systemd-netif.service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -v '127.0.0.1\|127.0.1.1' ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' Starting NFS status monitor for NFSv2/3 locking.... + myips=172.21.15.161 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Started Network Time Service. [ OK ] Finished Permit User Sessions. [ OK ] Finished Ubuntu FAN network setup. + '[' 172.21.15.161 '!=' '' ']' + set -e + '[' -n 172.21.15.161 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.161 -nq -c1 172.21.0.1 [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... ++ dig +short -x 172.21.15.161 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started Notify NFS peers of a restart. [ OK ] Started LSB: radosgw RESTful rados gateway. + newhostname=smithi161.front.sepia.ceph.com + '[' -n smithi161.front.sepia.ceph.com ']' + hostname smithi161.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi161 + echo smithi161 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.161 smithi161.front.sepia.ceph.com smithi161/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK [ Starting Set console scheme... [ OK ] Started (i)SCSI target daemon. [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started The Apache HTTP Server. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. Ubuntu 22.04.1 LTS smithi161.front.sepia.ceph.com ttyS1 smithi161 login: [disconnect] 2024-09-20T21:05:17.360 INFO:teuthology.misc:Re-opening connections... 2024-09-20T21:05:17.360 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2024-09-20T21:05:17.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-20T21:05:17.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:05:17.812 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-20T21:05:18.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-20T21:05:18.845 DEBUG:teuthology.misc:waited 1.4849331378936768 2024-09-20T21:05:19.845 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi161.front.sepia.ceph.com 2024-09-20T21:05:19.846 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi161.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-09-20T21:05:19.846 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-20T21:05:20.002 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2024-09-20T21:05:20.026 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-20T21:05:20.027 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-20T21:05:20.072 INFO:tasks.ceph.osd.1:Started 2024-09-20T21:05:20.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:05:20.185 INFO:teuthology.orchestra.run.smithi161.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-20T21:05:20.187 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T21:05:20.188 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-20T21:05:22.241 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:05:21.507+0000 7fd0300bb7c0 -1 Falling back to public interface 2024-09-20T21:05:22.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-20T21:05:25.189 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:05:25.306 INFO:teuthology.orchestra.run.smithi161.stderr:no valid command found; 10 closest matches: 2024-09-20T21:05:25.306 INFO:teuthology.orchestra.run.smithi161.stderr:0 2024-09-20T21:05:25.306 INFO:teuthology.orchestra.run.smithi161.stderr:1 2024-09-20T21:05:25.306 INFO:teuthology.orchestra.run.smithi161.stderr:2 2024-09-20T21:05:25.306 INFO:teuthology.orchestra.run.smithi161.stderr:abort 2024-09-20T21:05:25.306 INFO:teuthology.orchestra.run.smithi161.stderr:assert 2024-09-20T21:05:25.307 INFO:teuthology.orchestra.run.smithi161.stderr:bluefs debug_inject_read_zeros 2024-09-20T21:05:25.307 INFO:teuthology.orchestra.run.smithi161.stderr:bluefs files list 2024-09-20T21:05:25.307 INFO:teuthology.orchestra.run.smithi161.stderr:bluefs stats 2024-09-20T21:05:25.307 INFO:teuthology.orchestra.run.smithi161.stderr:bluestore bluefs device info [] 2024-09-20T21:05:25.307 INFO:teuthology.orchestra.run.smithi161.stderr:config diff 2024-09-20T21:05:25.307 INFO:teuthology.orchestra.run.smithi161.stderr:admin_socket: invalid command 2024-09-20T21:05:25.309 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T21:05:25.309 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-20T21:05:30.310 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:no valid command found; 10 closest matches: 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:0 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:1 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:2 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:abort 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:assert 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:bluefs debug_inject_read_zeros 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:bluefs files list 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:bluefs stats 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:bluestore allocator dump block 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:bluestore allocator fragmentation block 2024-09-20T21:05:30.425 INFO:teuthology.orchestra.run.smithi161.stderr:admin_socket: invalid command 2024-09-20T21:05:30.427 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T21:05:30.427 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-20T21:05:31.350 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:05:30.615+0000 7fd0300bb7c0 -1 osd.1 47 log_to_monitors true 2024-09-20T21:05:32.290 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-09-20T21:05:31.555+0000 7fd023e99640 -1 osd.1 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T21:05:35.428 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T21:05:35.555 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-20T21:05:35.556 INFO:teuthology.orchestra.run.smithi161.stdout: "ops": [], 2024-09-20T21:05:35.556 INFO:teuthology.orchestra.run.smithi161.stdout: "num_ops": 0 2024-09-20T21:05:35.556 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-20T21:05:35.569 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-20T21:05:36.234 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.0 to 1 (10000) 2024-09-20T21:05:36.259 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-20T21:05:37.260 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.1 to 1 (10000) 2024-09-20T21:05:37.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-20T21:05:38.260 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.2 to 1 (10000) 2024-09-20T21:05:38.285 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-20T21:05:38.285 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:05:38.586 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:38.588 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:05:38.603 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2024-09-20T21:05:38.260591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":205,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596432,"kb_used_data":2948,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282519088,"statfs":{"total":289910292480,"available":289299546112,"internally_reserved":0,"allocated":3018752,"data_stored":2265546,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-22,"num_objects_misplaced":-3,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.046053"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.230521+0000","last_change":"2024-09-20T21:03:00.185875+0000","last_active":"2024-09-20T21:05:34.230521+0000","last_peered":"2024-09-20T21:05:34.230521+0000","last_clean":"2024-09-20T21:05:34.230521+0000","last_became_active":"2024-09-20T21:03:00.185497+0000","last_became_peered":"2024-09-20T21:03:00.185497+0000","last_unstale":"2024-09-20T21:05:34.230521+0000","last_undegraded":"2024-09-20T21:05:34.230521+0000","last_fullsized":"2024-09-20T21:05:34.230521+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:28.649371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.226812+0000","last_change":"2024-09-20T21:03:00.181974+0000","last_active":"2024-09-20T21:05:34.226812+0000","last_peered":"2024-09-20T21:05:34.226812+0000","last_clean":"2024-09-20T21:05:34.226812+0000","last_became_active":"2024-09-20T21:03:00.181499+0000","last_became_peered":"2024-09-20T21:03:00.181499+0000","last_unstale":"2024-09-20T21:05:34.226812+0000","last_undegraded":"2024-09-20T21:05:34.226812+0000","last_fullsized":"2024-09-20T21:05:34.226812+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:51.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.535364+0000","last_change":"2024-09-20T21:05:33.529595+0000","last_active":"2024-09-20T21:05:36.535364+0000","last_peered":"2024-09-20T21:05:36.535364+0000","last_clean":"2024-09-20T21:05:36.535364+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:05:36.535364+0000","last_undegraded":"2024-09-20T21:05:36.535364+0000","last_fullsized":"2024-09-20T21:05:36.535364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:08.234369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533097+0000","last_change":"2024-09-20T21:05:33.516896+0000","last_active":"2024-09-20T21:05:36.533097+0000","last_peered":"2024-09-20T21:05:36.533097+0000","last_clean":"2024-09-20T21:05:36.533097+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:05:36.533097+0000","last_undegraded":"2024-09-20T21:05:36.533097+0000","last_fullsized":"2024-09-20T21:05:36.533097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:48.472114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.225546+0000","last_change":"2024-09-20T21:03:00.187632+0000","last_active":"2024-09-20T21:05:34.225546+0000","last_peered":"2024-09-20T21:05:34.225546+0000","last_clean":"2024-09-20T21:05:34.225546+0000","last_became_active":"2024-09-20T21:03:00.187296+0000","last_became_peered":"2024-09-20T21:03:00.187296+0000","last_unstale":"2024-09-20T21:05:34.225546+0000","last_undegraded":"2024-09-20T21:05:34.225546+0000","last_fullsized":"2024-09-20T21:05:34.225546+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:37.800532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533827+0000","last_change":"2024-09-20T21:05:33.526021+0000","last_active":"2024-09-20T21:05:36.533827+0000","last_peered":"2024-09-20T21:05:36.533827+0000","last_clean":"2024-09-20T21:05:36.533827+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:05:36.533827+0000","last_undegraded":"2024-09-20T21:05:36.533827+0000","last_fullsized":"2024-09-20T21:05:36.533827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:51.022212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532679+0000","last_change":"2024-09-20T21:05:33.526988+0000","last_active":"2024-09-20T21:05:36.532679+0000","last_peered":"2024-09-20T21:05:36.532679+0000","last_clean":"2024-09-20T21:05:36.532679+0000","last_became_active":"2024-09-20T21:05:33.520724+0000","last_became_peered":"2024-09-20T21:05:33.520724+0000","last_unstale":"2024-09-20T21:05:36.532679+0000","last_undegraded":"2024-09-20T21:05:36.532679+0000","last_fullsized":"2024-09-20T21:05:36.532679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:06:25.607129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531399+0000","last_change":"2024-09-20T21:05:33.527599+0000","last_active":"2024-09-20T21:05:36.531399+0000","last_peered":"2024-09-20T21:05:36.531399+0000","last_clean":"2024-09-20T21:05:36.531399+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:05:36.531399+0000","last_undegraded":"2024-09-20T21:05:36.531399+0000","last_fullsized":"2024-09-20T21:05:36.531399+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:19:18.002155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228651+0000","last_change":"2024-09-20T21:03:00.185882+0000","last_active":"2024-09-20T21:05:34.228651+0000","last_peered":"2024-09-20T21:05:34.228651+0000","last_clean":"2024-09-20T21:05:34.228651+0000","last_became_active":"2024-09-20T21:03:00.185539+0000","last_became_peered":"2024-09-20T21:03:00.185539+0000","last_unstale":"2024-09-20T21:05:34.228651+0000","last_undegraded":"2024-09-20T21:05:34.228651+0000","last_fullsized":"2024-09-20T21:05:34.228651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:12:56.727059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227171+0000","last_change":"2024-09-20T21:03:00.186475+0000","last_active":"2024-09-20T21:05:34.227171+0000","last_peered":"2024-09-20T21:05:34.227171+0000","last_clean":"2024-09-20T21:05:34.227171+0000","last_became_active":"2024-09-20T21:03:00.186135+0000","last_became_peered":"2024-09-20T21:03:00.186135+0000","last_unstale":"2024-09-20T21:05:34.227171+0000","last_undegraded":"2024-09-20T21:05:34.227171+0000","last_fullsized":"2024-09-20T21:05:34.227171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:20:50.799154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.544128+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:36.544128+0000","last_peered":"2024-09-20T21:05:36.544128+0000","last_clean":"2024-09-20T21:05:36.544128+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:36.544128+0000","last_undegraded":"2024-09-20T21:05:36.544128+0000","last_fullsized":"2024-09-20T21:05:36.544128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:14:10.131416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.247457+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:05:34.247457+0000","last_peered":"2024-09-20T21:05:34.247457+0000","last_clean":"2024-09-20T21:05:34.247457+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:05:34.247457+0000","last_undegraded":"2024-09-20T21:05:34.247457+0000","last_fullsized":"2024-09-20T21:05:34.247457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:51.509743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-20T21:05:33.217301+0000","last_change":"2024-09-20T21:05:34.231928+0000","last_active":"2024-09-20T21:05:33.217301+0000","last_peered":"2024-09-20T21:05:32.515887+0000","last_clean":"2024-09-20T21:05:32.515887+0000","last_became_active":"2024-09-20T21:03:09.257323+0000","last_became_peered":"2024-09-20T21:03:09.257323+0000","last_unstale":"2024-09-20T21:05:33.217301+0000","last_undegraded":"2024-09-20T21:05:33.217301+0000","last_fullsized":"2024-09-20T21:05:33.217301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533497+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:36.533497+0000","last_peered":"2024-09-20T21:05:36.533497+0000","last_clean":"2024-09-20T21:05:36.533497+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:36.533497+0000","last_undegraded":"2024-09-20T21:05:36.533497+0000","last_fullsized":"2024-09-20T21:05:36.533497+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:17.867418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532954+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:36.532954+0000","last_peered":"2024-09-20T21:05:36.532954+0000","last_clean":"2024-09-20T21:05:36.532954+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:36.532954+0000","last_undegraded":"2024-09-20T21:05:36.532954+0000","last_fullsized":"2024-09-20T21:05:36.532954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:36.753632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533647+0000","last_change":"2024-09-20T21:05:33.529077+0000","last_active":"2024-09-20T21:05:36.533647+0000","last_peered":"2024-09-20T21:05:36.533647+0000","last_clean":"2024-09-20T21:05:36.533647+0000","last_became_active":"2024-09-20T21:05:33.526219+0000","last_became_peered":"2024-09-20T21:05:33.526219+0000","last_unstale":"2024-09-20T21:05:36.533647+0000","last_undegraded":"2024-09-20T21:05:36.533647+0000","last_fullsized":"2024-09-20T21:05:36.533647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:34.906828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.232028+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:34.232028+0000","last_peered":"2024-09-20T21:05:34.232028+0000","last_clean":"2024-09-20T21:05:34.232028+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:34.232028+0000","last_undegraded":"2024-09-20T21:05:34.232028+0000","last_fullsized":"2024-09-20T21:05:34.232028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":138,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228179+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:34.228179+0000","last_peered":"2024-09-20T21:05:34.228179+0000","last_clean":"2024-09-20T21:05:34.228179+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:34.228179+0000","last_undegraded":"2024-09-20T21:05:34.228179+0000","last_fullsized":"2024-09-20T21:05:34.228179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.230088+0000","last_change":"2024-09-20T21:03:00.186296+0000","last_active":"2024-09-20T21:05:34.230088+0000","last_peered":"2024-09-20T21:05:34.230088+0000","last_clean":"2024-09-20T21:05:34.230088+0000","last_became_active":"2024-09-20T21:03:00.185622+0000","last_became_peered":"2024-09-20T21:03:00.185622+0000","last_unstale":"2024-09-20T21:05:34.230088+0000","last_undegraded":"2024-09-20T21:05:34.230088+0000","last_fullsized":"2024-09-20T21:05:34.230088+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.181299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533900+0000","last_change":"2024-09-20T21:05:33.523697+0000","last_active":"2024-09-20T21:05:36.533900+0000","last_peered":"2024-09-20T21:05:36.533900+0000","last_clean":"2024-09-20T21:05:36.533900+0000","last_became_active":"2024-09-20T21:05:33.523128+0000","last_became_peered":"2024-09-20T21:05:33.523128+0000","last_unstale":"2024-09-20T21:05:36.533900+0000","last_undegraded":"2024-09-20T21:05:36.533900+0000","last_fullsized":"2024-09-20T21:05:36.533900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:10.328730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533689+0000","last_change":"2024-09-20T21:05:33.524928+0000","last_active":"2024-09-20T21:05:36.533689+0000","last_peered":"2024-09-20T21:05:36.533689+0000","last_clean":"2024-09-20T21:05:36.533689+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:05:36.533689+0000","last_undegraded":"2024-09-20T21:05:36.533689+0000","last_fullsized":"2024-09-20T21:05:36.533689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:42.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.242174+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:34.242174+0000","last_peered":"2024-09-20T21:05:34.242174+0000","last_clean":"2024-09-20T21:05:34.242174+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:34.242174+0000","last_undegraded":"2024-09-20T21:05:34.242174+0000","last_fullsized":"2024-09-20T21:05:34.242174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530937+0000","last_change":"2024-09-20T21:05:33.525193+0000","last_active":"2024-09-20T21:05:36.530937+0000","last_peered":"2024-09-20T21:05:36.530937+0000","last_clean":"2024-09-20T21:05:36.530937+0000","last_became_active":"2024-09-20T21:05:33.517158+0000","last_became_peered":"2024-09-20T21:05:33.517158+0000","last_unstale":"2024-09-20T21:05:36.530937+0000","last_undegraded":"2024-09-20T21:05:36.530937+0000","last_fullsized":"2024-09-20T21:05:36.530937+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:17.026497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.224489+0000","last_change":"2024-09-20T21:03:00.182713+0000","last_active":"2024-09-20T21:05:34.224489+0000","last_peered":"2024-09-20T21:05:34.224489+0000","last_clean":"2024-09-20T21:05:34.224489+0000","last_became_active":"2024-09-20T21:03:00.181842+0000","last_became_peered":"2024-09-20T21:03:00.181842+0000","last_unstale":"2024-09-20T21:05:34.224489+0000","last_undegraded":"2024-09-20T21:05:34.224489+0000","last_fullsized":"2024-09-20T21:05:34.224489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:26.399209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532765+0000","last_change":"2024-09-20T21:05:33.511797+0000","last_active":"2024-09-20T21:05:36.532765+0000","last_peered":"2024-09-20T21:05:36.532765+0000","last_clean":"2024-09-20T21:05:36.532765+0000","last_became_active":"2024-09-20T21:05:33.509620+0000","last_became_peered":"2024-09-20T21:05:33.509620+0000","last_unstale":"2024-09-20T21:05:36.532765+0000","last_undegraded":"2024-09-20T21:05:36.532765+0000","last_fullsized":"2024-09-20T21:05:36.532765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:33.627527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532594+0000","last_change":"2024-09-20T21:05:33.523555+0000","last_active":"2024-09-20T21:05:36.532594+0000","last_peered":"2024-09-20T21:05:36.532594+0000","last_clean":"2024-09-20T21:05:36.532594+0000","last_became_active":"2024-09-20T21:05:33.517817+0000","last_became_peered":"2024-09-20T21:05:33.517817+0000","last_unstale":"2024-09-20T21:05:36.532594+0000","last_undegraded":"2024-09-20T21:05:36.532594+0000","last_fullsized":"2024-09-20T21:05:36.532594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:16.704262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534986+0000","last_change":"2024-09-20T21:05:33.528984+0000","last_active":"2024-09-20T21:05:36.534986+0000","last_peered":"2024-09-20T21:05:36.534986+0000","last_clean":"2024-09-20T21:05:36.534986+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:05:36.534986+0000","last_undegraded":"2024-09-20T21:05:36.534986+0000","last_fullsized":"2024-09-20T21:05:36.534986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:53.623013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533664+0000","last_change":"2024-09-20T21:05:33.509655+0000","last_active":"2024-09-20T21:05:36.533664+0000","last_peered":"2024-09-20T21:05:36.533664+0000","last_clean":"2024-09-20T21:05:36.533664+0000","last_became_active":"2024-09-20T21:05:33.508551+0000","last_became_peered":"2024-09-20T21:05:33.508551+0000","last_unstale":"2024-09-20T21:05:36.533664+0000","last_undegraded":"2024-09-20T21:05:36.533664+0000","last_fullsized":"2024-09-20T21:05:36.533664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:12.145348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.409003+0000","last_change":"2024-09-20T21:03:09.257334+0000","last_active":"2024-09-20T21:03:29.409003+0000","last_peered":"2024-09-20T21:03:29.409003+0000","last_clean":"2024-09-20T21:03:29.409003+0000","last_became_active":"2024-09-20T21:03:09.256027+0000","last_became_peered":"2024-09-20T21:03:09.256027+0000","last_unstale":"2024-09-20T21:03:29.409003+0000","last_undegraded":"2024-09-20T21:03:29.409003+0000","last_fullsized":"2024-09-20T21:03:29.409003+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:03.468293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.245672+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:34.245672+0000","last_peered":"2024-09-20T21:05:34.245672+0000","last_clean":"2024-09-20T21:05:34.245672+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:34.245672+0000","last_undegraded":"2024-09-20T21:05:34.245672+0000","last_fullsized":"2024-09-20T21:05:34.245672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":140,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.220011+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:34.220011+0000","last_peered":"2024-09-20T21:05:34.220011+0000","last_clean":"2024-09-20T21:05:34.220011+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:34.220011+0000","last_undegraded":"2024-09-20T21:05:34.220011+0000","last_fullsized":"2024-09-20T21:05:34.220011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531154+0000","last_change":"2024-09-20T21:05:33.520634+0000","last_active":"2024-09-20T21:05:36.531154+0000","last_peered":"2024-09-20T21:05:36.531154+0000","last_clean":"2024-09-20T21:05:36.531154+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:05:36.531154+0000","last_undegraded":"2024-09-20T21:05:36.531154+0000","last_fullsized":"2024-09-20T21:05:36.531154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.341860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.231801+0000","last_change":"2024-09-20T21:03:00.182033+0000","last_active":"2024-09-20T21:05:34.231801+0000","last_peered":"2024-09-20T21:05:34.231801+0000","last_clean":"2024-09-20T21:05:34.231801+0000","last_became_active":"2024-09-20T21:03:00.181486+0000","last_became_peered":"2024-09-20T21:03:00.181486+0000","last_unstale":"2024-09-20T21:05:34.231801+0000","last_undegraded":"2024-09-20T21:05:34.231801+0000","last_fullsized":"2024-09-20T21:05:34.231801+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:22.185174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532185+0000","last_change":"2024-09-20T21:05:33.523453+0000","last_active":"2024-09-20T21:05:36.532185+0000","last_peered":"2024-09-20T21:05:36.532185+0000","last_clean":"2024-09-20T21:05:36.532185+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:05:36.532185+0000","last_undegraded":"2024-09-20T21:05:36.532185+0000","last_fullsized":"2024-09-20T21:05:36.532185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:59.275158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.231712+0000","last_change":"2024-09-20T21:03:00.186549+0000","last_active":"2024-09-20T21:05:34.231712+0000","last_peered":"2024-09-20T21:05:34.231712+0000","last_clean":"2024-09-20T21:05:34.231712+0000","last_became_active":"2024-09-20T21:03:00.185982+0000","last_became_peered":"2024-09-20T21:03:00.185982+0000","last_unstale":"2024-09-20T21:05:34.231712+0000","last_undegraded":"2024-09-20T21:05:34.231712+0000","last_fullsized":"2024-09-20T21:05:34.231712+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:44.292273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.265360+0000","last_change":"2024-09-20T21:05:34.265360+0000","last_active":"2024-09-20T21:05:34.265360+0000","last_peered":"2024-09-20T21:05:34.265360+0000","last_clean":"2024-09-20T21:05:34.265360+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:05:34.265360+0000","last_undegraded":"2024-09-20T21:05:34.265360+0000","last_fullsized":"2024-09-20T21:05:34.265360+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:02.949435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.264103+0000","last_change":"2024-09-20T21:05:34.264103+0000","last_active":"2024-09-20T21:05:34.264103+0000","last_peered":"2024-09-20T21:05:34.264103+0000","last_clean":"2024-09-20T21:05:34.264103+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:05:34.264103+0000","last_undegraded":"2024-09-20T21:05:34.264103+0000","last_fullsized":"2024-09-20T21:05:34.264103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.354082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531950+0000","last_change":"2024-09-20T21:05:33.507359+0000","last_active":"2024-09-20T21:05:36.531950+0000","last_peered":"2024-09-20T21:05:36.531950+0000","last_clean":"2024-09-20T21:05:36.531950+0000","last_became_active":"2024-09-20T21:05:33.505749+0000","last_became_peered":"2024-09-20T21:05:33.505749+0000","last_unstale":"2024-09-20T21:05:36.531950+0000","last_undegraded":"2024-09-20T21:05:36.531950+0000","last_fullsized":"2024-09-20T21:05:36.531950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:35.978609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533104+0000","last_change":"2024-09-20T21:05:33.528126+0000","last_active":"2024-09-20T21:05:36.533104+0000","last_peered":"2024-09-20T21:05:36.533104+0000","last_clean":"2024-09-20T21:05:36.533104+0000","last_became_active":"2024-09-20T21:05:33.521052+0000","last_became_peered":"2024-09-20T21:05:33.521052+0000","last_unstale":"2024-09-20T21:05:36.533104+0000","last_undegraded":"2024-09-20T21:05:36.533104+0000","last_fullsized":"2024-09-20T21:05:36.533104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:40.460011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530840+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:36.530840+0000","last_peered":"2024-09-20T21:05:36.530840+0000","last_clean":"2024-09-20T21:05:36.530840+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:36.530840+0000","last_undegraded":"2024-09-20T21:05:36.530840+0000","last_fullsized":"2024-09-20T21:05:36.530840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:41.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533049+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:36.533049+0000","last_peered":"2024-09-20T21:05:36.533049+0000","last_clean":"2024-09-20T21:05:36.533049+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:36.533049+0000","last_undegraded":"2024-09-20T21:05:36.533049+0000","last_fullsized":"2024-09-20T21:05:36.533049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:04.604590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534167+0000","last_change":"2024-09-20T21:05:33.511358+0000","last_active":"2024-09-20T21:05:36.534167+0000","last_peered":"2024-09-20T21:05:36.534167+0000","last_clean":"2024-09-20T21:05:36.534167+0000","last_became_active":"2024-09-20T21:05:33.507647+0000","last_became_peered":"2024-09-20T21:05:33.507647+0000","last_unstale":"2024-09-20T21:05:36.534167+0000","last_undegraded":"2024-09-20T21:05:36.534167+0000","last_fullsized":"2024-09-20T21:05:36.534167+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:44:55.328542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531925+0000","last_change":"2024-09-20T21:05:33.506588+0000","last_active":"2024-09-20T21:05:36.531925+0000","last_peered":"2024-09-20T21:05:36.531925+0000","last_clean":"2024-09-20T21:05:36.531925+0000","last_became_active":"2024-09-20T21:05:33.505615+0000","last_became_peered":"2024-09-20T21:05:33.505615+0000","last_unstale":"2024-09-20T21:05:36.531925+0000","last_undegraded":"2024-09-20T21:05:36.531925+0000","last_fullsized":"2024-09-20T21:05:36.531925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:40.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227924+0000","last_change":"2024-09-20T21:03:00.187291+0000","last_active":"2024-09-20T21:05:34.227924+0000","last_peered":"2024-09-20T21:05:34.227924+0000","last_clean":"2024-09-20T21:05:34.227924+0000","last_became_active":"2024-09-20T21:03:00.186993+0000","last_became_peered":"2024-09-20T21:03:00.186993+0000","last_unstale":"2024-09-20T21:05:34.227924+0000","last_undegraded":"2024-09-20T21:05:34.227924+0000","last_fullsized":"2024-09-20T21:05:34.227924+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:54:14.917606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534439+0000","last_change":"2024-09-20T21:05:33.529620+0000","last_active":"2024-09-20T21:05:36.534439+0000","last_peered":"2024-09-20T21:05:36.534439+0000","last_clean":"2024-09-20T21:05:36.534439+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:05:36.534439+0000","last_undegraded":"2024-09-20T21:05:36.534439+0000","last_fullsized":"2024-09-20T21:05:36.534439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:39.374497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534076+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:36.534076+0000","last_peered":"2024-09-20T21:05:36.534076+0000","last_clean":"2024-09-20T21:05:36.534076+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:36.534076+0000","last_undegraded":"2024-09-20T21:05:36.534076+0000","last_fullsized":"2024-09-20T21:05:36.534076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:30.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533415+0000","last_change":"2024-09-20T21:05:33.516924+0000","last_active":"2024-09-20T21:05:36.533415+0000","last_peered":"2024-09-20T21:05:36.533415+0000","last_clean":"2024-09-20T21:05:36.533415+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:05:36.533415+0000","last_undegraded":"2024-09-20T21:05:36.533415+0000","last_fullsized":"2024-09-20T21:05:36.533415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:55.590471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534471+0000","last_change":"2024-09-20T21:05:33.525586+0000","last_active":"2024-09-20T21:05:36.534471+0000","last_peered":"2024-09-20T21:05:36.534471+0000","last_clean":"2024-09-20T21:05:36.534471+0000","last_became_active":"2024-09-20T21:05:33.522980+0000","last_became_peered":"2024-09-20T21:05:33.522980+0000","last_unstale":"2024-09-20T21:05:36.534471+0000","last_undegraded":"2024-09-20T21:05:36.534471+0000","last_fullsized":"2024-09-20T21:05:36.534471+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:02.419755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.264426+0000","last_change":"2024-09-20T21:05:34.264426+0000","last_active":"2024-09-20T21:05:34.264426+0000","last_peered":"2024-09-20T21:05:34.264426+0000","last_clean":"2024-09-20T21:05:34.264426+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:05:34.264426+0000","last_undegraded":"2024-09-20T21:05:34.264426+0000","last_fullsized":"2024-09-20T21:05:34.264426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:23.886272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534627+0000","last_change":"2024-09-20T21:05:33.517281+0000","last_active":"2024-09-20T21:05:36.534627+0000","last_peered":"2024-09-20T21:05:36.534627+0000","last_clean":"2024-09-20T21:05:36.534627+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:05:36.534627+0000","last_undegraded":"2024-09-20T21:05:36.534627+0000","last_fullsized":"2024-09-20T21:05:36.534627+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:44.497231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531298+0000","last_change":"2024-09-20T21:05:33.523216+0000","last_active":"2024-09-20T21:05:36.531298+0000","last_peered":"2024-09-20T21:05:36.531298+0000","last_clean":"2024-09-20T21:05:36.531298+0000","last_became_active":"2024-09-20T21:05:33.516684+0000","last_became_peered":"2024-09-20T21:05:33.516684+0000","last_unstale":"2024-09-20T21:05:36.531298+0000","last_undegraded":"2024-09-20T21:05:36.531298+0000","last_fullsized":"2024-09-20T21:05:36.531298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:33:12.817332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532390+0000","last_change":"2024-09-20T21:05:33.527473+0000","last_active":"2024-09-20T21:05:36.532390+0000","last_peered":"2024-09-20T21:05:36.532390+0000","last_clean":"2024-09-20T21:05:36.532390+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:05:36.532390+0000","last_undegraded":"2024-09-20T21:05:36.532390+0000","last_fullsized":"2024-09-20T21:05:36.532390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:43.880199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.243835+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:34.243835+0000","last_peered":"2024-09-20T21:05:34.243835+0000","last_clean":"2024-09-20T21:05:34.243835+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:34.243835+0000","last_undegraded":"2024-09-20T21:05:34.243835+0000","last_fullsized":"2024-09-20T21:05:34.243835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:06:41.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532824+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:36.532824+0000","last_peered":"2024-09-20T21:05:36.532824+0000","last_clean":"2024-09-20T21:05:36.532824+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:36.532824+0000","last_undegraded":"2024-09-20T21:05:36.532824+0000","last_fullsized":"2024-09-20T21:05:36.532824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:57.275101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.225029+0000","last_change":"2024-09-20T21:03:00.182491+0000","last_active":"2024-09-20T21:05:34.225029+0000","last_peered":"2024-09-20T21:05:34.225029+0000","last_clean":"2024-09-20T21:05:34.225029+0000","last_became_active":"2024-09-20T21:03:00.181363+0000","last_became_peered":"2024-09-20T21:03:00.181363+0000","last_unstale":"2024-09-20T21:05:34.225029+0000","last_undegraded":"2024-09-20T21:05:34.225029+0000","last_fullsized":"2024-09-20T21:05:34.225029+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:28.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228356+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:05:34.228356+0000","last_peered":"2024-09-20T21:05:34.228356+0000","last_clean":"2024-09-20T21:05:34.228356+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:05:34.228356+0000","last_undegraded":"2024-09-20T21:05:34.228356+0000","last_fullsized":"2024-09-20T21:05:34.228356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":253,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530578+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:36.530578+0000","last_peered":"2024-09-20T21:05:36.530578+0000","last_clean":"2024-09-20T21:05:36.530578+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:36.530578+0000","last_undegraded":"2024-09-20T21:05:36.530578+0000","last_fullsized":"2024-09-20T21:05:36.530578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:49.545054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531068+0000","last_change":"2024-09-20T21:05:33.516926+0000","last_active":"2024-09-20T21:05:36.531068+0000","last_peered":"2024-09-20T21:05:36.531068+0000","last_clean":"2024-09-20T21:05:36.531068+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:05:36.531068+0000","last_undegraded":"2024-09-20T21:05:36.531068+0000","last_fullsized":"2024-09-20T21:05:36.531068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:48.429167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.407874+0000","last_change":"2024-09-20T21:03:09.259033+0000","last_active":"2024-09-20T21:03:29.407874+0000","last_peered":"2024-09-20T21:03:29.407874+0000","last_clean":"2024-09-20T21:03:29.407874+0000","last_became_active":"2024-09-20T21:03:09.255753+0000","last_became_peered":"2024-09-20T21:03:09.255753+0000","last_unstale":"2024-09-20T21:03:29.407874+0000","last_undegraded":"2024-09-20T21:03:29.407874+0000","last_fullsized":"2024-09-20T21:03:29.407874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:06.244010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534837+0000","last_change":"2024-09-20T21:05:33.527863+0000","last_active":"2024-09-20T21:05:36.534837+0000","last_peered":"2024-09-20T21:05:36.534837+0000","last_clean":"2024-09-20T21:05:36.534837+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:05:36.534837+0000","last_undegraded":"2024-09-20T21:05:36.534837+0000","last_fullsized":"2024-09-20T21:05:36.534837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:28.039071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531382+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:36.531382+0000","last_peered":"2024-09-20T21:05:36.531382+0000","last_clean":"2024-09-20T21:05:36.531382+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:36.531382+0000","last_undegraded":"2024-09-20T21:05:36.531382+0000","last_fullsized":"2024-09-20T21:05:36.531382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:58.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530629+0000","last_change":"2024-09-20T21:05:33.517511+0000","last_active":"2024-09-20T21:05:36.530629+0000","last_peered":"2024-09-20T21:05:36.530629+0000","last_clean":"2024-09-20T21:05:36.530629+0000","last_became_active":"2024-09-20T21:05:33.512528+0000","last_became_peered":"2024-09-20T21:05:33.512528+0000","last_unstale":"2024-09-20T21:05:36.530629+0000","last_undegraded":"2024-09-20T21:05:36.530629+0000","last_fullsized":"2024-09-20T21:05:36.530629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:12:56.968567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227583+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:34.227583+0000","last_peered":"2024-09-20T21:05:34.227583+0000","last_clean":"2024-09-20T21:05:34.227583+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:34.227583+0000","last_undegraded":"2024-09-20T21:05:34.227583+0000","last_fullsized":"2024-09-20T21:05:34.227583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221339+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:34.221339+0000","last_peered":"2024-09-20T21:05:34.221339+0000","last_clean":"2024-09-20T21:05:34.221339+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:34.221339+0000","last_undegraded":"2024-09-20T21:05:34.221339+0000","last_fullsized":"2024-09-20T21:05:34.221339+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530710+0000","last_change":"2024-09-20T21:05:33.506109+0000","last_active":"2024-09-20T21:05:36.530710+0000","last_peered":"2024-09-20T21:05:36.530710+0000","last_clean":"2024-09-20T21:05:36.530710+0000","last_became_active":"2024-09-20T21:05:33.505217+0000","last_became_peered":"2024-09-20T21:05:33.505217+0000","last_unstale":"2024-09-20T21:05:36.530710+0000","last_undegraded":"2024-09-20T21:05:36.530710+0000","last_fullsized":"2024-09-20T21:05:36.530710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:35.484677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228392+0000","last_change":"2024-09-20T21:03:00.182222+0000","last_active":"2024-09-20T21:05:34.228392+0000","last_peered":"2024-09-20T21:05:34.228392+0000","last_clean":"2024-09-20T21:05:34.228392+0000","last_became_active":"2024-09-20T21:03:00.181621+0000","last_became_peered":"2024-09-20T21:03:00.181621+0000","last_unstale":"2024-09-20T21:05:34.228392+0000","last_undegraded":"2024-09-20T21:05:34.228392+0000","last_fullsized":"2024-09-20T21:05:34.228392+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:17.147485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530978+0000","last_change":"2024-09-20T21:05:33.525394+0000","last_active":"2024-09-20T21:05:36.530978+0000","last_peered":"2024-09-20T21:05:36.530978+0000","last_clean":"2024-09-20T21:05:36.530978+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:05:36.530978+0000","last_undegraded":"2024-09-20T21:05:36.530978+0000","last_fullsized":"2024-09-20T21:05:36.530978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:51:33.922257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531598+0000","last_change":"2024-09-20T21:05:33.522984+0000","last_active":"2024-09-20T21:05:36.531598+0000","last_peered":"2024-09-20T21:05:36.531598+0000","last_clean":"2024-09-20T21:05:36.531598+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:05:36.531598+0000","last_undegraded":"2024-09-20T21:05:36.531598+0000","last_fullsized":"2024-09-20T21:05:36.531598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:22:14.870718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227653+0000","last_change":"2024-09-20T21:03:00.181764+0000","last_active":"2024-09-20T21:05:34.227653+0000","last_peered":"2024-09-20T21:05:34.227653+0000","last_clean":"2024-09-20T21:05:34.227653+0000","last_became_active":"2024-09-20T21:03:00.181125+0000","last_became_peered":"2024-09-20T21:03:00.181125+0000","last_unstale":"2024-09-20T21:05:34.227653+0000","last_undegraded":"2024-09-20T21:05:34.227653+0000","last_fullsized":"2024-09-20T21:05:34.227653+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:58.632807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531763+0000","last_change":"2024-09-20T21:05:33.530100+0000","last_active":"2024-09-20T21:05:36.531763+0000","last_peered":"2024-09-20T21:05:36.531763+0000","last_clean":"2024-09-20T21:05:36.531763+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:05:36.531763+0000","last_undegraded":"2024-09-20T21:05:36.531763+0000","last_fullsized":"2024-09-20T21:05:36.531763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:12.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221816+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:34.221816+0000","last_peered":"2024-09-20T21:05:34.221816+0000","last_clean":"2024-09-20T21:05:34.221816+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:34.221816+0000","last_undegraded":"2024-09-20T21:05:34.221816+0000","last_fullsized":"2024-09-20T21:05:34.221816+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.241501+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:34.241501+0000","last_peered":"2024-09-20T21:05:34.241501+0000","last_clean":"2024-09-20T21:05:34.241501+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:34.241501+0000","last_undegraded":"2024-09-20T21:05:34.241501+0000","last_fullsized":"2024-09-20T21:05:34.241501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:03.961332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221558+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:34.221558+0000","last_peered":"2024-09-20T21:05:34.221558+0000","last_clean":"2024-09-20T21:05:34.221558+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:34.221558+0000","last_undegraded":"2024-09-20T21:05:34.221558+0000","last_fullsized":"2024-09-20T21:05:34.221558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.233180+0000","last_change":"2024-09-20T21:03:00.186668+0000","last_active":"2024-09-20T21:05:34.233180+0000","last_peered":"2024-09-20T21:05:34.233180+0000","last_clean":"2024-09-20T21:05:34.233180+0000","last_became_active":"2024-09-20T21:03:00.186259+0000","last_became_peered":"2024-09-20T21:03:00.186259+0000","last_unstale":"2024-09-20T21:05:34.233180+0000","last_undegraded":"2024-09-20T21:05:34.233180+0000","last_fullsized":"2024-09-20T21:05:34.233180+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:42:58.237986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533928+0000","last_change":"2024-09-20T21:05:33.509455+0000","last_active":"2024-09-20T21:05:36.533928+0000","last_peered":"2024-09-20T21:05:36.533928+0000","last_clean":"2024-09-20T21:05:36.533928+0000","last_became_active":"2024-09-20T21:05:33.508553+0000","last_became_peered":"2024-09-20T21:05:33.508553+0000","last_unstale":"2024-09-20T21:05:36.533928+0000","last_undegraded":"2024-09-20T21:05:36.533928+0000","last_fullsized":"2024-09-20T21:05:36.533928+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:16:44.519386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.232515+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:34.232515+0000","last_peered":"2024-09-20T21:05:34.232515+0000","last_clean":"2024-09-20T21:05:34.232515+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:34.232515+0000","last_undegraded":"2024-09-20T21:05:34.232515+0000","last_fullsized":"2024-09-20T21:05:34.232515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.232770+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:05:34.232770+0000","last_peered":"2024-09-20T21:05:34.232770+0000","last_clean":"2024-09-20T21:05:34.232770+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:05:34.232770+0000","last_undegraded":"2024-09-20T21:05:34.232770+0000","last_fullsized":"2024-09-20T21:05:34.232770+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.407367+0000","last_change":"2024-09-20T21:03:09.320426+0000","last_active":"2024-09-20T21:03:29.407367+0000","last_peered":"2024-09-20T21:03:29.407367+0000","last_clean":"2024-09-20T21:03:29.407367+0000","last_became_active":"2024-09-20T21:03:09.319266+0000","last_became_peered":"2024-09-20T21:03:09.319266+0000","last_unstale":"2024-09-20T21:03:29.407367+0000","last_undegraded":"2024-09-20T21:03:29.407367+0000","last_fullsized":"2024-09-20T21:03:29.407367+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:35:35.196344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.269917+0000","last_change":"2024-09-20T21:05:34.264862+0000","last_active":"2024-09-20T21:05:34.269917+0000","last_peered":"2024-09-20T21:05:34.269917+0000","last_clean":"2024-09-20T21:05:34.269917+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:05:34.269917+0000","last_undegraded":"2024-09-20T21:05:34.269917+0000","last_fullsized":"2024-09-20T21:05:34.269917+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:32.512356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532164+0000","last_change":"2024-09-20T21:05:33.508633+0000","last_active":"2024-09-20T21:05:36.532164+0000","last_peered":"2024-09-20T21:05:36.532164+0000","last_clean":"2024-09-20T21:05:36.532164+0000","last_became_active":"2024-09-20T21:05:33.505595+0000","last_became_peered":"2024-09-20T21:05:33.505595+0000","last_unstale":"2024-09-20T21:05:36.532164+0000","last_undegraded":"2024-09-20T21:05:36.532164+0000","last_fullsized":"2024-09-20T21:05:36.532164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:10.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532027+0000","last_change":"2024-09-20T21:05:33.507358+0000","last_active":"2024-09-20T21:05:36.532027+0000","last_peered":"2024-09-20T21:05:36.532027+0000","last_clean":"2024-09-20T21:05:36.532027+0000","last_became_active":"2024-09-20T21:05:33.506544+0000","last_became_peered":"2024-09-20T21:05:33.506544+0000","last_unstale":"2024-09-20T21:05:36.532027+0000","last_undegraded":"2024-09-20T21:05:36.532027+0000","last_fullsized":"2024-09-20T21:05:36.532027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:00.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533106+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:36.533106+0000","last_peered":"2024-09-20T21:05:36.533106+0000","last_clean":"2024-09-20T21:05:36.533106+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:36.533106+0000","last_undegraded":"2024-09-20T21:05:36.533106+0000","last_fullsized":"2024-09-20T21:05:36.533106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:49.172273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532044+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:36.532044+0000","last_peered":"2024-09-20T21:05:36.532044+0000","last_clean":"2024-09-20T21:05:36.532044+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:36.532044+0000","last_undegraded":"2024-09-20T21:05:36.532044+0000","last_fullsized":"2024-09-20T21:05:36.532044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:07:07.242939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221325+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:05:34.221325+0000","last_peered":"2024-09-20T21:05:34.221325+0000","last_clean":"2024-09-20T21:05:34.221325+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:05:34.221325+0000","last_undegraded":"2024-09-20T21:05:34.221325+0000","last_fullsized":"2024-09-20T21:05:34.221325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534923+0000","last_change":"2024-09-20T21:05:33.528236+0000","last_active":"2024-09-20T21:05:36.534923+0000","last_peered":"2024-09-20T21:05:36.534923+0000","last_clean":"2024-09-20T21:05:36.534923+0000","last_became_active":"2024-09-20T21:05:33.516911+0000","last_became_peered":"2024-09-20T21:05:33.516911+0000","last_unstale":"2024-09-20T21:05:36.534923+0000","last_undegraded":"2024-09-20T21:05:36.534923+0000","last_fullsized":"2024-09-20T21:05:36.534923+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:52.563724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532440+0000","last_change":"2024-09-20T21:05:33.525151+0000","last_active":"2024-09-20T21:05:36.532440+0000","last_peered":"2024-09-20T21:05:36.532440+0000","last_clean":"2024-09-20T21:05:36.532440+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:05:36.532440+0000","last_undegraded":"2024-09-20T21:05:36.532440+0000","last_fullsized":"2024-09-20T21:05:36.532440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:51.245496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531752+0000","last_change":"2024-09-20T21:05:33.525313+0000","last_active":"2024-09-20T21:05:36.531752+0000","last_peered":"2024-09-20T21:05:36.531752+0000","last_clean":"2024-09-20T21:05:36.531752+0000","last_became_active":"2024-09-20T21:05:33.517931+0000","last_became_peered":"2024-09-20T21:05:33.517931+0000","last_unstale":"2024-09-20T21:05:36.531752+0000","last_undegraded":"2024-09-20T21:05:36.531752+0000","last_fullsized":"2024-09-20T21:05:36.531752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:15.962153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.264735+0000","last_change":"2024-09-20T21:05:34.264735+0000","last_active":"2024-09-20T21:05:34.264735+0000","last_peered":"2024-09-20T21:05:34.264735+0000","last_clean":"2024-09-20T21:05:34.264735+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:05:34.264735+0000","last_undegraded":"2024-09-20T21:05:34.264735+0000","last_fullsized":"2024-09-20T21:05:34.264735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:16.718841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-20T21:05:33.209748+0000","last_change":"2024-09-20T21:05:34.225456+0000","last_active":"2024-09-20T21:05:33.209748+0000","last_peered":"2024-09-20T21:05:32.514387+0000","last_clean":"2024-09-20T21:05:32.514387+0000","last_became_active":"2024-09-20T21:03:09.319134+0000","last_became_peered":"2024-09-20T21:03:09.319134+0000","last_unstale":"2024-09-20T21:05:33.209748+0000","last_undegraded":"2024-09-20T21:05:33.209748+0000","last_fullsized":"2024-09-20T21:05:33.209748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.248368+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:34.248368+0000","last_peered":"2024-09-20T21:05:34.248368+0000","last_clean":"2024-09-20T21:05:34.248368+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:34.248368+0000","last_undegraded":"2024-09-20T21:05:34.248368+0000","last_fullsized":"2024-09-20T21:05:34.248368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:39.486200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.413291+0000","last_change":"2024-09-20T21:03:09.320997+0000","last_active":"2024-09-20T21:03:29.413291+0000","last_peered":"2024-09-20T21:03:29.413291+0000","last_clean":"2024-09-20T21:03:29.413291+0000","last_became_active":"2024-09-20T21:03:09.319756+0000","last_became_peered":"2024-09-20T21:03:09.319756+0000","last_unstale":"2024-09-20T21:03:29.413291+0000","last_undegraded":"2024-09-20T21:03:29.413291+0000","last_fullsized":"2024-09-20T21:03:29.413291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:16:30.171477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532245+0000","last_change":"2024-09-20T21:05:33.525291+0000","last_active":"2024-09-20T21:05:36.532245+0000","last_peered":"2024-09-20T21:05:36.532245+0000","last_clean":"2024-09-20T21:05:36.532245+0000","last_became_active":"2024-09-20T21:05:33.523537+0000","last_became_peered":"2024-09-20T21:05:33.523537+0000","last_unstale":"2024-09-20T21:05:36.532245+0000","last_undegraded":"2024-09-20T21:05:36.532245+0000","last_fullsized":"2024-09-20T21:05:36.532245+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:42.985077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.540422+0000","last_change":"2024-09-20T21:05:36.539030+0000","last_active":"2024-09-20T21:05:36.540422+0000","last_peered":"2024-09-20T21:05:36.540422+0000","last_clean":"2024-09-20T21:05:36.540422+0000","last_became_active":"2024-09-20T21:05:36.538325+0000","last_became_peered":"2024-09-20T21:05:36.538325+0000","last_unstale":"2024-09-20T21:05:36.540422+0000","last_undegraded":"2024-09-20T21:05:36.540422+0000","last_fullsized":"2024-09-20T21:05:36.540422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:48.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532065+0000","last_change":"2024-09-20T21:05:33.528150+0000","last_active":"2024-09-20T21:05:36.532065+0000","last_peered":"2024-09-20T21:05:36.532065+0000","last_clean":"2024-09-20T21:05:36.532065+0000","last_became_active":"2024-09-20T21:05:33.512623+0000","last_became_peered":"2024-09-20T21:05:33.512623+0000","last_unstale":"2024-09-20T21:05:36.532065+0000","last_undegraded":"2024-09-20T21:05:36.532065+0000","last_fullsized":"2024-09-20T21:05:36.532065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:08.142904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227511+0000","last_change":"2024-09-20T21:03:00.182809+0000","last_active":"2024-09-20T21:05:34.227511+0000","last_peered":"2024-09-20T21:05:34.227511+0000","last_clean":"2024-09-20T21:05:34.227511+0000","last_became_active":"2024-09-20T21:03:00.182423+0000","last_became_peered":"2024-09-20T21:03:00.182423+0000","last_unstale":"2024-09-20T21:05:34.227511+0000","last_undegraded":"2024-09-20T21:05:34.227511+0000","last_fullsized":"2024-09-20T21:05:34.227511+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:26.732116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":91,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.412991+0000","last_change":"2024-09-20T21:03:09.257671+0000","last_active":"2024-09-20T21:03:29.412991+0000","last_peered":"2024-09-20T21:03:29.412991+0000","last_clean":"2024-09-20T21:03:29.412991+0000","last_became_active":"2024-09-20T21:03:09.256538+0000","last_became_peered":"2024-09-20T21:03:09.256538+0000","last_unstale":"2024-09-20T21:03:29.412991+0000","last_undegraded":"2024-09-20T21:03:29.412991+0000","last_fullsized":"2024-09-20T21:03:29.412991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:41.755432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534768+0000","last_change":"2024-09-20T21:05:33.508991+0000","last_active":"2024-09-20T21:05:36.534768+0000","last_peered":"2024-09-20T21:05:36.534768+0000","last_clean":"2024-09-20T21:05:36.534768+0000","last_became_active":"2024-09-20T21:05:33.507155+0000","last_became_peered":"2024-09-20T21:05:33.507155+0000","last_unstale":"2024-09-20T21:05:36.534768+0000","last_undegraded":"2024-09-20T21:05:36.534768+0000","last_fullsized":"2024-09-20T21:05:36.534768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:04:20.632178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532969+0000","last_change":"2024-09-20T21:05:33.523783+0000","last_active":"2024-09-20T21:05:36.532969+0000","last_peered":"2024-09-20T21:05:36.532969+0000","last_clean":"2024-09-20T21:05:36.532969+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:05:36.532969+0000","last_undegraded":"2024-09-20T21:05:36.532969+0000","last_fullsized":"2024-09-20T21:05:36.532969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:29.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.560617+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:36.560617+0000","last_peered":"2024-09-20T21:05:36.560617+0000","last_clean":"2024-09-20T21:05:36.560617+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:36.560617+0000","last_undegraded":"2024-09-20T21:05:36.560617+0000","last_fullsized":"2024-09-20T21:05:36.560617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:45:47.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533560+0000","last_change":"2024-09-20T21:05:33.525036+0000","last_active":"2024-09-20T21:05:36.533560+0000","last_peered":"2024-09-20T21:05:36.533560+0000","last_clean":"2024-09-20T21:05:36.533560+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:05:36.533560+0000","last_undegraded":"2024-09-20T21:05:36.533560+0000","last_fullsized":"2024-09-20T21:05:36.533560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:13.120671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531493+0000","last_change":"2024-09-20T21:05:33.525496+0000","last_active":"2024-09-20T21:05:36.531493+0000","last_peered":"2024-09-20T21:05:36.531493+0000","last_clean":"2024-09-20T21:05:36.531493+0000","last_became_active":"2024-09-20T21:05:33.511914+0000","last_became_peered":"2024-09-20T21:05:33.511914+0000","last_unstale":"2024-09-20T21:05:36.531493+0000","last_undegraded":"2024-09-20T21:05:36.531493+0000","last_fullsized":"2024-09-20T21:05:36.531493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:47:40.771092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.229962+0000","last_change":"2024-09-20T21:03:00.186986+0000","last_active":"2024-09-20T21:05:34.229962+0000","last_peered":"2024-09-20T21:05:34.229962+0000","last_clean":"2024-09-20T21:05:34.229962+0000","last_became_active":"2024-09-20T21:03:00.186450+0000","last_became_peered":"2024-09-20T21:03:00.186450+0000","last_unstale":"2024-09-20T21:05:34.229962+0000","last_undegraded":"2024-09-20T21:05:34.229962+0000","last_fullsized":"2024-09-20T21:05:34.229962+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:16:39.776258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.231725+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:34.231725+0000","last_peered":"2024-09-20T21:05:34.231725+0000","last_clean":"2024-09-20T21:05:34.231725+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:34.231725+0000","last_undegraded":"2024-09-20T21:05:34.231725+0000","last_fullsized":"2024-09-20T21:05:34.231725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534323+0000","last_change":"2024-09-20T21:05:33.529399+0000","last_active":"2024-09-20T21:05:36.534323+0000","last_peered":"2024-09-20T21:05:36.534323+0000","last_clean":"2024-09-20T21:05:36.534323+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:05:36.534323+0000","last_undegraded":"2024-09-20T21:05:36.534323+0000","last_fullsized":"2024-09-20T21:05:36.534323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:36.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.552715+0000","last_change":"2024-09-20T21:05:36.551627+0000","last_active":"2024-09-20T21:05:36.552715+0000","last_peered":"2024-09-20T21:05:36.552715+0000","last_clean":"2024-09-20T21:05:36.552715+0000","last_became_active":"2024-09-20T21:05:36.542121+0000","last_became_peered":"2024-09-20T21:05:36.542121+0000","last_unstale":"2024-09-20T21:05:36.552715+0000","last_undegraded":"2024-09-20T21:05:36.552715+0000","last_fullsized":"2024-09-20T21:05:36.552715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:30.528499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":125,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":62,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738427,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216828,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94155012,"statfs":{"total":96636764160,"available":96414732288,"internally_reserved":0,"allocated":1024000,"data_stored":949633,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350978,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54556,"kb_used_data":1024,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317284,"statfs":{"total":96636764160,"available":96580898816,"internally_reserved":0,"allocated":1048576,"data_stored":958389,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325048,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046792,"statfs":{"total":96636764160,"available":96303915008,"internally_reserved":0,"allocated":946176,"data_stored":357524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:05:38.611 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:05:38.946 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:38.949 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:05:38.962 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2024-09-20T21:05:38.260591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":205,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596432,"kb_used_data":2948,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282519088,"statfs":{"total":289910292480,"available":289299546112,"internally_reserved":0,"allocated":3018752,"data_stored":2265546,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-22,"num_objects_misplaced":-3,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.046053"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.230521+0000","last_change":"2024-09-20T21:03:00.185875+0000","last_active":"2024-09-20T21:05:34.230521+0000","last_peered":"2024-09-20T21:05:34.230521+0000","last_clean":"2024-09-20T21:05:34.230521+0000","last_became_active":"2024-09-20T21:03:00.185497+0000","last_became_peered":"2024-09-20T21:03:00.185497+0000","last_unstale":"2024-09-20T21:05:34.230521+0000","last_undegraded":"2024-09-20T21:05:34.230521+0000","last_fullsized":"2024-09-20T21:05:34.230521+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:28.649371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.226812+0000","last_change":"2024-09-20T21:03:00.181974+0000","last_active":"2024-09-20T21:05:34.226812+0000","last_peered":"2024-09-20T21:05:34.226812+0000","last_clean":"2024-09-20T21:05:34.226812+0000","last_became_active":"2024-09-20T21:03:00.181499+0000","last_became_peered":"2024-09-20T21:03:00.181499+0000","last_unstale":"2024-09-20T21:05:34.226812+0000","last_undegraded":"2024-09-20T21:05:34.226812+0000","last_fullsized":"2024-09-20T21:05:34.226812+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:51.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.535364+0000","last_change":"2024-09-20T21:05:33.529595+0000","last_active":"2024-09-20T21:05:36.535364+0000","last_peered":"2024-09-20T21:05:36.535364+0000","last_clean":"2024-09-20T21:05:36.535364+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:05:36.535364+0000","last_undegraded":"2024-09-20T21:05:36.535364+0000","last_fullsized":"2024-09-20T21:05:36.535364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:08.234369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533097+0000","last_change":"2024-09-20T21:05:33.516896+0000","last_active":"2024-09-20T21:05:36.533097+0000","last_peered":"2024-09-20T21:05:36.533097+0000","last_clean":"2024-09-20T21:05:36.533097+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:05:36.533097+0000","last_undegraded":"2024-09-20T21:05:36.533097+0000","last_fullsized":"2024-09-20T21:05:36.533097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:48.472114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.225546+0000","last_change":"2024-09-20T21:03:00.187632+0000","last_active":"2024-09-20T21:05:34.225546+0000","last_peered":"2024-09-20T21:05:34.225546+0000","last_clean":"2024-09-20T21:05:34.225546+0000","last_became_active":"2024-09-20T21:03:00.187296+0000","last_became_peered":"2024-09-20T21:03:00.187296+0000","last_unstale":"2024-09-20T21:05:34.225546+0000","last_undegraded":"2024-09-20T21:05:34.225546+0000","last_fullsized":"2024-09-20T21:05:34.225546+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:37.800532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533827+0000","last_change":"2024-09-20T21:05:33.526021+0000","last_active":"2024-09-20T21:05:36.533827+0000","last_peered":"2024-09-20T21:05:36.533827+0000","last_clean":"2024-09-20T21:05:36.533827+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:05:36.533827+0000","last_undegraded":"2024-09-20T21:05:36.533827+0000","last_fullsized":"2024-09-20T21:05:36.533827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:51.022212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532679+0000","last_change":"2024-09-20T21:05:33.526988+0000","last_active":"2024-09-20T21:05:36.532679+0000","last_peered":"2024-09-20T21:05:36.532679+0000","last_clean":"2024-09-20T21:05:36.532679+0000","last_became_active":"2024-09-20T21:05:33.520724+0000","last_became_peered":"2024-09-20T21:05:33.520724+0000","last_unstale":"2024-09-20T21:05:36.532679+0000","last_undegraded":"2024-09-20T21:05:36.532679+0000","last_fullsized":"2024-09-20T21:05:36.532679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:06:25.607129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531399+0000","last_change":"2024-09-20T21:05:33.527599+0000","last_active":"2024-09-20T21:05:36.531399+0000","last_peered":"2024-09-20T21:05:36.531399+0000","last_clean":"2024-09-20T21:05:36.531399+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:05:36.531399+0000","last_undegraded":"2024-09-20T21:05:36.531399+0000","last_fullsized":"2024-09-20T21:05:36.531399+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:19:18.002155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228651+0000","last_change":"2024-09-20T21:03:00.185882+0000","last_active":"2024-09-20T21:05:34.228651+0000","last_peered":"2024-09-20T21:05:34.228651+0000","last_clean":"2024-09-20T21:05:34.228651+0000","last_became_active":"2024-09-20T21:03:00.185539+0000","last_became_peered":"2024-09-20T21:03:00.185539+0000","last_unstale":"2024-09-20T21:05:34.228651+0000","last_undegraded":"2024-09-20T21:05:34.228651+0000","last_fullsized":"2024-09-20T21:05:34.228651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:12:56.727059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227171+0000","last_change":"2024-09-20T21:03:00.186475+0000","last_active":"2024-09-20T21:05:34.227171+0000","last_peered":"2024-09-20T21:05:34.227171+0000","last_clean":"2024-09-20T21:05:34.227171+0000","last_became_active":"2024-09-20T21:03:00.186135+0000","last_became_peered":"2024-09-20T21:03:00.186135+0000","last_unstale":"2024-09-20T21:05:34.227171+0000","last_undegraded":"2024-09-20T21:05:34.227171+0000","last_fullsized":"2024-09-20T21:05:34.227171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:20:50.799154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.544128+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:36.544128+0000","last_peered":"2024-09-20T21:05:36.544128+0000","last_clean":"2024-09-20T21:05:36.544128+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:36.544128+0000","last_undegraded":"2024-09-20T21:05:36.544128+0000","last_fullsized":"2024-09-20T21:05:36.544128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:14:10.131416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.247457+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:05:34.247457+0000","last_peered":"2024-09-20T21:05:34.247457+0000","last_clean":"2024-09-20T21:05:34.247457+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:05:34.247457+0000","last_undegraded":"2024-09-20T21:05:34.247457+0000","last_fullsized":"2024-09-20T21:05:34.247457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:51.509743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-20T21:05:33.217301+0000","last_change":"2024-09-20T21:05:34.231928+0000","last_active":"2024-09-20T21:05:33.217301+0000","last_peered":"2024-09-20T21:05:32.515887+0000","last_clean":"2024-09-20T21:05:32.515887+0000","last_became_active":"2024-09-20T21:03:09.257323+0000","last_became_peered":"2024-09-20T21:03:09.257323+0000","last_unstale":"2024-09-20T21:05:33.217301+0000","last_undegraded":"2024-09-20T21:05:33.217301+0000","last_fullsized":"2024-09-20T21:05:33.217301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533497+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:36.533497+0000","last_peered":"2024-09-20T21:05:36.533497+0000","last_clean":"2024-09-20T21:05:36.533497+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:36.533497+0000","last_undegraded":"2024-09-20T21:05:36.533497+0000","last_fullsized":"2024-09-20T21:05:36.533497+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:17.867418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532954+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:36.532954+0000","last_peered":"2024-09-20T21:05:36.532954+0000","last_clean":"2024-09-20T21:05:36.532954+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:36.532954+0000","last_undegraded":"2024-09-20T21:05:36.532954+0000","last_fullsized":"2024-09-20T21:05:36.532954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:36.753632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533647+0000","last_change":"2024-09-20T21:05:33.529077+0000","last_active":"2024-09-20T21:05:36.533647+0000","last_peered":"2024-09-20T21:05:36.533647+0000","last_clean":"2024-09-20T21:05:36.533647+0000","last_became_active":"2024-09-20T21:05:33.526219+0000","last_became_peered":"2024-09-20T21:05:33.526219+0000","last_unstale":"2024-09-20T21:05:36.533647+0000","last_undegraded":"2024-09-20T21:05:36.533647+0000","last_fullsized":"2024-09-20T21:05:36.533647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:34.906828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.232028+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:34.232028+0000","last_peered":"2024-09-20T21:05:34.232028+0000","last_clean":"2024-09-20T21:05:34.232028+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:34.232028+0000","last_undegraded":"2024-09-20T21:05:34.232028+0000","last_fullsized":"2024-09-20T21:05:34.232028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":138,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228179+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:34.228179+0000","last_peered":"2024-09-20T21:05:34.228179+0000","last_clean":"2024-09-20T21:05:34.228179+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:34.228179+0000","last_undegraded":"2024-09-20T21:05:34.228179+0000","last_fullsized":"2024-09-20T21:05:34.228179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.230088+0000","last_change":"2024-09-20T21:03:00.186296+0000","last_active":"2024-09-20T21:05:34.230088+0000","last_peered":"2024-09-20T21:05:34.230088+0000","last_clean":"2024-09-20T21:05:34.230088+0000","last_became_active":"2024-09-20T21:03:00.185622+0000","last_became_peered":"2024-09-20T21:03:00.185622+0000","last_unstale":"2024-09-20T21:05:34.230088+0000","last_undegraded":"2024-09-20T21:05:34.230088+0000","last_fullsized":"2024-09-20T21:05:34.230088+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.181299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533900+0000","last_change":"2024-09-20T21:05:33.523697+0000","last_active":"2024-09-20T21:05:36.533900+0000","last_peered":"2024-09-20T21:05:36.533900+0000","last_clean":"2024-09-20T21:05:36.533900+0000","last_became_active":"2024-09-20T21:05:33.523128+0000","last_became_peered":"2024-09-20T21:05:33.523128+0000","last_unstale":"2024-09-20T21:05:36.533900+0000","last_undegraded":"2024-09-20T21:05:36.533900+0000","last_fullsized":"2024-09-20T21:05:36.533900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:10.328730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533689+0000","last_change":"2024-09-20T21:05:33.524928+0000","last_active":"2024-09-20T21:05:36.533689+0000","last_peered":"2024-09-20T21:05:36.533689+0000","last_clean":"2024-09-20T21:05:36.533689+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:05:36.533689+0000","last_undegraded":"2024-09-20T21:05:36.533689+0000","last_fullsized":"2024-09-20T21:05:36.533689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:42.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.242174+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:34.242174+0000","last_peered":"2024-09-20T21:05:34.242174+0000","last_clean":"2024-09-20T21:05:34.242174+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:34.242174+0000","last_undegraded":"2024-09-20T21:05:34.242174+0000","last_fullsized":"2024-09-20T21:05:34.242174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530937+0000","last_change":"2024-09-20T21:05:33.525193+0000","last_active":"2024-09-20T21:05:36.530937+0000","last_peered":"2024-09-20T21:05:36.530937+0000","last_clean":"2024-09-20T21:05:36.530937+0000","last_became_active":"2024-09-20T21:05:33.517158+0000","last_became_peered":"2024-09-20T21:05:33.517158+0000","last_unstale":"2024-09-20T21:05:36.530937+0000","last_undegraded":"2024-09-20T21:05:36.530937+0000","last_fullsized":"2024-09-20T21:05:36.530937+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:17.026497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.224489+0000","last_change":"2024-09-20T21:03:00.182713+0000","last_active":"2024-09-20T21:05:34.224489+0000","last_peered":"2024-09-20T21:05:34.224489+0000","last_clean":"2024-09-20T21:05:34.224489+0000","last_became_active":"2024-09-20T21:03:00.181842+0000","last_became_peered":"2024-09-20T21:03:00.181842+0000","last_unstale":"2024-09-20T21:05:34.224489+0000","last_undegraded":"2024-09-20T21:05:34.224489+0000","last_fullsized":"2024-09-20T21:05:34.224489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:26.399209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532765+0000","last_change":"2024-09-20T21:05:33.511797+0000","last_active":"2024-09-20T21:05:36.532765+0000","last_peered":"2024-09-20T21:05:36.532765+0000","last_clean":"2024-09-20T21:05:36.532765+0000","last_became_active":"2024-09-20T21:05:33.509620+0000","last_became_peered":"2024-09-20T21:05:33.509620+0000","last_unstale":"2024-09-20T21:05:36.532765+0000","last_undegraded":"2024-09-20T21:05:36.532765+0000","last_fullsized":"2024-09-20T21:05:36.532765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:33.627527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532594+0000","last_change":"2024-09-20T21:05:33.523555+0000","last_active":"2024-09-20T21:05:36.532594+0000","last_peered":"2024-09-20T21:05:36.532594+0000","last_clean":"2024-09-20T21:05:36.532594+0000","last_became_active":"2024-09-20T21:05:33.517817+0000","last_became_peered":"2024-09-20T21:05:33.517817+0000","last_unstale":"2024-09-20T21:05:36.532594+0000","last_undegraded":"2024-09-20T21:05:36.532594+0000","last_fullsized":"2024-09-20T21:05:36.532594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:16.704262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534986+0000","last_change":"2024-09-20T21:05:33.528984+0000","last_active":"2024-09-20T21:05:36.534986+0000","last_peered":"2024-09-20T21:05:36.534986+0000","last_clean":"2024-09-20T21:05:36.534986+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:05:36.534986+0000","last_undegraded":"2024-09-20T21:05:36.534986+0000","last_fullsized":"2024-09-20T21:05:36.534986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:53.623013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533664+0000","last_change":"2024-09-20T21:05:33.509655+0000","last_active":"2024-09-20T21:05:36.533664+0000","last_peered":"2024-09-20T21:05:36.533664+0000","last_clean":"2024-09-20T21:05:36.533664+0000","last_became_active":"2024-09-20T21:05:33.508551+0000","last_became_peered":"2024-09-20T21:05:33.508551+0000","last_unstale":"2024-09-20T21:05:36.533664+0000","last_undegraded":"2024-09-20T21:05:36.533664+0000","last_fullsized":"2024-09-20T21:05:36.533664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:12.145348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.409003+0000","last_change":"2024-09-20T21:03:09.257334+0000","last_active":"2024-09-20T21:03:29.409003+0000","last_peered":"2024-09-20T21:03:29.409003+0000","last_clean":"2024-09-20T21:03:29.409003+0000","last_became_active":"2024-09-20T21:03:09.256027+0000","last_became_peered":"2024-09-20T21:03:09.256027+0000","last_unstale":"2024-09-20T21:03:29.409003+0000","last_undegraded":"2024-09-20T21:03:29.409003+0000","last_fullsized":"2024-09-20T21:03:29.409003+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:03.468293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.245672+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:34.245672+0000","last_peered":"2024-09-20T21:05:34.245672+0000","last_clean":"2024-09-20T21:05:34.245672+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:34.245672+0000","last_undegraded":"2024-09-20T21:05:34.245672+0000","last_fullsized":"2024-09-20T21:05:34.245672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":140,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.220011+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:34.220011+0000","last_peered":"2024-09-20T21:05:34.220011+0000","last_clean":"2024-09-20T21:05:34.220011+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:34.220011+0000","last_undegraded":"2024-09-20T21:05:34.220011+0000","last_fullsized":"2024-09-20T21:05:34.220011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531154+0000","last_change":"2024-09-20T21:05:33.520634+0000","last_active":"2024-09-20T21:05:36.531154+0000","last_peered":"2024-09-20T21:05:36.531154+0000","last_clean":"2024-09-20T21:05:36.531154+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:05:36.531154+0000","last_undegraded":"2024-09-20T21:05:36.531154+0000","last_fullsized":"2024-09-20T21:05:36.531154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.341860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.231801+0000","last_change":"2024-09-20T21:03:00.182033+0000","last_active":"2024-09-20T21:05:34.231801+0000","last_peered":"2024-09-20T21:05:34.231801+0000","last_clean":"2024-09-20T21:05:34.231801+0000","last_became_active":"2024-09-20T21:03:00.181486+0000","last_became_peered":"2024-09-20T21:03:00.181486+0000","last_unstale":"2024-09-20T21:05:34.231801+0000","last_undegraded":"2024-09-20T21:05:34.231801+0000","last_fullsized":"2024-09-20T21:05:34.231801+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:22.185174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532185+0000","last_change":"2024-09-20T21:05:33.523453+0000","last_active":"2024-09-20T21:05:36.532185+0000","last_peered":"2024-09-20T21:05:36.532185+0000","last_clean":"2024-09-20T21:05:36.532185+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:05:36.532185+0000","last_undegraded":"2024-09-20T21:05:36.532185+0000","last_fullsized":"2024-09-20T21:05:36.532185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:59.275158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.231712+0000","last_change":"2024-09-20T21:03:00.186549+0000","last_active":"2024-09-20T21:05:34.231712+0000","last_peered":"2024-09-20T21:05:34.231712+0000","last_clean":"2024-09-20T21:05:34.231712+0000","last_became_active":"2024-09-20T21:03:00.185982+0000","last_became_peered":"2024-09-20T21:03:00.185982+0000","last_unstale":"2024-09-20T21:05:34.231712+0000","last_undegraded":"2024-09-20T21:05:34.231712+0000","last_fullsized":"2024-09-20T21:05:34.231712+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:44.292273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.265360+0000","last_change":"2024-09-20T21:05:34.265360+0000","last_active":"2024-09-20T21:05:34.265360+0000","last_peered":"2024-09-20T21:05:34.265360+0000","last_clean":"2024-09-20T21:05:34.265360+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:05:34.265360+0000","last_undegraded":"2024-09-20T21:05:34.265360+0000","last_fullsized":"2024-09-20T21:05:34.265360+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:02.949435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.264103+0000","last_change":"2024-09-20T21:05:34.264103+0000","last_active":"2024-09-20T21:05:34.264103+0000","last_peered":"2024-09-20T21:05:34.264103+0000","last_clean":"2024-09-20T21:05:34.264103+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:05:34.264103+0000","last_undegraded":"2024-09-20T21:05:34.264103+0000","last_fullsized":"2024-09-20T21:05:34.264103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.354082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531950+0000","last_change":"2024-09-20T21:05:33.507359+0000","last_active":"2024-09-20T21:05:36.531950+0000","last_peered":"2024-09-20T21:05:36.531950+0000","last_clean":"2024-09-20T21:05:36.531950+0000","last_became_active":"2024-09-20T21:05:33.505749+0000","last_became_peered":"2024-09-20T21:05:33.505749+0000","last_unstale":"2024-09-20T21:05:36.531950+0000","last_undegraded":"2024-09-20T21:05:36.531950+0000","last_fullsized":"2024-09-20T21:05:36.531950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:35.978609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533104+0000","last_change":"2024-09-20T21:05:33.528126+0000","last_active":"2024-09-20T21:05:36.533104+0000","last_peered":"2024-09-20T21:05:36.533104+0000","last_clean":"2024-09-20T21:05:36.533104+0000","last_became_active":"2024-09-20T21:05:33.521052+0000","last_became_peered":"2024-09-20T21:05:33.521052+0000","last_unstale":"2024-09-20T21:05:36.533104+0000","last_undegraded":"2024-09-20T21:05:36.533104+0000","last_fullsized":"2024-09-20T21:05:36.533104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:40.460011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530840+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:36.530840+0000","last_peered":"2024-09-20T21:05:36.530840+0000","last_clean":"2024-09-20T21:05:36.530840+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:36.530840+0000","last_undegraded":"2024-09-20T21:05:36.530840+0000","last_fullsized":"2024-09-20T21:05:36.530840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:41.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533049+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:36.533049+0000","last_peered":"2024-09-20T21:05:36.533049+0000","last_clean":"2024-09-20T21:05:36.533049+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:36.533049+0000","last_undegraded":"2024-09-20T21:05:36.533049+0000","last_fullsized":"2024-09-20T21:05:36.533049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:04.604590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534167+0000","last_change":"2024-09-20T21:05:33.511358+0000","last_active":"2024-09-20T21:05:36.534167+0000","last_peered":"2024-09-20T21:05:36.534167+0000","last_clean":"2024-09-20T21:05:36.534167+0000","last_became_active":"2024-09-20T21:05:33.507647+0000","last_became_peered":"2024-09-20T21:05:33.507647+0000","last_unstale":"2024-09-20T21:05:36.534167+0000","last_undegraded":"2024-09-20T21:05:36.534167+0000","last_fullsized":"2024-09-20T21:05:36.534167+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:44:55.328542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531925+0000","last_change":"2024-09-20T21:05:33.506588+0000","last_active":"2024-09-20T21:05:36.531925+0000","last_peered":"2024-09-20T21:05:36.531925+0000","last_clean":"2024-09-20T21:05:36.531925+0000","last_became_active":"2024-09-20T21:05:33.505615+0000","last_became_peered":"2024-09-20T21:05:33.505615+0000","last_unstale":"2024-09-20T21:05:36.531925+0000","last_undegraded":"2024-09-20T21:05:36.531925+0000","last_fullsized":"2024-09-20T21:05:36.531925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:40.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227924+0000","last_change":"2024-09-20T21:03:00.187291+0000","last_active":"2024-09-20T21:05:34.227924+0000","last_peered":"2024-09-20T21:05:34.227924+0000","last_clean":"2024-09-20T21:05:34.227924+0000","last_became_active":"2024-09-20T21:03:00.186993+0000","last_became_peered":"2024-09-20T21:03:00.186993+0000","last_unstale":"2024-09-20T21:05:34.227924+0000","last_undegraded":"2024-09-20T21:05:34.227924+0000","last_fullsized":"2024-09-20T21:05:34.227924+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:54:14.917606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534439+0000","last_change":"2024-09-20T21:05:33.529620+0000","last_active":"2024-09-20T21:05:36.534439+0000","last_peered":"2024-09-20T21:05:36.534439+0000","last_clean":"2024-09-20T21:05:36.534439+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:05:36.534439+0000","last_undegraded":"2024-09-20T21:05:36.534439+0000","last_fullsized":"2024-09-20T21:05:36.534439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:39.374497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534076+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:36.534076+0000","last_peered":"2024-09-20T21:05:36.534076+0000","last_clean":"2024-09-20T21:05:36.534076+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:36.534076+0000","last_undegraded":"2024-09-20T21:05:36.534076+0000","last_fullsized":"2024-09-20T21:05:36.534076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:30.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533415+0000","last_change":"2024-09-20T21:05:33.516924+0000","last_active":"2024-09-20T21:05:36.533415+0000","last_peered":"2024-09-20T21:05:36.533415+0000","last_clean":"2024-09-20T21:05:36.533415+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:05:36.533415+0000","last_undegraded":"2024-09-20T21:05:36.533415+0000","last_fullsized":"2024-09-20T21:05:36.533415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:55.590471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534471+0000","last_change":"2024-09-20T21:05:33.525586+0000","last_active":"2024-09-20T21:05:36.534471+0000","last_peered":"2024-09-20T21:05:36.534471+0000","last_clean":"2024-09-20T21:05:36.534471+0000","last_became_active":"2024-09-20T21:05:33.522980+0000","last_became_peered":"2024-09-20T21:05:33.522980+0000","last_unstale":"2024-09-20T21:05:36.534471+0000","last_undegraded":"2024-09-20T21:05:36.534471+0000","last_fullsized":"2024-09-20T21:05:36.534471+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:02.419755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.264426+0000","last_change":"2024-09-20T21:05:34.264426+0000","last_active":"2024-09-20T21:05:34.264426+0000","last_peered":"2024-09-20T21:05:34.264426+0000","last_clean":"2024-09-20T21:05:34.264426+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:05:34.264426+0000","last_undegraded":"2024-09-20T21:05:34.264426+0000","last_fullsized":"2024-09-20T21:05:34.264426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:23.886272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534627+0000","last_change":"2024-09-20T21:05:33.517281+0000","last_active":"2024-09-20T21:05:36.534627+0000","last_peered":"2024-09-20T21:05:36.534627+0000","last_clean":"2024-09-20T21:05:36.534627+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:05:36.534627+0000","last_undegraded":"2024-09-20T21:05:36.534627+0000","last_fullsized":"2024-09-20T21:05:36.534627+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:44.497231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531298+0000","last_change":"2024-09-20T21:05:33.523216+0000","last_active":"2024-09-20T21:05:36.531298+0000","last_peered":"2024-09-20T21:05:36.531298+0000","last_clean":"2024-09-20T21:05:36.531298+0000","last_became_active":"2024-09-20T21:05:33.516684+0000","last_became_peered":"2024-09-20T21:05:33.516684+0000","last_unstale":"2024-09-20T21:05:36.531298+0000","last_undegraded":"2024-09-20T21:05:36.531298+0000","last_fullsized":"2024-09-20T21:05:36.531298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:33:12.817332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532390+0000","last_change":"2024-09-20T21:05:33.527473+0000","last_active":"2024-09-20T21:05:36.532390+0000","last_peered":"2024-09-20T21:05:36.532390+0000","last_clean":"2024-09-20T21:05:36.532390+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:05:36.532390+0000","last_undegraded":"2024-09-20T21:05:36.532390+0000","last_fullsized":"2024-09-20T21:05:36.532390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:43.880199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.243835+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:34.243835+0000","last_peered":"2024-09-20T21:05:34.243835+0000","last_clean":"2024-09-20T21:05:34.243835+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:34.243835+0000","last_undegraded":"2024-09-20T21:05:34.243835+0000","last_fullsized":"2024-09-20T21:05:34.243835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:06:41.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532824+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:36.532824+0000","last_peered":"2024-09-20T21:05:36.532824+0000","last_clean":"2024-09-20T21:05:36.532824+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:36.532824+0000","last_undegraded":"2024-09-20T21:05:36.532824+0000","last_fullsized":"2024-09-20T21:05:36.532824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:57.275101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.225029+0000","last_change":"2024-09-20T21:03:00.182491+0000","last_active":"2024-09-20T21:05:34.225029+0000","last_peered":"2024-09-20T21:05:34.225029+0000","last_clean":"2024-09-20T21:05:34.225029+0000","last_became_active":"2024-09-20T21:03:00.181363+0000","last_became_peered":"2024-09-20T21:03:00.181363+0000","last_unstale":"2024-09-20T21:05:34.225029+0000","last_undegraded":"2024-09-20T21:05:34.225029+0000","last_fullsized":"2024-09-20T21:05:34.225029+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:28.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228356+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:05:34.228356+0000","last_peered":"2024-09-20T21:05:34.228356+0000","last_clean":"2024-09-20T21:05:34.228356+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:05:34.228356+0000","last_undegraded":"2024-09-20T21:05:34.228356+0000","last_fullsized":"2024-09-20T21:05:34.228356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":253,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530578+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:36.530578+0000","last_peered":"2024-09-20T21:05:36.530578+0000","last_clean":"2024-09-20T21:05:36.530578+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:36.530578+0000","last_undegraded":"2024-09-20T21:05:36.530578+0000","last_fullsized":"2024-09-20T21:05:36.530578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:49.545054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531068+0000","last_change":"2024-09-20T21:05:33.516926+0000","last_active":"2024-09-20T21:05:36.531068+0000","last_peered":"2024-09-20T21:05:36.531068+0000","last_clean":"2024-09-20T21:05:36.531068+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:05:36.531068+0000","last_undegraded":"2024-09-20T21:05:36.531068+0000","last_fullsized":"2024-09-20T21:05:36.531068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:48.429167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.407874+0000","last_change":"2024-09-20T21:03:09.259033+0000","last_active":"2024-09-20T21:03:29.407874+0000","last_peered":"2024-09-20T21:03:29.407874+0000","last_clean":"2024-09-20T21:03:29.407874+0000","last_became_active":"2024-09-20T21:03:09.255753+0000","last_became_peered":"2024-09-20T21:03:09.255753+0000","last_unstale":"2024-09-20T21:03:29.407874+0000","last_undegraded":"2024-09-20T21:03:29.407874+0000","last_fullsized":"2024-09-20T21:03:29.407874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:06.244010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534837+0000","last_change":"2024-09-20T21:05:33.527863+0000","last_active":"2024-09-20T21:05:36.534837+0000","last_peered":"2024-09-20T21:05:36.534837+0000","last_clean":"2024-09-20T21:05:36.534837+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:05:36.534837+0000","last_undegraded":"2024-09-20T21:05:36.534837+0000","last_fullsized":"2024-09-20T21:05:36.534837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:28.039071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531382+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:36.531382+0000","last_peered":"2024-09-20T21:05:36.531382+0000","last_clean":"2024-09-20T21:05:36.531382+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:36.531382+0000","last_undegraded":"2024-09-20T21:05:36.531382+0000","last_fullsized":"2024-09-20T21:05:36.531382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:58.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530629+0000","last_change":"2024-09-20T21:05:33.517511+0000","last_active":"2024-09-20T21:05:36.530629+0000","last_peered":"2024-09-20T21:05:36.530629+0000","last_clean":"2024-09-20T21:05:36.530629+0000","last_became_active":"2024-09-20T21:05:33.512528+0000","last_became_peered":"2024-09-20T21:05:33.512528+0000","last_unstale":"2024-09-20T21:05:36.530629+0000","last_undegraded":"2024-09-20T21:05:36.530629+0000","last_fullsized":"2024-09-20T21:05:36.530629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:12:56.968567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227583+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:34.227583+0000","last_peered":"2024-09-20T21:05:34.227583+0000","last_clean":"2024-09-20T21:05:34.227583+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:34.227583+0000","last_undegraded":"2024-09-20T21:05:34.227583+0000","last_fullsized":"2024-09-20T21:05:34.227583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221339+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:34.221339+0000","last_peered":"2024-09-20T21:05:34.221339+0000","last_clean":"2024-09-20T21:05:34.221339+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:34.221339+0000","last_undegraded":"2024-09-20T21:05:34.221339+0000","last_fullsized":"2024-09-20T21:05:34.221339+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530710+0000","last_change":"2024-09-20T21:05:33.506109+0000","last_active":"2024-09-20T21:05:36.530710+0000","last_peered":"2024-09-20T21:05:36.530710+0000","last_clean":"2024-09-20T21:05:36.530710+0000","last_became_active":"2024-09-20T21:05:33.505217+0000","last_became_peered":"2024-09-20T21:05:33.505217+0000","last_unstale":"2024-09-20T21:05:36.530710+0000","last_undegraded":"2024-09-20T21:05:36.530710+0000","last_fullsized":"2024-09-20T21:05:36.530710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:35.484677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228392+0000","last_change":"2024-09-20T21:03:00.182222+0000","last_active":"2024-09-20T21:05:34.228392+0000","last_peered":"2024-09-20T21:05:34.228392+0000","last_clean":"2024-09-20T21:05:34.228392+0000","last_became_active":"2024-09-20T21:03:00.181621+0000","last_became_peered":"2024-09-20T21:03:00.181621+0000","last_unstale":"2024-09-20T21:05:34.228392+0000","last_undegraded":"2024-09-20T21:05:34.228392+0000","last_fullsized":"2024-09-20T21:05:34.228392+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:17.147485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530978+0000","last_change":"2024-09-20T21:05:33.525394+0000","last_active":"2024-09-20T21:05:36.530978+0000","last_peered":"2024-09-20T21:05:36.530978+0000","last_clean":"2024-09-20T21:05:36.530978+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:05:36.530978+0000","last_undegraded":"2024-09-20T21:05:36.530978+0000","last_fullsized":"2024-09-20T21:05:36.530978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:51:33.922257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531598+0000","last_change":"2024-09-20T21:05:33.522984+0000","last_active":"2024-09-20T21:05:36.531598+0000","last_peered":"2024-09-20T21:05:36.531598+0000","last_clean":"2024-09-20T21:05:36.531598+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:05:36.531598+0000","last_undegraded":"2024-09-20T21:05:36.531598+0000","last_fullsized":"2024-09-20T21:05:36.531598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:22:14.870718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227653+0000","last_change":"2024-09-20T21:03:00.181764+0000","last_active":"2024-09-20T21:05:34.227653+0000","last_peered":"2024-09-20T21:05:34.227653+0000","last_clean":"2024-09-20T21:05:34.227653+0000","last_became_active":"2024-09-20T21:03:00.181125+0000","last_became_peered":"2024-09-20T21:03:00.181125+0000","last_unstale":"2024-09-20T21:05:34.227653+0000","last_undegraded":"2024-09-20T21:05:34.227653+0000","last_fullsized":"2024-09-20T21:05:34.227653+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:58.632807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531763+0000","last_change":"2024-09-20T21:05:33.530100+0000","last_active":"2024-09-20T21:05:36.531763+0000","last_peered":"2024-09-20T21:05:36.531763+0000","last_clean":"2024-09-20T21:05:36.531763+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:05:36.531763+0000","last_undegraded":"2024-09-20T21:05:36.531763+0000","last_fullsized":"2024-09-20T21:05:36.531763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:12.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221816+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:34.221816+0000","last_peered":"2024-09-20T21:05:34.221816+0000","last_clean":"2024-09-20T21:05:34.221816+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:34.221816+0000","last_undegraded":"2024-09-20T21:05:34.221816+0000","last_fullsized":"2024-09-20T21:05:34.221816+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.241501+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:34.241501+0000","last_peered":"2024-09-20T21:05:34.241501+0000","last_clean":"2024-09-20T21:05:34.241501+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:34.241501+0000","last_undegraded":"2024-09-20T21:05:34.241501+0000","last_fullsized":"2024-09-20T21:05:34.241501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:03.961332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221558+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:34.221558+0000","last_peered":"2024-09-20T21:05:34.221558+0000","last_clean":"2024-09-20T21:05:34.221558+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:34.221558+0000","last_undegraded":"2024-09-20T21:05:34.221558+0000","last_fullsized":"2024-09-20T21:05:34.221558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.233180+0000","last_change":"2024-09-20T21:03:00.186668+0000","last_active":"2024-09-20T21:05:34.233180+0000","last_peered":"2024-09-20T21:05:34.233180+0000","last_clean":"2024-09-20T21:05:34.233180+0000","last_became_active":"2024-09-20T21:03:00.186259+0000","last_became_peered":"2024-09-20T21:03:00.186259+0000","last_unstale":"2024-09-20T21:05:34.233180+0000","last_undegraded":"2024-09-20T21:05:34.233180+0000","last_fullsized":"2024-09-20T21:05:34.233180+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:42:58.237986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533928+0000","last_change":"2024-09-20T21:05:33.509455+0000","last_active":"2024-09-20T21:05:36.533928+0000","last_peered":"2024-09-20T21:05:36.533928+0000","last_clean":"2024-09-20T21:05:36.533928+0000","last_became_active":"2024-09-20T21:05:33.508553+0000","last_became_peered":"2024-09-20T21:05:33.508553+0000","last_unstale":"2024-09-20T21:05:36.533928+0000","last_undegraded":"2024-09-20T21:05:36.533928+0000","last_fullsized":"2024-09-20T21:05:36.533928+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:16:44.519386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.232515+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:34.232515+0000","last_peered":"2024-09-20T21:05:34.232515+0000","last_clean":"2024-09-20T21:05:34.232515+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:34.232515+0000","last_undegraded":"2024-09-20T21:05:34.232515+0000","last_fullsized":"2024-09-20T21:05:34.232515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.232770+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:05:34.232770+0000","last_peered":"2024-09-20T21:05:34.232770+0000","last_clean":"2024-09-20T21:05:34.232770+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:05:34.232770+0000","last_undegraded":"2024-09-20T21:05:34.232770+0000","last_fullsized":"2024-09-20T21:05:34.232770+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.407367+0000","last_change":"2024-09-20T21:03:09.320426+0000","last_active":"2024-09-20T21:03:29.407367+0000","last_peered":"2024-09-20T21:03:29.407367+0000","last_clean":"2024-09-20T21:03:29.407367+0000","last_became_active":"2024-09-20T21:03:09.319266+0000","last_became_peered":"2024-09-20T21:03:09.319266+0000","last_unstale":"2024-09-20T21:03:29.407367+0000","last_undegraded":"2024-09-20T21:03:29.407367+0000","last_fullsized":"2024-09-20T21:03:29.407367+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:35:35.196344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.269917+0000","last_change":"2024-09-20T21:05:34.264862+0000","last_active":"2024-09-20T21:05:34.269917+0000","last_peered":"2024-09-20T21:05:34.269917+0000","last_clean":"2024-09-20T21:05:34.269917+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:05:34.269917+0000","last_undegraded":"2024-09-20T21:05:34.269917+0000","last_fullsized":"2024-09-20T21:05:34.269917+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:32.512356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532164+0000","last_change":"2024-09-20T21:05:33.508633+0000","last_active":"2024-09-20T21:05:36.532164+0000","last_peered":"2024-09-20T21:05:36.532164+0000","last_clean":"2024-09-20T21:05:36.532164+0000","last_became_active":"2024-09-20T21:05:33.505595+0000","last_became_peered":"2024-09-20T21:05:33.505595+0000","last_unstale":"2024-09-20T21:05:36.532164+0000","last_undegraded":"2024-09-20T21:05:36.532164+0000","last_fullsized":"2024-09-20T21:05:36.532164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:10.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532027+0000","last_change":"2024-09-20T21:05:33.507358+0000","last_active":"2024-09-20T21:05:36.532027+0000","last_peered":"2024-09-20T21:05:36.532027+0000","last_clean":"2024-09-20T21:05:36.532027+0000","last_became_active":"2024-09-20T21:05:33.506544+0000","last_became_peered":"2024-09-20T21:05:33.506544+0000","last_unstale":"2024-09-20T21:05:36.532027+0000","last_undegraded":"2024-09-20T21:05:36.532027+0000","last_fullsized":"2024-09-20T21:05:36.532027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:00.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533106+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:36.533106+0000","last_peered":"2024-09-20T21:05:36.533106+0000","last_clean":"2024-09-20T21:05:36.533106+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:36.533106+0000","last_undegraded":"2024-09-20T21:05:36.533106+0000","last_fullsized":"2024-09-20T21:05:36.533106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:49.172273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532044+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:36.532044+0000","last_peered":"2024-09-20T21:05:36.532044+0000","last_clean":"2024-09-20T21:05:36.532044+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:36.532044+0000","last_undegraded":"2024-09-20T21:05:36.532044+0000","last_fullsized":"2024-09-20T21:05:36.532044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:07:07.242939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221325+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:05:34.221325+0000","last_peered":"2024-09-20T21:05:34.221325+0000","last_clean":"2024-09-20T21:05:34.221325+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:05:34.221325+0000","last_undegraded":"2024-09-20T21:05:34.221325+0000","last_fullsized":"2024-09-20T21:05:34.221325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534923+0000","last_change":"2024-09-20T21:05:33.528236+0000","last_active":"2024-09-20T21:05:36.534923+0000","last_peered":"2024-09-20T21:05:36.534923+0000","last_clean":"2024-09-20T21:05:36.534923+0000","last_became_active":"2024-09-20T21:05:33.516911+0000","last_became_peered":"2024-09-20T21:05:33.516911+0000","last_unstale":"2024-09-20T21:05:36.534923+0000","last_undegraded":"2024-09-20T21:05:36.534923+0000","last_fullsized":"2024-09-20T21:05:36.534923+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:52.563724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532440+0000","last_change":"2024-09-20T21:05:33.525151+0000","last_active":"2024-09-20T21:05:36.532440+0000","last_peered":"2024-09-20T21:05:36.532440+0000","last_clean":"2024-09-20T21:05:36.532440+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:05:36.532440+0000","last_undegraded":"2024-09-20T21:05:36.532440+0000","last_fullsized":"2024-09-20T21:05:36.532440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:51.245496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531752+0000","last_change":"2024-09-20T21:05:33.525313+0000","last_active":"2024-09-20T21:05:36.531752+0000","last_peered":"2024-09-20T21:05:36.531752+0000","last_clean":"2024-09-20T21:05:36.531752+0000","last_became_active":"2024-09-20T21:05:33.517931+0000","last_became_peered":"2024-09-20T21:05:33.517931+0000","last_unstale":"2024-09-20T21:05:36.531752+0000","last_undegraded":"2024-09-20T21:05:36.531752+0000","last_fullsized":"2024-09-20T21:05:36.531752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:15.962153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.264735+0000","last_change":"2024-09-20T21:05:34.264735+0000","last_active":"2024-09-20T21:05:34.264735+0000","last_peered":"2024-09-20T21:05:34.264735+0000","last_clean":"2024-09-20T21:05:34.264735+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:05:34.264735+0000","last_undegraded":"2024-09-20T21:05:34.264735+0000","last_fullsized":"2024-09-20T21:05:34.264735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:16.718841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-20T21:05:33.209748+0000","last_change":"2024-09-20T21:05:34.225456+0000","last_active":"2024-09-20T21:05:33.209748+0000","last_peered":"2024-09-20T21:05:32.514387+0000","last_clean":"2024-09-20T21:05:32.514387+0000","last_became_active":"2024-09-20T21:03:09.319134+0000","last_became_peered":"2024-09-20T21:03:09.319134+0000","last_unstale":"2024-09-20T21:05:33.209748+0000","last_undegraded":"2024-09-20T21:05:33.209748+0000","last_fullsized":"2024-09-20T21:05:33.209748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.248368+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:34.248368+0000","last_peered":"2024-09-20T21:05:34.248368+0000","last_clean":"2024-09-20T21:05:34.248368+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:34.248368+0000","last_undegraded":"2024-09-20T21:05:34.248368+0000","last_fullsized":"2024-09-20T21:05:34.248368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:39.486200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.413291+0000","last_change":"2024-09-20T21:03:09.320997+0000","last_active":"2024-09-20T21:03:29.413291+0000","last_peered":"2024-09-20T21:03:29.413291+0000","last_clean":"2024-09-20T21:03:29.413291+0000","last_became_active":"2024-09-20T21:03:09.319756+0000","last_became_peered":"2024-09-20T21:03:09.319756+0000","last_unstale":"2024-09-20T21:03:29.413291+0000","last_undegraded":"2024-09-20T21:03:29.413291+0000","last_fullsized":"2024-09-20T21:03:29.413291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:16:30.171477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532245+0000","last_change":"2024-09-20T21:05:33.525291+0000","last_active":"2024-09-20T21:05:36.532245+0000","last_peered":"2024-09-20T21:05:36.532245+0000","last_clean":"2024-09-20T21:05:36.532245+0000","last_became_active":"2024-09-20T21:05:33.523537+0000","last_became_peered":"2024-09-20T21:05:33.523537+0000","last_unstale":"2024-09-20T21:05:36.532245+0000","last_undegraded":"2024-09-20T21:05:36.532245+0000","last_fullsized":"2024-09-20T21:05:36.532245+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:42.985077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.540422+0000","last_change":"2024-09-20T21:05:36.539030+0000","last_active":"2024-09-20T21:05:36.540422+0000","last_peered":"2024-09-20T21:05:36.540422+0000","last_clean":"2024-09-20T21:05:36.540422+0000","last_became_active":"2024-09-20T21:05:36.538325+0000","last_became_peered":"2024-09-20T21:05:36.538325+0000","last_unstale":"2024-09-20T21:05:36.540422+0000","last_undegraded":"2024-09-20T21:05:36.540422+0000","last_fullsized":"2024-09-20T21:05:36.540422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:48.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532065+0000","last_change":"2024-09-20T21:05:33.528150+0000","last_active":"2024-09-20T21:05:36.532065+0000","last_peered":"2024-09-20T21:05:36.532065+0000","last_clean":"2024-09-20T21:05:36.532065+0000","last_became_active":"2024-09-20T21:05:33.512623+0000","last_became_peered":"2024-09-20T21:05:33.512623+0000","last_unstale":"2024-09-20T21:05:36.532065+0000","last_undegraded":"2024-09-20T21:05:36.532065+0000","last_fullsized":"2024-09-20T21:05:36.532065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:08.142904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227511+0000","last_change":"2024-09-20T21:03:00.182809+0000","last_active":"2024-09-20T21:05:34.227511+0000","last_peered":"2024-09-20T21:05:34.227511+0000","last_clean":"2024-09-20T21:05:34.227511+0000","last_became_active":"2024-09-20T21:03:00.182423+0000","last_became_peered":"2024-09-20T21:03:00.182423+0000","last_unstale":"2024-09-20T21:05:34.227511+0000","last_undegraded":"2024-09-20T21:05:34.227511+0000","last_fullsized":"2024-09-20T21:05:34.227511+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:26.732116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":91,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.412991+0000","last_change":"2024-09-20T21:03:09.257671+0000","last_active":"2024-09-20T21:03:29.412991+0000","last_peered":"2024-09-20T21:03:29.412991+0000","last_clean":"2024-09-20T21:03:29.412991+0000","last_became_active":"2024-09-20T21:03:09.256538+0000","last_became_peered":"2024-09-20T21:03:09.256538+0000","last_unstale":"2024-09-20T21:03:29.412991+0000","last_undegraded":"2024-09-20T21:03:29.412991+0000","last_fullsized":"2024-09-20T21:03:29.412991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:41.755432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534768+0000","last_change":"2024-09-20T21:05:33.508991+0000","last_active":"2024-09-20T21:05:36.534768+0000","last_peered":"2024-09-20T21:05:36.534768+0000","last_clean":"2024-09-20T21:05:36.534768+0000","last_became_active":"2024-09-20T21:05:33.507155+0000","last_became_peered":"2024-09-20T21:05:33.507155+0000","last_unstale":"2024-09-20T21:05:36.534768+0000","last_undegraded":"2024-09-20T21:05:36.534768+0000","last_fullsized":"2024-09-20T21:05:36.534768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:04:20.632178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532969+0000","last_change":"2024-09-20T21:05:33.523783+0000","last_active":"2024-09-20T21:05:36.532969+0000","last_peered":"2024-09-20T21:05:36.532969+0000","last_clean":"2024-09-20T21:05:36.532969+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:05:36.532969+0000","last_undegraded":"2024-09-20T21:05:36.532969+0000","last_fullsized":"2024-09-20T21:05:36.532969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:29.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.560617+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:36.560617+0000","last_peered":"2024-09-20T21:05:36.560617+0000","last_clean":"2024-09-20T21:05:36.560617+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:36.560617+0000","last_undegraded":"2024-09-20T21:05:36.560617+0000","last_fullsized":"2024-09-20T21:05:36.560617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:45:47.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533560+0000","last_change":"2024-09-20T21:05:33.525036+0000","last_active":"2024-09-20T21:05:36.533560+0000","last_peered":"2024-09-20T21:05:36.533560+0000","last_clean":"2024-09-20T21:05:36.533560+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:05:36.533560+0000","last_undegraded":"2024-09-20T21:05:36.533560+0000","last_fullsized":"2024-09-20T21:05:36.533560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:13.120671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531493+0000","last_change":"2024-09-20T21:05:33.525496+0000","last_active":"2024-09-20T21:05:36.531493+0000","last_peered":"2024-09-20T21:05:36.531493+0000","last_clean":"2024-09-20T21:05:36.531493+0000","last_became_active":"2024-09-20T21:05:33.511914+0000","last_became_peered":"2024-09-20T21:05:33.511914+0000","last_unstale":"2024-09-20T21:05:36.531493+0000","last_undegraded":"2024-09-20T21:05:36.531493+0000","last_fullsized":"2024-09-20T21:05:36.531493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:47:40.771092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.229962+0000","last_change":"2024-09-20T21:03:00.186986+0000","last_active":"2024-09-20T21:05:34.229962+0000","last_peered":"2024-09-20T21:05:34.229962+0000","last_clean":"2024-09-20T21:05:34.229962+0000","last_became_active":"2024-09-20T21:03:00.186450+0000","last_became_peered":"2024-09-20T21:03:00.186450+0000","last_unstale":"2024-09-20T21:05:34.229962+0000","last_undegraded":"2024-09-20T21:05:34.229962+0000","last_fullsized":"2024-09-20T21:05:34.229962+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:16:39.776258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.231725+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:34.231725+0000","last_peered":"2024-09-20T21:05:34.231725+0000","last_clean":"2024-09-20T21:05:34.231725+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:34.231725+0000","last_undegraded":"2024-09-20T21:05:34.231725+0000","last_fullsized":"2024-09-20T21:05:34.231725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534323+0000","last_change":"2024-09-20T21:05:33.529399+0000","last_active":"2024-09-20T21:05:36.534323+0000","last_peered":"2024-09-20T21:05:36.534323+0000","last_clean":"2024-09-20T21:05:36.534323+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:05:36.534323+0000","last_undegraded":"2024-09-20T21:05:36.534323+0000","last_fullsized":"2024-09-20T21:05:36.534323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:36.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.552715+0000","last_change":"2024-09-20T21:05:36.551627+0000","last_active":"2024-09-20T21:05:36.552715+0000","last_peered":"2024-09-20T21:05:36.552715+0000","last_clean":"2024-09-20T21:05:36.552715+0000","last_became_active":"2024-09-20T21:05:36.542121+0000","last_became_peered":"2024-09-20T21:05:36.542121+0000","last_unstale":"2024-09-20T21:05:36.552715+0000","last_undegraded":"2024-09-20T21:05:36.552715+0000","last_fullsized":"2024-09-20T21:05:36.552715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:30.528499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":125,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":62,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738427,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216828,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94155012,"statfs":{"total":96636764160,"available":96414732288,"internally_reserved":0,"allocated":1024000,"data_stored":949633,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350978,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54556,"kb_used_data":1024,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317284,"statfs":{"total":96636764160,"available":96580898816,"internally_reserved":0,"allocated":1048576,"data_stored":958389,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325048,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046792,"statfs":{"total":96636764160,"available":96303915008,"internally_reserved":0,"allocated":946176,"data_stored":357524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:05:38.970 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-20T21:05:39.357 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:39.357 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":289,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":86,"num_osds":3,"num_up_osds":3,"osd_up_since":1726866333,"num_in_osds":3,"osd_in_since":1726866051,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":98},{"state_name":"active+clean+remapped","count":5},{"state_name":"peering","count":2}],"num_pgs":105,"num_pools":4,"num_objects":26,"data_bytes":592797,"bytes_used":610746368,"bytes_avail":289299546112,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763},"fsmap":{"epoch":5,"btime":"2024-09-20T21:01:14:206337+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4204}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-20T21:02:20.878896+0000","services":{}},"progress_events":{}} 2024-09-20T21:05:39.375 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-20T21:05:39.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:05:39.685 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:39.687 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:05:39.705 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-09-20T21:05:38.985711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":205,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596432,"kb_used_data":2948,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282519088,"statfs":{"total":289910292480,"available":289299546112,"internally_reserved":0,"allocated":3018752,"data_stored":2265546,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-22,"num_objects_misplaced":-3,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002222"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.230521+0000","last_change":"2024-09-20T21:03:00.185875+0000","last_active":"2024-09-20T21:05:34.230521+0000","last_peered":"2024-09-20T21:05:34.230521+0000","last_clean":"2024-09-20T21:05:34.230521+0000","last_became_active":"2024-09-20T21:03:00.185497+0000","last_became_peered":"2024-09-20T21:03:00.185497+0000","last_unstale":"2024-09-20T21:05:34.230521+0000","last_undegraded":"2024-09-20T21:05:34.230521+0000","last_fullsized":"2024-09-20T21:05:34.230521+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:28.649371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.226812+0000","last_change":"2024-09-20T21:03:00.181974+0000","last_active":"2024-09-20T21:05:34.226812+0000","last_peered":"2024-09-20T21:05:34.226812+0000","last_clean":"2024-09-20T21:05:34.226812+0000","last_became_active":"2024-09-20T21:03:00.181499+0000","last_became_peered":"2024-09-20T21:03:00.181499+0000","last_unstale":"2024-09-20T21:05:34.226812+0000","last_undegraded":"2024-09-20T21:05:34.226812+0000","last_fullsized":"2024-09-20T21:05:34.226812+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:51.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.535364+0000","last_change":"2024-09-20T21:05:33.529595+0000","last_active":"2024-09-20T21:05:36.535364+0000","last_peered":"2024-09-20T21:05:36.535364+0000","last_clean":"2024-09-20T21:05:36.535364+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:05:36.535364+0000","last_undegraded":"2024-09-20T21:05:36.535364+0000","last_fullsized":"2024-09-20T21:05:36.535364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:08.234369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533097+0000","last_change":"2024-09-20T21:05:33.516896+0000","last_active":"2024-09-20T21:05:36.533097+0000","last_peered":"2024-09-20T21:05:36.533097+0000","last_clean":"2024-09-20T21:05:36.533097+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:05:36.533097+0000","last_undegraded":"2024-09-20T21:05:36.533097+0000","last_fullsized":"2024-09-20T21:05:36.533097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:48.472114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.225546+0000","last_change":"2024-09-20T21:03:00.187632+0000","last_active":"2024-09-20T21:05:34.225546+0000","last_peered":"2024-09-20T21:05:34.225546+0000","last_clean":"2024-09-20T21:05:34.225546+0000","last_became_active":"2024-09-20T21:03:00.187296+0000","last_became_peered":"2024-09-20T21:03:00.187296+0000","last_unstale":"2024-09-20T21:05:34.225546+0000","last_undegraded":"2024-09-20T21:05:34.225546+0000","last_fullsized":"2024-09-20T21:05:34.225546+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:37.800532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533827+0000","last_change":"2024-09-20T21:05:33.526021+0000","last_active":"2024-09-20T21:05:36.533827+0000","last_peered":"2024-09-20T21:05:36.533827+0000","last_clean":"2024-09-20T21:05:36.533827+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:05:36.533827+0000","last_undegraded":"2024-09-20T21:05:36.533827+0000","last_fullsized":"2024-09-20T21:05:36.533827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:51.022212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532679+0000","last_change":"2024-09-20T21:05:33.526988+0000","last_active":"2024-09-20T21:05:36.532679+0000","last_peered":"2024-09-20T21:05:36.532679+0000","last_clean":"2024-09-20T21:05:36.532679+0000","last_became_active":"2024-09-20T21:05:33.520724+0000","last_became_peered":"2024-09-20T21:05:33.520724+0000","last_unstale":"2024-09-20T21:05:36.532679+0000","last_undegraded":"2024-09-20T21:05:36.532679+0000","last_fullsized":"2024-09-20T21:05:36.532679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:06:25.607129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531399+0000","last_change":"2024-09-20T21:05:33.527599+0000","last_active":"2024-09-20T21:05:36.531399+0000","last_peered":"2024-09-20T21:05:36.531399+0000","last_clean":"2024-09-20T21:05:36.531399+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:05:36.531399+0000","last_undegraded":"2024-09-20T21:05:36.531399+0000","last_fullsized":"2024-09-20T21:05:36.531399+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:19:18.002155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228651+0000","last_change":"2024-09-20T21:03:00.185882+0000","last_active":"2024-09-20T21:05:34.228651+0000","last_peered":"2024-09-20T21:05:34.228651+0000","last_clean":"2024-09-20T21:05:34.228651+0000","last_became_active":"2024-09-20T21:03:00.185539+0000","last_became_peered":"2024-09-20T21:03:00.185539+0000","last_unstale":"2024-09-20T21:05:34.228651+0000","last_undegraded":"2024-09-20T21:05:34.228651+0000","last_fullsized":"2024-09-20T21:05:34.228651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:12:56.727059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227171+0000","last_change":"2024-09-20T21:03:00.186475+0000","last_active":"2024-09-20T21:05:34.227171+0000","last_peered":"2024-09-20T21:05:34.227171+0000","last_clean":"2024-09-20T21:05:34.227171+0000","last_became_active":"2024-09-20T21:03:00.186135+0000","last_became_peered":"2024-09-20T21:03:00.186135+0000","last_unstale":"2024-09-20T21:05:34.227171+0000","last_undegraded":"2024-09-20T21:05:34.227171+0000","last_fullsized":"2024-09-20T21:05:34.227171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:20:50.799154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.544128+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:36.544128+0000","last_peered":"2024-09-20T21:05:36.544128+0000","last_clean":"2024-09-20T21:05:36.544128+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:36.544128+0000","last_undegraded":"2024-09-20T21:05:36.544128+0000","last_fullsized":"2024-09-20T21:05:36.544128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:14:10.131416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.247457+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:05:34.247457+0000","last_peered":"2024-09-20T21:05:34.247457+0000","last_clean":"2024-09-20T21:05:34.247457+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:05:34.247457+0000","last_undegraded":"2024-09-20T21:05:34.247457+0000","last_fullsized":"2024-09-20T21:05:34.247457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:51.509743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-20T21:05:33.217301+0000","last_change":"2024-09-20T21:05:34.231928+0000","last_active":"2024-09-20T21:05:33.217301+0000","last_peered":"2024-09-20T21:05:32.515887+0000","last_clean":"2024-09-20T21:05:32.515887+0000","last_became_active":"2024-09-20T21:03:09.257323+0000","last_became_peered":"2024-09-20T21:03:09.257323+0000","last_unstale":"2024-09-20T21:05:33.217301+0000","last_undegraded":"2024-09-20T21:05:33.217301+0000","last_fullsized":"2024-09-20T21:05:33.217301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533497+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:36.533497+0000","last_peered":"2024-09-20T21:05:36.533497+0000","last_clean":"2024-09-20T21:05:36.533497+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:36.533497+0000","last_undegraded":"2024-09-20T21:05:36.533497+0000","last_fullsized":"2024-09-20T21:05:36.533497+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:17.867418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532954+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:36.532954+0000","last_peered":"2024-09-20T21:05:36.532954+0000","last_clean":"2024-09-20T21:05:36.532954+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:36.532954+0000","last_undegraded":"2024-09-20T21:05:36.532954+0000","last_fullsized":"2024-09-20T21:05:36.532954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:36.753632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533647+0000","last_change":"2024-09-20T21:05:33.529077+0000","last_active":"2024-09-20T21:05:36.533647+0000","last_peered":"2024-09-20T21:05:36.533647+0000","last_clean":"2024-09-20T21:05:36.533647+0000","last_became_active":"2024-09-20T21:05:33.526219+0000","last_became_peered":"2024-09-20T21:05:33.526219+0000","last_unstale":"2024-09-20T21:05:36.533647+0000","last_undegraded":"2024-09-20T21:05:36.533647+0000","last_fullsized":"2024-09-20T21:05:36.533647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:34.906828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.232028+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:34.232028+0000","last_peered":"2024-09-20T21:05:34.232028+0000","last_clean":"2024-09-20T21:05:34.232028+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:34.232028+0000","last_undegraded":"2024-09-20T21:05:34.232028+0000","last_fullsized":"2024-09-20T21:05:34.232028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":138,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228179+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:34.228179+0000","last_peered":"2024-09-20T21:05:34.228179+0000","last_clean":"2024-09-20T21:05:34.228179+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:34.228179+0000","last_undegraded":"2024-09-20T21:05:34.228179+0000","last_fullsized":"2024-09-20T21:05:34.228179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.230088+0000","last_change":"2024-09-20T21:03:00.186296+0000","last_active":"2024-09-20T21:05:34.230088+0000","last_peered":"2024-09-20T21:05:34.230088+0000","last_clean":"2024-09-20T21:05:34.230088+0000","last_became_active":"2024-09-20T21:03:00.185622+0000","last_became_peered":"2024-09-20T21:03:00.185622+0000","last_unstale":"2024-09-20T21:05:34.230088+0000","last_undegraded":"2024-09-20T21:05:34.230088+0000","last_fullsized":"2024-09-20T21:05:34.230088+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.181299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533900+0000","last_change":"2024-09-20T21:05:33.523697+0000","last_active":"2024-09-20T21:05:36.533900+0000","last_peered":"2024-09-20T21:05:36.533900+0000","last_clean":"2024-09-20T21:05:36.533900+0000","last_became_active":"2024-09-20T21:05:33.523128+0000","last_became_peered":"2024-09-20T21:05:33.523128+0000","last_unstale":"2024-09-20T21:05:36.533900+0000","last_undegraded":"2024-09-20T21:05:36.533900+0000","last_fullsized":"2024-09-20T21:05:36.533900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:10.328730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533689+0000","last_change":"2024-09-20T21:05:33.524928+0000","last_active":"2024-09-20T21:05:36.533689+0000","last_peered":"2024-09-20T21:05:36.533689+0000","last_clean":"2024-09-20T21:05:36.533689+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:05:36.533689+0000","last_undegraded":"2024-09-20T21:05:36.533689+0000","last_fullsized":"2024-09-20T21:05:36.533689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:42.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.242174+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:34.242174+0000","last_peered":"2024-09-20T21:05:34.242174+0000","last_clean":"2024-09-20T21:05:34.242174+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:34.242174+0000","last_undegraded":"2024-09-20T21:05:34.242174+0000","last_fullsized":"2024-09-20T21:05:34.242174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530937+0000","last_change":"2024-09-20T21:05:33.525193+0000","last_active":"2024-09-20T21:05:36.530937+0000","last_peered":"2024-09-20T21:05:36.530937+0000","last_clean":"2024-09-20T21:05:36.530937+0000","last_became_active":"2024-09-20T21:05:33.517158+0000","last_became_peered":"2024-09-20T21:05:33.517158+0000","last_unstale":"2024-09-20T21:05:36.530937+0000","last_undegraded":"2024-09-20T21:05:36.530937+0000","last_fullsized":"2024-09-20T21:05:36.530937+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:17.026497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.224489+0000","last_change":"2024-09-20T21:03:00.182713+0000","last_active":"2024-09-20T21:05:34.224489+0000","last_peered":"2024-09-20T21:05:34.224489+0000","last_clean":"2024-09-20T21:05:34.224489+0000","last_became_active":"2024-09-20T21:03:00.181842+0000","last_became_peered":"2024-09-20T21:03:00.181842+0000","last_unstale":"2024-09-20T21:05:34.224489+0000","last_undegraded":"2024-09-20T21:05:34.224489+0000","last_fullsized":"2024-09-20T21:05:34.224489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:26.399209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532765+0000","last_change":"2024-09-20T21:05:33.511797+0000","last_active":"2024-09-20T21:05:36.532765+0000","last_peered":"2024-09-20T21:05:36.532765+0000","last_clean":"2024-09-20T21:05:36.532765+0000","last_became_active":"2024-09-20T21:05:33.509620+0000","last_became_peered":"2024-09-20T21:05:33.509620+0000","last_unstale":"2024-09-20T21:05:36.532765+0000","last_undegraded":"2024-09-20T21:05:36.532765+0000","last_fullsized":"2024-09-20T21:05:36.532765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:33.627527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532594+0000","last_change":"2024-09-20T21:05:33.523555+0000","last_active":"2024-09-20T21:05:36.532594+0000","last_peered":"2024-09-20T21:05:36.532594+0000","last_clean":"2024-09-20T21:05:36.532594+0000","last_became_active":"2024-09-20T21:05:33.517817+0000","last_became_peered":"2024-09-20T21:05:33.517817+0000","last_unstale":"2024-09-20T21:05:36.532594+0000","last_undegraded":"2024-09-20T21:05:36.532594+0000","last_fullsized":"2024-09-20T21:05:36.532594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:16.704262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534986+0000","last_change":"2024-09-20T21:05:33.528984+0000","last_active":"2024-09-20T21:05:36.534986+0000","last_peered":"2024-09-20T21:05:36.534986+0000","last_clean":"2024-09-20T21:05:36.534986+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:05:36.534986+0000","last_undegraded":"2024-09-20T21:05:36.534986+0000","last_fullsized":"2024-09-20T21:05:36.534986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:53.623013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533664+0000","last_change":"2024-09-20T21:05:33.509655+0000","last_active":"2024-09-20T21:05:36.533664+0000","last_peered":"2024-09-20T21:05:36.533664+0000","last_clean":"2024-09-20T21:05:36.533664+0000","last_became_active":"2024-09-20T21:05:33.508551+0000","last_became_peered":"2024-09-20T21:05:33.508551+0000","last_unstale":"2024-09-20T21:05:36.533664+0000","last_undegraded":"2024-09-20T21:05:36.533664+0000","last_fullsized":"2024-09-20T21:05:36.533664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:12.145348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.409003+0000","last_change":"2024-09-20T21:03:09.257334+0000","last_active":"2024-09-20T21:03:29.409003+0000","last_peered":"2024-09-20T21:03:29.409003+0000","last_clean":"2024-09-20T21:03:29.409003+0000","last_became_active":"2024-09-20T21:03:09.256027+0000","last_became_peered":"2024-09-20T21:03:09.256027+0000","last_unstale":"2024-09-20T21:03:29.409003+0000","last_undegraded":"2024-09-20T21:03:29.409003+0000","last_fullsized":"2024-09-20T21:03:29.409003+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:03.468293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.245672+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:34.245672+0000","last_peered":"2024-09-20T21:05:34.245672+0000","last_clean":"2024-09-20T21:05:34.245672+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:34.245672+0000","last_undegraded":"2024-09-20T21:05:34.245672+0000","last_fullsized":"2024-09-20T21:05:34.245672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":140,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.220011+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:34.220011+0000","last_peered":"2024-09-20T21:05:34.220011+0000","last_clean":"2024-09-20T21:05:34.220011+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:34.220011+0000","last_undegraded":"2024-09-20T21:05:34.220011+0000","last_fullsized":"2024-09-20T21:05:34.220011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531154+0000","last_change":"2024-09-20T21:05:33.520634+0000","last_active":"2024-09-20T21:05:36.531154+0000","last_peered":"2024-09-20T21:05:36.531154+0000","last_clean":"2024-09-20T21:05:36.531154+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:05:36.531154+0000","last_undegraded":"2024-09-20T21:05:36.531154+0000","last_fullsized":"2024-09-20T21:05:36.531154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.341860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.231801+0000","last_change":"2024-09-20T21:03:00.182033+0000","last_active":"2024-09-20T21:05:34.231801+0000","last_peered":"2024-09-20T21:05:34.231801+0000","last_clean":"2024-09-20T21:05:34.231801+0000","last_became_active":"2024-09-20T21:03:00.181486+0000","last_became_peered":"2024-09-20T21:03:00.181486+0000","last_unstale":"2024-09-20T21:05:34.231801+0000","last_undegraded":"2024-09-20T21:05:34.231801+0000","last_fullsized":"2024-09-20T21:05:34.231801+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:22.185174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532185+0000","last_change":"2024-09-20T21:05:33.523453+0000","last_active":"2024-09-20T21:05:36.532185+0000","last_peered":"2024-09-20T21:05:36.532185+0000","last_clean":"2024-09-20T21:05:36.532185+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:05:36.532185+0000","last_undegraded":"2024-09-20T21:05:36.532185+0000","last_fullsized":"2024-09-20T21:05:36.532185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:59.275158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.231712+0000","last_change":"2024-09-20T21:03:00.186549+0000","last_active":"2024-09-20T21:05:34.231712+0000","last_peered":"2024-09-20T21:05:34.231712+0000","last_clean":"2024-09-20T21:05:34.231712+0000","last_became_active":"2024-09-20T21:03:00.185982+0000","last_became_peered":"2024-09-20T21:03:00.185982+0000","last_unstale":"2024-09-20T21:05:34.231712+0000","last_undegraded":"2024-09-20T21:05:34.231712+0000","last_fullsized":"2024-09-20T21:05:34.231712+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:44.292273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.265360+0000","last_change":"2024-09-20T21:05:34.265360+0000","last_active":"2024-09-20T21:05:34.265360+0000","last_peered":"2024-09-20T21:05:34.265360+0000","last_clean":"2024-09-20T21:05:34.265360+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:05:34.265360+0000","last_undegraded":"2024-09-20T21:05:34.265360+0000","last_fullsized":"2024-09-20T21:05:34.265360+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:02.949435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.264103+0000","last_change":"2024-09-20T21:05:34.264103+0000","last_active":"2024-09-20T21:05:34.264103+0000","last_peered":"2024-09-20T21:05:34.264103+0000","last_clean":"2024-09-20T21:05:34.264103+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:05:34.264103+0000","last_undegraded":"2024-09-20T21:05:34.264103+0000","last_fullsized":"2024-09-20T21:05:34.264103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.354082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531950+0000","last_change":"2024-09-20T21:05:33.507359+0000","last_active":"2024-09-20T21:05:36.531950+0000","last_peered":"2024-09-20T21:05:36.531950+0000","last_clean":"2024-09-20T21:05:36.531950+0000","last_became_active":"2024-09-20T21:05:33.505749+0000","last_became_peered":"2024-09-20T21:05:33.505749+0000","last_unstale":"2024-09-20T21:05:36.531950+0000","last_undegraded":"2024-09-20T21:05:36.531950+0000","last_fullsized":"2024-09-20T21:05:36.531950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:35.978609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533104+0000","last_change":"2024-09-20T21:05:33.528126+0000","last_active":"2024-09-20T21:05:36.533104+0000","last_peered":"2024-09-20T21:05:36.533104+0000","last_clean":"2024-09-20T21:05:36.533104+0000","last_became_active":"2024-09-20T21:05:33.521052+0000","last_became_peered":"2024-09-20T21:05:33.521052+0000","last_unstale":"2024-09-20T21:05:36.533104+0000","last_undegraded":"2024-09-20T21:05:36.533104+0000","last_fullsized":"2024-09-20T21:05:36.533104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:40.460011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530840+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:36.530840+0000","last_peered":"2024-09-20T21:05:36.530840+0000","last_clean":"2024-09-20T21:05:36.530840+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:36.530840+0000","last_undegraded":"2024-09-20T21:05:36.530840+0000","last_fullsized":"2024-09-20T21:05:36.530840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:41.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533049+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:36.533049+0000","last_peered":"2024-09-20T21:05:36.533049+0000","last_clean":"2024-09-20T21:05:36.533049+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:36.533049+0000","last_undegraded":"2024-09-20T21:05:36.533049+0000","last_fullsized":"2024-09-20T21:05:36.533049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:04.604590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534167+0000","last_change":"2024-09-20T21:05:33.511358+0000","last_active":"2024-09-20T21:05:36.534167+0000","last_peered":"2024-09-20T21:05:36.534167+0000","last_clean":"2024-09-20T21:05:36.534167+0000","last_became_active":"2024-09-20T21:05:33.507647+0000","last_became_peered":"2024-09-20T21:05:33.507647+0000","last_unstale":"2024-09-20T21:05:36.534167+0000","last_undegraded":"2024-09-20T21:05:36.534167+0000","last_fullsized":"2024-09-20T21:05:36.534167+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:44:55.328542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531925+0000","last_change":"2024-09-20T21:05:33.506588+0000","last_active":"2024-09-20T21:05:36.531925+0000","last_peered":"2024-09-20T21:05:36.531925+0000","last_clean":"2024-09-20T21:05:36.531925+0000","last_became_active":"2024-09-20T21:05:33.505615+0000","last_became_peered":"2024-09-20T21:05:33.505615+0000","last_unstale":"2024-09-20T21:05:36.531925+0000","last_undegraded":"2024-09-20T21:05:36.531925+0000","last_fullsized":"2024-09-20T21:05:36.531925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:40.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227924+0000","last_change":"2024-09-20T21:03:00.187291+0000","last_active":"2024-09-20T21:05:34.227924+0000","last_peered":"2024-09-20T21:05:34.227924+0000","last_clean":"2024-09-20T21:05:34.227924+0000","last_became_active":"2024-09-20T21:03:00.186993+0000","last_became_peered":"2024-09-20T21:03:00.186993+0000","last_unstale":"2024-09-20T21:05:34.227924+0000","last_undegraded":"2024-09-20T21:05:34.227924+0000","last_fullsized":"2024-09-20T21:05:34.227924+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:54:14.917606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534439+0000","last_change":"2024-09-20T21:05:33.529620+0000","last_active":"2024-09-20T21:05:36.534439+0000","last_peered":"2024-09-20T21:05:36.534439+0000","last_clean":"2024-09-20T21:05:36.534439+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:05:36.534439+0000","last_undegraded":"2024-09-20T21:05:36.534439+0000","last_fullsized":"2024-09-20T21:05:36.534439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:39.374497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534076+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:36.534076+0000","last_peered":"2024-09-20T21:05:36.534076+0000","last_clean":"2024-09-20T21:05:36.534076+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:36.534076+0000","last_undegraded":"2024-09-20T21:05:36.534076+0000","last_fullsized":"2024-09-20T21:05:36.534076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:30.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533415+0000","last_change":"2024-09-20T21:05:33.516924+0000","last_active":"2024-09-20T21:05:36.533415+0000","last_peered":"2024-09-20T21:05:36.533415+0000","last_clean":"2024-09-20T21:05:36.533415+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:05:36.533415+0000","last_undegraded":"2024-09-20T21:05:36.533415+0000","last_fullsized":"2024-09-20T21:05:36.533415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:55.590471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534471+0000","last_change":"2024-09-20T21:05:33.525586+0000","last_active":"2024-09-20T21:05:36.534471+0000","last_peered":"2024-09-20T21:05:36.534471+0000","last_clean":"2024-09-20T21:05:36.534471+0000","last_became_active":"2024-09-20T21:05:33.522980+0000","last_became_peered":"2024-09-20T21:05:33.522980+0000","last_unstale":"2024-09-20T21:05:36.534471+0000","last_undegraded":"2024-09-20T21:05:36.534471+0000","last_fullsized":"2024-09-20T21:05:36.534471+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:02.419755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.264426+0000","last_change":"2024-09-20T21:05:34.264426+0000","last_active":"2024-09-20T21:05:34.264426+0000","last_peered":"2024-09-20T21:05:34.264426+0000","last_clean":"2024-09-20T21:05:34.264426+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:05:34.264426+0000","last_undegraded":"2024-09-20T21:05:34.264426+0000","last_fullsized":"2024-09-20T21:05:34.264426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:23.886272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534627+0000","last_change":"2024-09-20T21:05:33.517281+0000","last_active":"2024-09-20T21:05:36.534627+0000","last_peered":"2024-09-20T21:05:36.534627+0000","last_clean":"2024-09-20T21:05:36.534627+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:05:36.534627+0000","last_undegraded":"2024-09-20T21:05:36.534627+0000","last_fullsized":"2024-09-20T21:05:36.534627+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:44.497231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531298+0000","last_change":"2024-09-20T21:05:33.523216+0000","last_active":"2024-09-20T21:05:36.531298+0000","last_peered":"2024-09-20T21:05:36.531298+0000","last_clean":"2024-09-20T21:05:36.531298+0000","last_became_active":"2024-09-20T21:05:33.516684+0000","last_became_peered":"2024-09-20T21:05:33.516684+0000","last_unstale":"2024-09-20T21:05:36.531298+0000","last_undegraded":"2024-09-20T21:05:36.531298+0000","last_fullsized":"2024-09-20T21:05:36.531298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:33:12.817332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532390+0000","last_change":"2024-09-20T21:05:33.527473+0000","last_active":"2024-09-20T21:05:36.532390+0000","last_peered":"2024-09-20T21:05:36.532390+0000","last_clean":"2024-09-20T21:05:36.532390+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:05:36.532390+0000","last_undegraded":"2024-09-20T21:05:36.532390+0000","last_fullsized":"2024-09-20T21:05:36.532390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:43.880199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.243835+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:34.243835+0000","last_peered":"2024-09-20T21:05:34.243835+0000","last_clean":"2024-09-20T21:05:34.243835+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:34.243835+0000","last_undegraded":"2024-09-20T21:05:34.243835+0000","last_fullsized":"2024-09-20T21:05:34.243835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:06:41.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532824+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:36.532824+0000","last_peered":"2024-09-20T21:05:36.532824+0000","last_clean":"2024-09-20T21:05:36.532824+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:36.532824+0000","last_undegraded":"2024-09-20T21:05:36.532824+0000","last_fullsized":"2024-09-20T21:05:36.532824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:57.275101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.225029+0000","last_change":"2024-09-20T21:03:00.182491+0000","last_active":"2024-09-20T21:05:34.225029+0000","last_peered":"2024-09-20T21:05:34.225029+0000","last_clean":"2024-09-20T21:05:34.225029+0000","last_became_active":"2024-09-20T21:03:00.181363+0000","last_became_peered":"2024-09-20T21:03:00.181363+0000","last_unstale":"2024-09-20T21:05:34.225029+0000","last_undegraded":"2024-09-20T21:05:34.225029+0000","last_fullsized":"2024-09-20T21:05:34.225029+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:28.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228356+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:05:34.228356+0000","last_peered":"2024-09-20T21:05:34.228356+0000","last_clean":"2024-09-20T21:05:34.228356+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:05:34.228356+0000","last_undegraded":"2024-09-20T21:05:34.228356+0000","last_fullsized":"2024-09-20T21:05:34.228356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":253,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530578+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:36.530578+0000","last_peered":"2024-09-20T21:05:36.530578+0000","last_clean":"2024-09-20T21:05:36.530578+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:36.530578+0000","last_undegraded":"2024-09-20T21:05:36.530578+0000","last_fullsized":"2024-09-20T21:05:36.530578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:49.545054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531068+0000","last_change":"2024-09-20T21:05:33.516926+0000","last_active":"2024-09-20T21:05:36.531068+0000","last_peered":"2024-09-20T21:05:36.531068+0000","last_clean":"2024-09-20T21:05:36.531068+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:05:36.531068+0000","last_undegraded":"2024-09-20T21:05:36.531068+0000","last_fullsized":"2024-09-20T21:05:36.531068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:48.429167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.407874+0000","last_change":"2024-09-20T21:03:09.259033+0000","last_active":"2024-09-20T21:03:29.407874+0000","last_peered":"2024-09-20T21:03:29.407874+0000","last_clean":"2024-09-20T21:03:29.407874+0000","last_became_active":"2024-09-20T21:03:09.255753+0000","last_became_peered":"2024-09-20T21:03:09.255753+0000","last_unstale":"2024-09-20T21:03:29.407874+0000","last_undegraded":"2024-09-20T21:03:29.407874+0000","last_fullsized":"2024-09-20T21:03:29.407874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:06.244010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534837+0000","last_change":"2024-09-20T21:05:33.527863+0000","last_active":"2024-09-20T21:05:36.534837+0000","last_peered":"2024-09-20T21:05:36.534837+0000","last_clean":"2024-09-20T21:05:36.534837+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:05:36.534837+0000","last_undegraded":"2024-09-20T21:05:36.534837+0000","last_fullsized":"2024-09-20T21:05:36.534837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:28.039071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531382+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:36.531382+0000","last_peered":"2024-09-20T21:05:36.531382+0000","last_clean":"2024-09-20T21:05:36.531382+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:36.531382+0000","last_undegraded":"2024-09-20T21:05:36.531382+0000","last_fullsized":"2024-09-20T21:05:36.531382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:58.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530629+0000","last_change":"2024-09-20T21:05:33.517511+0000","last_active":"2024-09-20T21:05:36.530629+0000","last_peered":"2024-09-20T21:05:36.530629+0000","last_clean":"2024-09-20T21:05:36.530629+0000","last_became_active":"2024-09-20T21:05:33.512528+0000","last_became_peered":"2024-09-20T21:05:33.512528+0000","last_unstale":"2024-09-20T21:05:36.530629+0000","last_undegraded":"2024-09-20T21:05:36.530629+0000","last_fullsized":"2024-09-20T21:05:36.530629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:12:56.968567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227583+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:34.227583+0000","last_peered":"2024-09-20T21:05:34.227583+0000","last_clean":"2024-09-20T21:05:34.227583+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:34.227583+0000","last_undegraded":"2024-09-20T21:05:34.227583+0000","last_fullsized":"2024-09-20T21:05:34.227583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221339+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:34.221339+0000","last_peered":"2024-09-20T21:05:34.221339+0000","last_clean":"2024-09-20T21:05:34.221339+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:34.221339+0000","last_undegraded":"2024-09-20T21:05:34.221339+0000","last_fullsized":"2024-09-20T21:05:34.221339+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530710+0000","last_change":"2024-09-20T21:05:33.506109+0000","last_active":"2024-09-20T21:05:36.530710+0000","last_peered":"2024-09-20T21:05:36.530710+0000","last_clean":"2024-09-20T21:05:36.530710+0000","last_became_active":"2024-09-20T21:05:33.505217+0000","last_became_peered":"2024-09-20T21:05:33.505217+0000","last_unstale":"2024-09-20T21:05:36.530710+0000","last_undegraded":"2024-09-20T21:05:36.530710+0000","last_fullsized":"2024-09-20T21:05:36.530710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:35.484677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.228392+0000","last_change":"2024-09-20T21:03:00.182222+0000","last_active":"2024-09-20T21:05:34.228392+0000","last_peered":"2024-09-20T21:05:34.228392+0000","last_clean":"2024-09-20T21:05:34.228392+0000","last_became_active":"2024-09-20T21:03:00.181621+0000","last_became_peered":"2024-09-20T21:03:00.181621+0000","last_unstale":"2024-09-20T21:05:34.228392+0000","last_undegraded":"2024-09-20T21:05:34.228392+0000","last_fullsized":"2024-09-20T21:05:34.228392+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:17.147485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.530978+0000","last_change":"2024-09-20T21:05:33.525394+0000","last_active":"2024-09-20T21:05:36.530978+0000","last_peered":"2024-09-20T21:05:36.530978+0000","last_clean":"2024-09-20T21:05:36.530978+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:05:36.530978+0000","last_undegraded":"2024-09-20T21:05:36.530978+0000","last_fullsized":"2024-09-20T21:05:36.530978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:51:33.922257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531598+0000","last_change":"2024-09-20T21:05:33.522984+0000","last_active":"2024-09-20T21:05:36.531598+0000","last_peered":"2024-09-20T21:05:36.531598+0000","last_clean":"2024-09-20T21:05:36.531598+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:05:36.531598+0000","last_undegraded":"2024-09-20T21:05:36.531598+0000","last_fullsized":"2024-09-20T21:05:36.531598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:22:14.870718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227653+0000","last_change":"2024-09-20T21:03:00.181764+0000","last_active":"2024-09-20T21:05:34.227653+0000","last_peered":"2024-09-20T21:05:34.227653+0000","last_clean":"2024-09-20T21:05:34.227653+0000","last_became_active":"2024-09-20T21:03:00.181125+0000","last_became_peered":"2024-09-20T21:03:00.181125+0000","last_unstale":"2024-09-20T21:05:34.227653+0000","last_undegraded":"2024-09-20T21:05:34.227653+0000","last_fullsized":"2024-09-20T21:05:34.227653+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:58.632807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531763+0000","last_change":"2024-09-20T21:05:33.530100+0000","last_active":"2024-09-20T21:05:36.531763+0000","last_peered":"2024-09-20T21:05:36.531763+0000","last_clean":"2024-09-20T21:05:36.531763+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:05:36.531763+0000","last_undegraded":"2024-09-20T21:05:36.531763+0000","last_fullsized":"2024-09-20T21:05:36.531763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:12.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221816+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:34.221816+0000","last_peered":"2024-09-20T21:05:34.221816+0000","last_clean":"2024-09-20T21:05:34.221816+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:34.221816+0000","last_undegraded":"2024-09-20T21:05:34.221816+0000","last_fullsized":"2024-09-20T21:05:34.221816+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.241501+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:34.241501+0000","last_peered":"2024-09-20T21:05:34.241501+0000","last_clean":"2024-09-20T21:05:34.241501+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:34.241501+0000","last_undegraded":"2024-09-20T21:05:34.241501+0000","last_fullsized":"2024-09-20T21:05:34.241501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:03.961332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221558+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:34.221558+0000","last_peered":"2024-09-20T21:05:34.221558+0000","last_clean":"2024-09-20T21:05:34.221558+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:34.221558+0000","last_undegraded":"2024-09-20T21:05:34.221558+0000","last_fullsized":"2024-09-20T21:05:34.221558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.233180+0000","last_change":"2024-09-20T21:03:00.186668+0000","last_active":"2024-09-20T21:05:34.233180+0000","last_peered":"2024-09-20T21:05:34.233180+0000","last_clean":"2024-09-20T21:05:34.233180+0000","last_became_active":"2024-09-20T21:03:00.186259+0000","last_became_peered":"2024-09-20T21:03:00.186259+0000","last_unstale":"2024-09-20T21:05:34.233180+0000","last_undegraded":"2024-09-20T21:05:34.233180+0000","last_fullsized":"2024-09-20T21:05:34.233180+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:42:58.237986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533928+0000","last_change":"2024-09-20T21:05:33.509455+0000","last_active":"2024-09-20T21:05:36.533928+0000","last_peered":"2024-09-20T21:05:36.533928+0000","last_clean":"2024-09-20T21:05:36.533928+0000","last_became_active":"2024-09-20T21:05:33.508553+0000","last_became_peered":"2024-09-20T21:05:33.508553+0000","last_unstale":"2024-09-20T21:05:36.533928+0000","last_undegraded":"2024-09-20T21:05:36.533928+0000","last_fullsized":"2024-09-20T21:05:36.533928+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:16:44.519386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.232515+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:34.232515+0000","last_peered":"2024-09-20T21:05:34.232515+0000","last_clean":"2024-09-20T21:05:34.232515+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:34.232515+0000","last_undegraded":"2024-09-20T21:05:34.232515+0000","last_fullsized":"2024-09-20T21:05:34.232515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.232770+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:05:34.232770+0000","last_peered":"2024-09-20T21:05:34.232770+0000","last_clean":"2024-09-20T21:05:34.232770+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:05:34.232770+0000","last_undegraded":"2024-09-20T21:05:34.232770+0000","last_fullsized":"2024-09-20T21:05:34.232770+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.407367+0000","last_change":"2024-09-20T21:03:09.320426+0000","last_active":"2024-09-20T21:03:29.407367+0000","last_peered":"2024-09-20T21:03:29.407367+0000","last_clean":"2024-09-20T21:03:29.407367+0000","last_became_active":"2024-09-20T21:03:09.319266+0000","last_became_peered":"2024-09-20T21:03:09.319266+0000","last_unstale":"2024-09-20T21:03:29.407367+0000","last_undegraded":"2024-09-20T21:03:29.407367+0000","last_fullsized":"2024-09-20T21:03:29.407367+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:35:35.196344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.269917+0000","last_change":"2024-09-20T21:05:34.264862+0000","last_active":"2024-09-20T21:05:34.269917+0000","last_peered":"2024-09-20T21:05:34.269917+0000","last_clean":"2024-09-20T21:05:34.269917+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:05:34.269917+0000","last_undegraded":"2024-09-20T21:05:34.269917+0000","last_fullsized":"2024-09-20T21:05:34.269917+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:32.512356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532164+0000","last_change":"2024-09-20T21:05:33.508633+0000","last_active":"2024-09-20T21:05:36.532164+0000","last_peered":"2024-09-20T21:05:36.532164+0000","last_clean":"2024-09-20T21:05:36.532164+0000","last_became_active":"2024-09-20T21:05:33.505595+0000","last_became_peered":"2024-09-20T21:05:33.505595+0000","last_unstale":"2024-09-20T21:05:36.532164+0000","last_undegraded":"2024-09-20T21:05:36.532164+0000","last_fullsized":"2024-09-20T21:05:36.532164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:10.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532027+0000","last_change":"2024-09-20T21:05:33.507358+0000","last_active":"2024-09-20T21:05:36.532027+0000","last_peered":"2024-09-20T21:05:36.532027+0000","last_clean":"2024-09-20T21:05:36.532027+0000","last_became_active":"2024-09-20T21:05:33.506544+0000","last_became_peered":"2024-09-20T21:05:33.506544+0000","last_unstale":"2024-09-20T21:05:36.532027+0000","last_undegraded":"2024-09-20T21:05:36.532027+0000","last_fullsized":"2024-09-20T21:05:36.532027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:00.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533106+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:36.533106+0000","last_peered":"2024-09-20T21:05:36.533106+0000","last_clean":"2024-09-20T21:05:36.533106+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:36.533106+0000","last_undegraded":"2024-09-20T21:05:36.533106+0000","last_fullsized":"2024-09-20T21:05:36.533106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:49.172273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532044+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:36.532044+0000","last_peered":"2024-09-20T21:05:36.532044+0000","last_clean":"2024-09-20T21:05:36.532044+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:36.532044+0000","last_undegraded":"2024-09-20T21:05:36.532044+0000","last_fullsized":"2024-09-20T21:05:36.532044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:07:07.242939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.221325+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:05:34.221325+0000","last_peered":"2024-09-20T21:05:34.221325+0000","last_clean":"2024-09-20T21:05:34.221325+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:05:34.221325+0000","last_undegraded":"2024-09-20T21:05:34.221325+0000","last_fullsized":"2024-09-20T21:05:34.221325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534923+0000","last_change":"2024-09-20T21:05:33.528236+0000","last_active":"2024-09-20T21:05:36.534923+0000","last_peered":"2024-09-20T21:05:36.534923+0000","last_clean":"2024-09-20T21:05:36.534923+0000","last_became_active":"2024-09-20T21:05:33.516911+0000","last_became_peered":"2024-09-20T21:05:33.516911+0000","last_unstale":"2024-09-20T21:05:36.534923+0000","last_undegraded":"2024-09-20T21:05:36.534923+0000","last_fullsized":"2024-09-20T21:05:36.534923+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:52.563724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532440+0000","last_change":"2024-09-20T21:05:33.525151+0000","last_active":"2024-09-20T21:05:36.532440+0000","last_peered":"2024-09-20T21:05:36.532440+0000","last_clean":"2024-09-20T21:05:36.532440+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:05:36.532440+0000","last_undegraded":"2024-09-20T21:05:36.532440+0000","last_fullsized":"2024-09-20T21:05:36.532440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:51.245496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531752+0000","last_change":"2024-09-20T21:05:33.525313+0000","last_active":"2024-09-20T21:05:36.531752+0000","last_peered":"2024-09-20T21:05:36.531752+0000","last_clean":"2024-09-20T21:05:36.531752+0000","last_became_active":"2024-09-20T21:05:33.517931+0000","last_became_peered":"2024-09-20T21:05:33.517931+0000","last_unstale":"2024-09-20T21:05:36.531752+0000","last_undegraded":"2024-09-20T21:05:36.531752+0000","last_fullsized":"2024-09-20T21:05:36.531752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:15.962153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.264735+0000","last_change":"2024-09-20T21:05:34.264735+0000","last_active":"2024-09-20T21:05:34.264735+0000","last_peered":"2024-09-20T21:05:34.264735+0000","last_clean":"2024-09-20T21:05:34.264735+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:05:34.264735+0000","last_undegraded":"2024-09-20T21:05:34.264735+0000","last_fullsized":"2024-09-20T21:05:34.264735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:16.718841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-20T21:05:33.209748+0000","last_change":"2024-09-20T21:05:34.225456+0000","last_active":"2024-09-20T21:05:33.209748+0000","last_peered":"2024-09-20T21:05:32.514387+0000","last_clean":"2024-09-20T21:05:32.514387+0000","last_became_active":"2024-09-20T21:03:09.319134+0000","last_became_peered":"2024-09-20T21:03:09.319134+0000","last_unstale":"2024-09-20T21:05:33.209748+0000","last_undegraded":"2024-09-20T21:05:33.209748+0000","last_fullsized":"2024-09-20T21:05:33.209748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.248368+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:34.248368+0000","last_peered":"2024-09-20T21:05:34.248368+0000","last_clean":"2024-09-20T21:05:34.248368+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:34.248368+0000","last_undegraded":"2024-09-20T21:05:34.248368+0000","last_fullsized":"2024-09-20T21:05:34.248368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:39.486200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.413291+0000","last_change":"2024-09-20T21:03:09.320997+0000","last_active":"2024-09-20T21:03:29.413291+0000","last_peered":"2024-09-20T21:03:29.413291+0000","last_clean":"2024-09-20T21:03:29.413291+0000","last_became_active":"2024-09-20T21:03:09.319756+0000","last_became_peered":"2024-09-20T21:03:09.319756+0000","last_unstale":"2024-09-20T21:03:29.413291+0000","last_undegraded":"2024-09-20T21:03:29.413291+0000","last_fullsized":"2024-09-20T21:03:29.413291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:16:30.171477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532245+0000","last_change":"2024-09-20T21:05:33.525291+0000","last_active":"2024-09-20T21:05:36.532245+0000","last_peered":"2024-09-20T21:05:36.532245+0000","last_clean":"2024-09-20T21:05:36.532245+0000","last_became_active":"2024-09-20T21:05:33.523537+0000","last_became_peered":"2024-09-20T21:05:33.523537+0000","last_unstale":"2024-09-20T21:05:36.532245+0000","last_undegraded":"2024-09-20T21:05:36.532245+0000","last_fullsized":"2024-09-20T21:05:36.532245+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:42.985077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.540422+0000","last_change":"2024-09-20T21:05:36.539030+0000","last_active":"2024-09-20T21:05:36.540422+0000","last_peered":"2024-09-20T21:05:36.540422+0000","last_clean":"2024-09-20T21:05:36.540422+0000","last_became_active":"2024-09-20T21:05:36.538325+0000","last_became_peered":"2024-09-20T21:05:36.538325+0000","last_unstale":"2024-09-20T21:05:36.540422+0000","last_undegraded":"2024-09-20T21:05:36.540422+0000","last_fullsized":"2024-09-20T21:05:36.540422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:48.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532065+0000","last_change":"2024-09-20T21:05:33.528150+0000","last_active":"2024-09-20T21:05:36.532065+0000","last_peered":"2024-09-20T21:05:36.532065+0000","last_clean":"2024-09-20T21:05:36.532065+0000","last_became_active":"2024-09-20T21:05:33.512623+0000","last_became_peered":"2024-09-20T21:05:33.512623+0000","last_unstale":"2024-09-20T21:05:36.532065+0000","last_undegraded":"2024-09-20T21:05:36.532065+0000","last_fullsized":"2024-09-20T21:05:36.532065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:08.142904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.227511+0000","last_change":"2024-09-20T21:03:00.182809+0000","last_active":"2024-09-20T21:05:34.227511+0000","last_peered":"2024-09-20T21:05:34.227511+0000","last_clean":"2024-09-20T21:05:34.227511+0000","last_became_active":"2024-09-20T21:03:00.182423+0000","last_became_peered":"2024-09-20T21:03:00.182423+0000","last_unstale":"2024-09-20T21:05:34.227511+0000","last_undegraded":"2024-09-20T21:05:34.227511+0000","last_fullsized":"2024-09-20T21:05:34.227511+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:26.732116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":91,"reported_epoch":79,"state":"active+clean+remapped","last_fresh":"2024-09-20T21:03:29.412991+0000","last_change":"2024-09-20T21:03:09.257671+0000","last_active":"2024-09-20T21:03:29.412991+0000","last_peered":"2024-09-20T21:03:29.412991+0000","last_clean":"2024-09-20T21:03:29.412991+0000","last_became_active":"2024-09-20T21:03:09.256538+0000","last_became_peered":"2024-09-20T21:03:09.256538+0000","last_unstale":"2024-09-20T21:03:29.412991+0000","last_undegraded":"2024-09-20T21:03:29.412991+0000","last_fullsized":"2024-09-20T21:03:29.412991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:41.755432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534768+0000","last_change":"2024-09-20T21:05:33.508991+0000","last_active":"2024-09-20T21:05:36.534768+0000","last_peered":"2024-09-20T21:05:36.534768+0000","last_clean":"2024-09-20T21:05:36.534768+0000","last_became_active":"2024-09-20T21:05:33.507155+0000","last_became_peered":"2024-09-20T21:05:33.507155+0000","last_unstale":"2024-09-20T21:05:36.534768+0000","last_undegraded":"2024-09-20T21:05:36.534768+0000","last_fullsized":"2024-09-20T21:05:36.534768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:04:20.632178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.532969+0000","last_change":"2024-09-20T21:05:33.523783+0000","last_active":"2024-09-20T21:05:36.532969+0000","last_peered":"2024-09-20T21:05:36.532969+0000","last_clean":"2024-09-20T21:05:36.532969+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:05:36.532969+0000","last_undegraded":"2024-09-20T21:05:36.532969+0000","last_fullsized":"2024-09-20T21:05:36.532969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:29.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.560617+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:36.560617+0000","last_peered":"2024-09-20T21:05:36.560617+0000","last_clean":"2024-09-20T21:05:36.560617+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:36.560617+0000","last_undegraded":"2024-09-20T21:05:36.560617+0000","last_fullsized":"2024-09-20T21:05:36.560617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:45:47.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.533560+0000","last_change":"2024-09-20T21:05:33.525036+0000","last_active":"2024-09-20T21:05:36.533560+0000","last_peered":"2024-09-20T21:05:36.533560+0000","last_clean":"2024-09-20T21:05:36.533560+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:05:36.533560+0000","last_undegraded":"2024-09-20T21:05:36.533560+0000","last_fullsized":"2024-09-20T21:05:36.533560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:13.120671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.531493+0000","last_change":"2024-09-20T21:05:33.525496+0000","last_active":"2024-09-20T21:05:36.531493+0000","last_peered":"2024-09-20T21:05:36.531493+0000","last_clean":"2024-09-20T21:05:36.531493+0000","last_became_active":"2024-09-20T21:05:33.511914+0000","last_became_peered":"2024-09-20T21:05:33.511914+0000","last_unstale":"2024-09-20T21:05:36.531493+0000","last_undegraded":"2024-09-20T21:05:36.531493+0000","last_fullsized":"2024-09-20T21:05:36.531493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:47:40.771092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.229962+0000","last_change":"2024-09-20T21:03:00.186986+0000","last_active":"2024-09-20T21:05:34.229962+0000","last_peered":"2024-09-20T21:05:34.229962+0000","last_clean":"2024-09-20T21:05:34.229962+0000","last_became_active":"2024-09-20T21:03:00.186450+0000","last_became_peered":"2024-09-20T21:03:00.186450+0000","last_unstale":"2024-09-20T21:05:34.229962+0000","last_undegraded":"2024-09-20T21:05:34.229962+0000","last_fullsized":"2024-09-20T21:05:34.229962+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:16:39.776258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-20T21:05:34.231725+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:34.231725+0000","last_peered":"2024-09-20T21:05:34.231725+0000","last_clean":"2024-09-20T21:05:34.231725+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:34.231725+0000","last_undegraded":"2024-09-20T21:05:34.231725+0000","last_fullsized":"2024-09-20T21:05:34.231725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.534323+0000","last_change":"2024-09-20T21:05:33.529399+0000","last_active":"2024-09-20T21:05:36.534323+0000","last_peered":"2024-09-20T21:05:36.534323+0000","last_clean":"2024-09-20T21:05:36.534323+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:05:36.534323+0000","last_undegraded":"2024-09-20T21:05:36.534323+0000","last_fullsized":"2024-09-20T21:05:36.534323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:36.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T21:05:36.552715+0000","last_change":"2024-09-20T21:05:36.551627+0000","last_active":"2024-09-20T21:05:36.552715+0000","last_peered":"2024-09-20T21:05:36.552715+0000","last_clean":"2024-09-20T21:05:36.552715+0000","last_became_active":"2024-09-20T21:05:36.542121+0000","last_became_peered":"2024-09-20T21:05:36.542121+0000","last_unstale":"2024-09-20T21:05:36.552715+0000","last_undegraded":"2024-09-20T21:05:36.552715+0000","last_fullsized":"2024-09-20T21:05:36.552715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:30.528499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":125,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":62,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738427,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216828,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94155012,"statfs":{"total":96636764160,"available":96414732288,"internally_reserved":0,"allocated":1024000,"data_stored":949633,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350978,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54556,"kb_used_data":1024,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317284,"statfs":{"total":96636764160,"available":96580898816,"internally_reserved":0,"allocated":1048576,"data_stored":958389,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325048,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046792,"statfs":{"total":96636764160,"available":96303915008,"internally_reserved":0,"allocated":946176,"data_stored":357524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:05:42.709 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:05:43.032 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:43.033 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:05:43.050 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-09-20T21:05:42.986908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596500,"kb_used_data":3016,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282519020,"statfs":{"total":289910292480,"available":289299476480,"internally_reserved":0,"allocated":3088384,"data_stored":2303602,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-20,"num_objects_misplaced":-3,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.751788"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":102,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.267977+0000","last_change":"2024-09-20T21:03:00.185875+0000","last_active":"2024-09-20T21:05:38.267977+0000","last_peered":"2024-09-20T21:05:38.267977+0000","last_clean":"2024-09-20T21:05:38.267977+0000","last_became_active":"2024-09-20T21:03:00.185497+0000","last_became_peered":"2024-09-20T21:03:00.185497+0000","last_unstale":"2024-09-20T21:05:38.267977+0000","last_undegraded":"2024-09-20T21:05:38.267977+0000","last_fullsized":"2024-09-20T21:05:38.267977+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:28.649371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":102,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.267174+0000","last_change":"2024-09-20T21:03:00.181974+0000","last_active":"2024-09-20T21:05:38.267174+0000","last_peered":"2024-09-20T21:05:38.267174+0000","last_clean":"2024-09-20T21:05:38.267174+0000","last_became_active":"2024-09-20T21:03:00.181499+0000","last_became_peered":"2024-09-20T21:03:00.181499+0000","last_unstale":"2024-09-20T21:05:38.267174+0000","last_undegraded":"2024-09-20T21:05:38.267174+0000","last_fullsized":"2024-09-20T21:05:38.267174+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:51.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.539731+0000","last_change":"2024-09-20T21:05:33.529595+0000","last_active":"2024-09-20T21:05:37.539731+0000","last_peered":"2024-09-20T21:05:37.539731+0000","last_clean":"2024-09-20T21:05:37.539731+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:05:37.539731+0000","last_undegraded":"2024-09-20T21:05:37.539731+0000","last_fullsized":"2024-09-20T21:05:37.539731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:08.234369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537404+0000","last_change":"2024-09-20T21:05:33.516896+0000","last_active":"2024-09-20T21:05:37.537404+0000","last_peered":"2024-09-20T21:05:37.537404+0000","last_clean":"2024-09-20T21:05:37.537404+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:05:37.537404+0000","last_undegraded":"2024-09-20T21:05:37.537404+0000","last_fullsized":"2024-09-20T21:05:37.537404+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:48.472114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266519+0000","last_change":"2024-09-20T21:03:00.187632+0000","last_active":"2024-09-20T21:05:38.266519+0000","last_peered":"2024-09-20T21:05:38.266519+0000","last_clean":"2024-09-20T21:05:38.266519+0000","last_became_active":"2024-09-20T21:03:00.187296+0000","last_became_peered":"2024-09-20T21:03:00.187296+0000","last_unstale":"2024-09-20T21:05:38.266519+0000","last_undegraded":"2024-09-20T21:05:38.266519+0000","last_fullsized":"2024-09-20T21:05:38.266519+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:37.800532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538681+0000","last_change":"2024-09-20T21:05:33.526021+0000","last_active":"2024-09-20T21:05:37.538681+0000","last_peered":"2024-09-20T21:05:37.538681+0000","last_clean":"2024-09-20T21:05:37.538681+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:05:37.538681+0000","last_undegraded":"2024-09-20T21:05:37.538681+0000","last_fullsized":"2024-09-20T21:05:37.538681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:51.022212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538021+0000","last_change":"2024-09-20T21:05:33.526988+0000","last_active":"2024-09-20T21:05:37.538021+0000","last_peered":"2024-09-20T21:05:37.538021+0000","last_clean":"2024-09-20T21:05:37.538021+0000","last_became_active":"2024-09-20T21:05:33.520724+0000","last_became_peered":"2024-09-20T21:05:33.520724+0000","last_unstale":"2024-09-20T21:05:37.538021+0000","last_undegraded":"2024-09-20T21:05:37.538021+0000","last_fullsized":"2024-09-20T21:05:37.538021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:06:25.607129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536558+0000","last_change":"2024-09-20T21:05:33.527599+0000","last_active":"2024-09-20T21:05:37.536558+0000","last_peered":"2024-09-20T21:05:37.536558+0000","last_clean":"2024-09-20T21:05:37.536558+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:05:37.536558+0000","last_undegraded":"2024-09-20T21:05:37.536558+0000","last_fullsized":"2024-09-20T21:05:37.536558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:19:18.002155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.267566+0000","last_change":"2024-09-20T21:03:00.185882+0000","last_active":"2024-09-20T21:05:38.267566+0000","last_peered":"2024-09-20T21:05:38.267566+0000","last_clean":"2024-09-20T21:05:38.267566+0000","last_became_active":"2024-09-20T21:03:00.185539+0000","last_became_peered":"2024-09-20T21:03:00.185539+0000","last_unstale":"2024-09-20T21:05:38.267566+0000","last_undegraded":"2024-09-20T21:05:38.267566+0000","last_fullsized":"2024-09-20T21:05:38.267566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:12:56.727059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.267280+0000","last_change":"2024-09-20T21:03:00.186475+0000","last_active":"2024-09-20T21:05:38.267280+0000","last_peered":"2024-09-20T21:05:38.267280+0000","last_clean":"2024-09-20T21:05:38.267280+0000","last_became_active":"2024-09-20T21:03:00.186135+0000","last_became_peered":"2024-09-20T21:03:00.186135+0000","last_unstale":"2024-09-20T21:05:38.267280+0000","last_undegraded":"2024-09-20T21:05:38.267280+0000","last_fullsized":"2024-09-20T21:05:38.267280+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:20:50.799154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.539588+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:37.539588+0000","last_peered":"2024-09-20T21:05:37.539588+0000","last_clean":"2024-09-20T21:05:37.539588+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:37.539588+0000","last_undegraded":"2024-09-20T21:05:37.539588+0000","last_fullsized":"2024-09-20T21:05:37.539588+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:14:10.131416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266592+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:05:38.266592+0000","last_peered":"2024-09-20T21:05:38.266592+0000","last_clean":"2024-09-20T21:05:38.266592+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:05:38.266592+0000","last_undegraded":"2024-09-20T21:05:38.266592+0000","last_fullsized":"2024-09-20T21:05:38.266592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:51.509743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266199+0000","last_change":"2024-09-20T21:05:37.271556+0000","last_active":"2024-09-20T21:05:38.266199+0000","last_peered":"2024-09-20T21:05:38.266199+0000","last_clean":"2024-09-20T21:05:38.266199+0000","last_became_active":"2024-09-20T21:05:37.270726+0000","last_became_peered":"2024-09-20T21:05:37.270726+0000","last_unstale":"2024-09-20T21:05:38.266199+0000","last_undegraded":"2024-09-20T21:05:38.266199+0000","last_fullsized":"2024-09-20T21:05:38.266199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:18:16.849565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538324+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:37.538324+0000","last_peered":"2024-09-20T21:05:37.538324+0000","last_clean":"2024-09-20T21:05:37.538324+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:37.538324+0000","last_undegraded":"2024-09-20T21:05:37.538324+0000","last_fullsized":"2024-09-20T21:05:37.538324+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:17.867418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537829+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:37.537829+0000","last_peered":"2024-09-20T21:05:37.537829+0000","last_clean":"2024-09-20T21:05:37.537829+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:37.537829+0000","last_undegraded":"2024-09-20T21:05:37.537829+0000","last_fullsized":"2024-09-20T21:05:37.537829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:36.753632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537062+0000","last_change":"2024-09-20T21:05:33.529077+0000","last_active":"2024-09-20T21:05:37.537062+0000","last_peered":"2024-09-20T21:05:37.537062+0000","last_clean":"2024-09-20T21:05:37.537062+0000","last_became_active":"2024-09-20T21:05:33.526219+0000","last_became_peered":"2024-09-20T21:05:33.526219+0000","last_unstale":"2024-09-20T21:05:37.537062+0000","last_undegraded":"2024-09-20T21:05:37.537062+0000","last_fullsized":"2024-09-20T21:05:37.537062+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:34.906828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":147,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.335661+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:39.335661+0000","last_peered":"2024-09-20T21:05:39.335661+0000","last_clean":"2024-09-20T21:05:39.335661+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:39.335661+0000","last_undegraded":"2024-09-20T21:05:39.335661+0000","last_fullsized":"2024-09-20T21:05:39.335661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":146,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.267574+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:38.267574+0000","last_peered":"2024-09-20T21:05:38.267574+0000","last_clean":"2024-09-20T21:05:38.267574+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:38.267574+0000","last_undegraded":"2024-09-20T21:05:38.267574+0000","last_fullsized":"2024-09-20T21:05:38.267574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266893+0000","last_change":"2024-09-20T21:03:00.186296+0000","last_active":"2024-09-20T21:05:38.266893+0000","last_peered":"2024-09-20T21:05:38.266893+0000","last_clean":"2024-09-20T21:05:38.266893+0000","last_became_active":"2024-09-20T21:03:00.185622+0000","last_became_peered":"2024-09-20T21:03:00.185622+0000","last_unstale":"2024-09-20T21:05:38.266893+0000","last_undegraded":"2024-09-20T21:05:38.266893+0000","last_fullsized":"2024-09-20T21:05:38.266893+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.181299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538804+0000","last_change":"2024-09-20T21:05:33.523697+0000","last_active":"2024-09-20T21:05:37.538804+0000","last_peered":"2024-09-20T21:05:37.538804+0000","last_clean":"2024-09-20T21:05:37.538804+0000","last_became_active":"2024-09-20T21:05:33.523128+0000","last_became_peered":"2024-09-20T21:05:33.523128+0000","last_unstale":"2024-09-20T21:05:37.538804+0000","last_undegraded":"2024-09-20T21:05:37.538804+0000","last_fullsized":"2024-09-20T21:05:37.538804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:10.328730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538379+0000","last_change":"2024-09-20T21:05:33.524928+0000","last_active":"2024-09-20T21:05:37.538379+0000","last_peered":"2024-09-20T21:05:37.538379+0000","last_clean":"2024-09-20T21:05:37.538379+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:05:37.538379+0000","last_undegraded":"2024-09-20T21:05:37.538379+0000","last_fullsized":"2024-09-20T21:05:37.538379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:42.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266027+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:38.266027+0000","last_peered":"2024-09-20T21:05:38.266027+0000","last_clean":"2024-09-20T21:05:38.266027+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:38.266027+0000","last_undegraded":"2024-09-20T21:05:38.266027+0000","last_fullsized":"2024-09-20T21:05:38.266027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536661+0000","last_change":"2024-09-20T21:05:33.525193+0000","last_active":"2024-09-20T21:05:37.536661+0000","last_peered":"2024-09-20T21:05:37.536661+0000","last_clean":"2024-09-20T21:05:37.536661+0000","last_became_active":"2024-09-20T21:05:33.517158+0000","last_became_peered":"2024-09-20T21:05:33.517158+0000","last_unstale":"2024-09-20T21:05:37.536661+0000","last_undegraded":"2024-09-20T21:05:37.536661+0000","last_fullsized":"2024-09-20T21:05:37.536661+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:17.026497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":102,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.265514+0000","last_change":"2024-09-20T21:03:00.182713+0000","last_active":"2024-09-20T21:05:38.265514+0000","last_peered":"2024-09-20T21:05:38.265514+0000","last_clean":"2024-09-20T21:05:38.265514+0000","last_became_active":"2024-09-20T21:03:00.181842+0000","last_became_peered":"2024-09-20T21:03:00.181842+0000","last_unstale":"2024-09-20T21:05:38.265514+0000","last_undegraded":"2024-09-20T21:05:38.265514+0000","last_fullsized":"2024-09-20T21:05:38.265514+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:26.399209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538391+0000","last_change":"2024-09-20T21:05:33.511797+0000","last_active":"2024-09-20T21:05:37.538391+0000","last_peered":"2024-09-20T21:05:37.538391+0000","last_clean":"2024-09-20T21:05:37.538391+0000","last_became_active":"2024-09-20T21:05:33.509620+0000","last_became_peered":"2024-09-20T21:05:33.509620+0000","last_unstale":"2024-09-20T21:05:37.538391+0000","last_undegraded":"2024-09-20T21:05:37.538391+0000","last_fullsized":"2024-09-20T21:05:37.538391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:33.627527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538467+0000","last_change":"2024-09-20T21:05:33.523555+0000","last_active":"2024-09-20T21:05:37.538467+0000","last_peered":"2024-09-20T21:05:37.538467+0000","last_clean":"2024-09-20T21:05:37.538467+0000","last_became_active":"2024-09-20T21:05:33.517817+0000","last_became_peered":"2024-09-20T21:05:33.517817+0000","last_unstale":"2024-09-20T21:05:37.538467+0000","last_undegraded":"2024-09-20T21:05:37.538467+0000","last_fullsized":"2024-09-20T21:05:37.538467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:16.704262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.539510+0000","last_change":"2024-09-20T21:05:33.528984+0000","last_active":"2024-09-20T21:05:37.539510+0000","last_peered":"2024-09-20T21:05:37.539510+0000","last_clean":"2024-09-20T21:05:37.539510+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:05:37.539510+0000","last_undegraded":"2024-09-20T21:05:37.539510+0000","last_fullsized":"2024-09-20T21:05:37.539510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:53.623013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538477+0000","last_change":"2024-09-20T21:05:33.509655+0000","last_active":"2024-09-20T21:05:37.538477+0000","last_peered":"2024-09-20T21:05:37.538477+0000","last_clean":"2024-09-20T21:05:37.538477+0000","last_became_active":"2024-09-20T21:05:33.508551+0000","last_became_peered":"2024-09-20T21:05:33.508551+0000","last_unstale":"2024-09-20T21:05:37.538477+0000","last_undegraded":"2024-09-20T21:05:37.538477+0000","last_fullsized":"2024-09-20T21:05:37.538477+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:12.145348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.334571+0000","last_change":"2024-09-20T21:05:37.268677+0000","last_active":"2024-09-20T21:05:39.334571+0000","last_peered":"2024-09-20T21:05:39.334571+0000","last_clean":"2024-09-20T21:05:39.334571+0000","last_became_active":"2024-09-20T21:05:37.267096+0000","last_became_peered":"2024-09-20T21:05:37.267096+0000","last_unstale":"2024-09-20T21:05:39.334571+0000","last_undegraded":"2024-09-20T21:05:39.334571+0000","last_fullsized":"2024-09-20T21:05:39.334571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":154,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266325+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:38.266325+0000","last_peered":"2024-09-20T21:05:38.266325+0000","last_clean":"2024-09-20T21:05:38.266325+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:38.266325+0000","last_undegraded":"2024-09-20T21:05:38.266325+0000","last_fullsized":"2024-09-20T21:05:38.266325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":148,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.333366+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:39.333366+0000","last_peered":"2024-09-20T21:05:39.333366+0000","last_clean":"2024-09-20T21:05:39.333366+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:39.333366+0000","last_undegraded":"2024-09-20T21:05:39.333366+0000","last_fullsized":"2024-09-20T21:05:39.333366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536319+0000","last_change":"2024-09-20T21:05:33.520634+0000","last_active":"2024-09-20T21:05:37.536319+0000","last_peered":"2024-09-20T21:05:37.536319+0000","last_clean":"2024-09-20T21:05:37.536319+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:05:37.536319+0000","last_undegraded":"2024-09-20T21:05:37.536319+0000","last_fullsized":"2024-09-20T21:05:37.536319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.341860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266920+0000","last_change":"2024-09-20T21:03:00.182033+0000","last_active":"2024-09-20T21:05:38.266920+0000","last_peered":"2024-09-20T21:05:38.266920+0000","last_clean":"2024-09-20T21:05:38.266920+0000","last_became_active":"2024-09-20T21:03:00.181486+0000","last_became_peered":"2024-09-20T21:03:00.181486+0000","last_unstale":"2024-09-20T21:05:38.266920+0000","last_undegraded":"2024-09-20T21:05:38.266920+0000","last_fullsized":"2024-09-20T21:05:38.266920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:22.185174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538168+0000","last_change":"2024-09-20T21:05:33.523453+0000","last_active":"2024-09-20T21:05:37.538168+0000","last_peered":"2024-09-20T21:05:37.538168+0000","last_clean":"2024-09-20T21:05:37.538168+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:05:37.538168+0000","last_undegraded":"2024-09-20T21:05:37.538168+0000","last_fullsized":"2024-09-20T21:05:37.538168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:59.275158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.267487+0000","last_change":"2024-09-20T21:03:00.186549+0000","last_active":"2024-09-20T21:05:38.267487+0000","last_peered":"2024-09-20T21:05:38.267487+0000","last_clean":"2024-09-20T21:05:38.267487+0000","last_became_active":"2024-09-20T21:03:00.185982+0000","last_became_peered":"2024-09-20T21:03:00.185982+0000","last_unstale":"2024-09-20T21:05:38.267487+0000","last_undegraded":"2024-09-20T21:05:38.267487+0000","last_fullsized":"2024-09-20T21:05:38.267487+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:44.292273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.333995+0000","last_change":"2024-09-20T21:05:34.265360+0000","last_active":"2024-09-20T21:05:39.333995+0000","last_peered":"2024-09-20T21:05:39.333995+0000","last_clean":"2024-09-20T21:05:39.333995+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:05:39.333995+0000","last_undegraded":"2024-09-20T21:05:39.333995+0000","last_fullsized":"2024-09-20T21:05:39.333995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:02.949435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":154,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.335482+0000","last_change":"2024-09-20T21:05:34.264103+0000","last_active":"2024-09-20T21:05:39.335482+0000","last_peered":"2024-09-20T21:05:39.335482+0000","last_clean":"2024-09-20T21:05:39.335482+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:05:39.335482+0000","last_undegraded":"2024-09-20T21:05:39.335482+0000","last_fullsized":"2024-09-20T21:05:39.335482+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.354082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537285+0000","last_change":"2024-09-20T21:05:33.507359+0000","last_active":"2024-09-20T21:05:37.537285+0000","last_peered":"2024-09-20T21:05:37.537285+0000","last_clean":"2024-09-20T21:05:37.537285+0000","last_became_active":"2024-09-20T21:05:33.505749+0000","last_became_peered":"2024-09-20T21:05:33.505749+0000","last_unstale":"2024-09-20T21:05:37.537285+0000","last_undegraded":"2024-09-20T21:05:37.537285+0000","last_fullsized":"2024-09-20T21:05:37.537285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:35.978609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538785+0000","last_change":"2024-09-20T21:05:33.528126+0000","last_active":"2024-09-20T21:05:37.538785+0000","last_peered":"2024-09-20T21:05:37.538785+0000","last_clean":"2024-09-20T21:05:37.538785+0000","last_became_active":"2024-09-20T21:05:33.521052+0000","last_became_peered":"2024-09-20T21:05:33.521052+0000","last_unstale":"2024-09-20T21:05:37.538785+0000","last_undegraded":"2024-09-20T21:05:37.538785+0000","last_fullsized":"2024-09-20T21:05:37.538785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:40.460011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":53,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536193+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:37.536193+0000","last_peered":"2024-09-20T21:05:37.536193+0000","last_clean":"2024-09-20T21:05:37.536193+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:37.536193+0000","last_undegraded":"2024-09-20T21:05:37.536193+0000","last_fullsized":"2024-09-20T21:05:37.536193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:41.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538618+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:37.538618+0000","last_peered":"2024-09-20T21:05:37.538618+0000","last_clean":"2024-09-20T21:05:37.538618+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:37.538618+0000","last_undegraded":"2024-09-20T21:05:37.538618+0000","last_fullsized":"2024-09-20T21:05:37.538618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:04.604590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537096+0000","last_change":"2024-09-20T21:05:33.511358+0000","last_active":"2024-09-20T21:05:37.537096+0000","last_peered":"2024-09-20T21:05:37.537096+0000","last_clean":"2024-09-20T21:05:37.537096+0000","last_became_active":"2024-09-20T21:05:33.507647+0000","last_became_peered":"2024-09-20T21:05:33.507647+0000","last_unstale":"2024-09-20T21:05:37.537096+0000","last_undegraded":"2024-09-20T21:05:37.537096+0000","last_fullsized":"2024-09-20T21:05:37.537096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:44:55.328542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537812+0000","last_change":"2024-09-20T21:05:33.506588+0000","last_active":"2024-09-20T21:05:37.537812+0000","last_peered":"2024-09-20T21:05:37.537812+0000","last_clean":"2024-09-20T21:05:37.537812+0000","last_became_active":"2024-09-20T21:05:33.505615+0000","last_became_peered":"2024-09-20T21:05:33.505615+0000","last_unstale":"2024-09-20T21:05:37.537812+0000","last_undegraded":"2024-09-20T21:05:37.537812+0000","last_fullsized":"2024-09-20T21:05:37.537812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:40.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":102,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.265832+0000","last_change":"2024-09-20T21:03:00.187291+0000","last_active":"2024-09-20T21:05:38.265832+0000","last_peered":"2024-09-20T21:05:38.265832+0000","last_clean":"2024-09-20T21:05:38.265832+0000","last_became_active":"2024-09-20T21:03:00.186993+0000","last_became_peered":"2024-09-20T21:03:00.186993+0000","last_unstale":"2024-09-20T21:05:38.265832+0000","last_undegraded":"2024-09-20T21:05:38.265832+0000","last_fullsized":"2024-09-20T21:05:38.265832+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:54:14.917606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538720+0000","last_change":"2024-09-20T21:05:33.529620+0000","last_active":"2024-09-20T21:05:37.538720+0000","last_peered":"2024-09-20T21:05:37.538720+0000","last_clean":"2024-09-20T21:05:37.538720+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:05:37.538720+0000","last_undegraded":"2024-09-20T21:05:37.538720+0000","last_fullsized":"2024-09-20T21:05:37.538720+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:39.374497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.539097+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:37.539097+0000","last_peered":"2024-09-20T21:05:37.539097+0000","last_clean":"2024-09-20T21:05:37.539097+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:37.539097+0000","last_undegraded":"2024-09-20T21:05:37.539097+0000","last_fullsized":"2024-09-20T21:05:37.539097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:30.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537652+0000","last_change":"2024-09-20T21:05:33.516924+0000","last_active":"2024-09-20T21:05:37.537652+0000","last_peered":"2024-09-20T21:05:37.537652+0000","last_clean":"2024-09-20T21:05:37.537652+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:05:37.537652+0000","last_undegraded":"2024-09-20T21:05:37.537652+0000","last_fullsized":"2024-09-20T21:05:37.537652+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:55.590471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538921+0000","last_change":"2024-09-20T21:05:33.525586+0000","last_active":"2024-09-20T21:05:37.538921+0000","last_peered":"2024-09-20T21:05:37.538921+0000","last_clean":"2024-09-20T21:05:37.538921+0000","last_became_active":"2024-09-20T21:05:33.522980+0000","last_became_peered":"2024-09-20T21:05:33.522980+0000","last_unstale":"2024-09-20T21:05:37.538921+0000","last_undegraded":"2024-09-20T21:05:37.538921+0000","last_fullsized":"2024-09-20T21:05:37.538921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:02.419755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":158,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.334911+0000","last_change":"2024-09-20T21:05:34.264426+0000","last_active":"2024-09-20T21:05:39.334911+0000","last_peered":"2024-09-20T21:05:39.334911+0000","last_clean":"2024-09-20T21:05:39.334911+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:05:39.334911+0000","last_undegraded":"2024-09-20T21:05:39.334911+0000","last_fullsized":"2024-09-20T21:05:39.334911+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:23.886272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.539849+0000","last_change":"2024-09-20T21:05:33.517281+0000","last_active":"2024-09-20T21:05:37.539849+0000","last_peered":"2024-09-20T21:05:37.539849+0000","last_clean":"2024-09-20T21:05:37.539849+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:05:37.539849+0000","last_undegraded":"2024-09-20T21:05:37.539849+0000","last_fullsized":"2024-09-20T21:05:37.539849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:44.497231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537002+0000","last_change":"2024-09-20T21:05:33.523216+0000","last_active":"2024-09-20T21:05:37.537002+0000","last_peered":"2024-09-20T21:05:37.537002+0000","last_clean":"2024-09-20T21:05:37.537002+0000","last_became_active":"2024-09-20T21:05:33.516684+0000","last_became_peered":"2024-09-20T21:05:33.516684+0000","last_unstale":"2024-09-20T21:05:37.537002+0000","last_undegraded":"2024-09-20T21:05:37.537002+0000","last_fullsized":"2024-09-20T21:05:37.537002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:33:12.817332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538448+0000","last_change":"2024-09-20T21:05:33.527473+0000","last_active":"2024-09-20T21:05:37.538448+0000","last_peered":"2024-09-20T21:05:37.538448+0000","last_clean":"2024-09-20T21:05:37.538448+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:05:37.538448+0000","last_undegraded":"2024-09-20T21:05:37.538448+0000","last_fullsized":"2024-09-20T21:05:37.538448+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:43.880199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266242+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:38.266242+0000","last_peered":"2024-09-20T21:05:38.266242+0000","last_clean":"2024-09-20T21:05:38.266242+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:38.266242+0000","last_undegraded":"2024-09-20T21:05:38.266242+0000","last_fullsized":"2024-09-20T21:05:38.266242+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:06:41.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538570+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:37.538570+0000","last_peered":"2024-09-20T21:05:37.538570+0000","last_clean":"2024-09-20T21:05:37.538570+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:37.538570+0000","last_undegraded":"2024-09-20T21:05:37.538570+0000","last_fullsized":"2024-09-20T21:05:37.538570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:57.275101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":104,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.265741+0000","last_change":"2024-09-20T21:03:00.182491+0000","last_active":"2024-09-20T21:05:38.265741+0000","last_peered":"2024-09-20T21:05:38.265741+0000","last_clean":"2024-09-20T21:05:38.265741+0000","last_became_active":"2024-09-20T21:03:00.181363+0000","last_became_peered":"2024-09-20T21:03:00.181363+0000","last_unstale":"2024-09-20T21:05:38.265741+0000","last_undegraded":"2024-09-20T21:05:38.265741+0000","last_fullsized":"2024-09-20T21:05:38.265741+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:28.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":147,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.335398+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:05:39.335398+0000","last_peered":"2024-09-20T21:05:39.335398+0000","last_clean":"2024-09-20T21:05:39.335398+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:05:39.335398+0000","last_undegraded":"2024-09-20T21:05:39.335398+0000","last_fullsized":"2024-09-20T21:05:39.335398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":255,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.535993+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:37.535993+0000","last_peered":"2024-09-20T21:05:37.535993+0000","last_clean":"2024-09-20T21:05:37.535993+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:37.535993+0000","last_undegraded":"2024-09-20T21:05:37.535993+0000","last_fullsized":"2024-09-20T21:05:37.535993+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:49.545054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536728+0000","last_change":"2024-09-20T21:05:33.516926+0000","last_active":"2024-09-20T21:05:37.536728+0000","last_peered":"2024-09-20T21:05:37.536728+0000","last_clean":"2024-09-20T21:05:37.536728+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:05:37.536728+0000","last_undegraded":"2024-09-20T21:05:37.536728+0000","last_fullsized":"2024-09-20T21:05:37.536728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:48.429167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.334334+0000","last_change":"2024-09-20T21:05:37.268775+0000","last_active":"2024-09-20T21:05:39.334334+0000","last_peered":"2024-09-20T21:05:39.334334+0000","last_clean":"2024-09-20T21:05:39.334334+0000","last_became_active":"2024-09-20T21:05:37.267211+0000","last_became_peered":"2024-09-20T21:05:37.267211+0000","last_unstale":"2024-09-20T21:05:39.334334+0000","last_undegraded":"2024-09-20T21:05:39.334334+0000","last_fullsized":"2024-09-20T21:05:39.334334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:50.497847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.539049+0000","last_change":"2024-09-20T21:05:33.527863+0000","last_active":"2024-09-20T21:05:37.539049+0000","last_peered":"2024-09-20T21:05:37.539049+0000","last_clean":"2024-09-20T21:05:37.539049+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:05:37.539049+0000","last_undegraded":"2024-09-20T21:05:37.539049+0000","last_fullsized":"2024-09-20T21:05:37.539049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:28.039071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536639+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:37.536639+0000","last_peered":"2024-09-20T21:05:37.536639+0000","last_clean":"2024-09-20T21:05:37.536639+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:37.536639+0000","last_undegraded":"2024-09-20T21:05:37.536639+0000","last_fullsized":"2024-09-20T21:05:37.536639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:58.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536346+0000","last_change":"2024-09-20T21:05:33.517511+0000","last_active":"2024-09-20T21:05:37.536346+0000","last_peered":"2024-09-20T21:05:37.536346+0000","last_clean":"2024-09-20T21:05:37.536346+0000","last_became_active":"2024-09-20T21:05:33.512528+0000","last_became_peered":"2024-09-20T21:05:33.512528+0000","last_unstale":"2024-09-20T21:05:37.536346+0000","last_undegraded":"2024-09-20T21:05:37.536346+0000","last_fullsized":"2024-09-20T21:05:37.536346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:12:56.968567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":147,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.267666+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:38.267666+0000","last_peered":"2024-09-20T21:05:38.267666+0000","last_clean":"2024-09-20T21:05:38.267666+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:38.267666+0000","last_undegraded":"2024-09-20T21:05:38.267666+0000","last_fullsized":"2024-09-20T21:05:38.267666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.332939+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:39.332939+0000","last_peered":"2024-09-20T21:05:39.332939+0000","last_clean":"2024-09-20T21:05:39.332939+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:39.332939+0000","last_undegraded":"2024-09-20T21:05:39.332939+0000","last_fullsized":"2024-09-20T21:05:39.332939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536032+0000","last_change":"2024-09-20T21:05:33.506109+0000","last_active":"2024-09-20T21:05:37.536032+0000","last_peered":"2024-09-20T21:05:37.536032+0000","last_clean":"2024-09-20T21:05:37.536032+0000","last_became_active":"2024-09-20T21:05:33.505217+0000","last_became_peered":"2024-09-20T21:05:33.505217+0000","last_unstale":"2024-09-20T21:05:37.536032+0000","last_undegraded":"2024-09-20T21:05:37.536032+0000","last_fullsized":"2024-09-20T21:05:37.536032+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:35.484677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.267478+0000","last_change":"2024-09-20T21:03:00.182222+0000","last_active":"2024-09-20T21:05:38.267478+0000","last_peered":"2024-09-20T21:05:38.267478+0000","last_clean":"2024-09-20T21:05:38.267478+0000","last_became_active":"2024-09-20T21:03:00.181621+0000","last_became_peered":"2024-09-20T21:03:00.181621+0000","last_unstale":"2024-09-20T21:05:38.267478+0000","last_undegraded":"2024-09-20T21:05:38.267478+0000","last_fullsized":"2024-09-20T21:05:38.267478+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:17.147485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536502+0000","last_change":"2024-09-20T21:05:33.525394+0000","last_active":"2024-09-20T21:05:37.536502+0000","last_peered":"2024-09-20T21:05:37.536502+0000","last_clean":"2024-09-20T21:05:37.536502+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:05:37.536502+0000","last_undegraded":"2024-09-20T21:05:37.536502+0000","last_fullsized":"2024-09-20T21:05:37.536502+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:51:33.922257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536862+0000","last_change":"2024-09-20T21:05:33.522984+0000","last_active":"2024-09-20T21:05:37.536862+0000","last_peered":"2024-09-20T21:05:37.536862+0000","last_clean":"2024-09-20T21:05:37.536862+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:05:37.536862+0000","last_undegraded":"2024-09-20T21:05:37.536862+0000","last_fullsized":"2024-09-20T21:05:37.536862+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:22:14.870718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266155+0000","last_change":"2024-09-20T21:03:00.181764+0000","last_active":"2024-09-20T21:05:38.266155+0000","last_peered":"2024-09-20T21:05:38.266155+0000","last_clean":"2024-09-20T21:05:38.266155+0000","last_became_active":"2024-09-20T21:03:00.181125+0000","last_became_peered":"2024-09-20T21:03:00.181125+0000","last_unstale":"2024-09-20T21:05:38.266155+0000","last_undegraded":"2024-09-20T21:05:38.266155+0000","last_fullsized":"2024-09-20T21:05:38.266155+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:58.632807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537479+0000","last_change":"2024-09-20T21:05:33.530100+0000","last_active":"2024-09-20T21:05:37.537479+0000","last_peered":"2024-09-20T21:05:37.537479+0000","last_clean":"2024-09-20T21:05:37.537479+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:05:37.537479+0000","last_undegraded":"2024-09-20T21:05:37.537479+0000","last_fullsized":"2024-09-20T21:05:37.537479+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:12.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.332939+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:39.332939+0000","last_peered":"2024-09-20T21:05:39.332939+0000","last_clean":"2024-09-20T21:05:39.332939+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:39.332939+0000","last_undegraded":"2024-09-20T21:05:39.332939+0000","last_fullsized":"2024-09-20T21:05:39.332939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":154,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266192+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:38.266192+0000","last_peered":"2024-09-20T21:05:38.266192+0000","last_clean":"2024-09-20T21:05:38.266192+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:38.266192+0000","last_undegraded":"2024-09-20T21:05:38.266192+0000","last_fullsized":"2024-09-20T21:05:38.266192+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:03.961332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":150,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.334991+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:39.334991+0000","last_peered":"2024-09-20T21:05:39.334991+0000","last_clean":"2024-09-20T21:05:39.334991+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:39.334991+0000","last_undegraded":"2024-09-20T21:05:39.334991+0000","last_fullsized":"2024-09-20T21:05:39.334991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":117,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.267988+0000","last_change":"2024-09-20T21:03:00.186668+0000","last_active":"2024-09-20T21:05:38.267988+0000","last_peered":"2024-09-20T21:05:38.267988+0000","last_clean":"2024-09-20T21:05:38.267988+0000","last_became_active":"2024-09-20T21:03:00.186259+0000","last_became_peered":"2024-09-20T21:03:00.186259+0000","last_unstale":"2024-09-20T21:05:38.267988+0000","last_undegraded":"2024-09-20T21:05:38.267988+0000","last_fullsized":"2024-09-20T21:05:38.267988+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:42:58.237986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538760+0000","last_change":"2024-09-20T21:05:33.509455+0000","last_active":"2024-09-20T21:05:37.538760+0000","last_peered":"2024-09-20T21:05:37.538760+0000","last_clean":"2024-09-20T21:05:37.538760+0000","last_became_active":"2024-09-20T21:05:33.508553+0000","last_became_peered":"2024-09-20T21:05:33.508553+0000","last_unstale":"2024-09-20T21:05:37.538760+0000","last_undegraded":"2024-09-20T21:05:37.538760+0000","last_fullsized":"2024-09-20T21:05:37.538760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:16:44.519386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":152,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.335714+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:39.335714+0000","last_peered":"2024-09-20T21:05:39.335714+0000","last_clean":"2024-09-20T21:05:39.335714+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:39.335714+0000","last_undegraded":"2024-09-20T21:05:39.335714+0000","last_fullsized":"2024-09-20T21:05:39.335714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.332928+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:05:39.332928+0000","last_peered":"2024-09-20T21:05:39.332928+0000","last_clean":"2024-09-20T21:05:39.332928+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:05:39.332928+0000","last_undegraded":"2024-09-20T21:05:39.332928+0000","last_fullsized":"2024-09-20T21:05:39.332928+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.334034+0000","last_change":"2024-09-20T21:05:37.267287+0000","last_active":"2024-09-20T21:05:39.334034+0000","last_peered":"2024-09-20T21:05:39.334034+0000","last_clean":"2024-09-20T21:05:39.334034+0000","last_became_active":"2024-09-20T21:05:37.266438+0000","last_became_peered":"2024-09-20T21:05:37.266438+0000","last_unstale":"2024-09-20T21:05:39.334034+0000","last_undegraded":"2024-09-20T21:05:39.334034+0000","last_fullsized":"2024-09-20T21:05:39.334034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":158,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.335730+0000","last_change":"2024-09-20T21:05:34.264862+0000","last_active":"2024-09-20T21:05:39.335730+0000","last_peered":"2024-09-20T21:05:39.335730+0000","last_clean":"2024-09-20T21:05:39.335730+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:05:39.335730+0000","last_undegraded":"2024-09-20T21:05:39.335730+0000","last_fullsized":"2024-09-20T21:05:39.335730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:32.512356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538101+0000","last_change":"2024-09-20T21:05:33.508633+0000","last_active":"2024-09-20T21:05:37.538101+0000","last_peered":"2024-09-20T21:05:37.538101+0000","last_clean":"2024-09-20T21:05:37.538101+0000","last_became_active":"2024-09-20T21:05:33.505595+0000","last_became_peered":"2024-09-20T21:05:33.505595+0000","last_unstale":"2024-09-20T21:05:37.538101+0000","last_undegraded":"2024-09-20T21:05:37.538101+0000","last_fullsized":"2024-09-20T21:05:37.538101+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:10.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537560+0000","last_change":"2024-09-20T21:05:33.507358+0000","last_active":"2024-09-20T21:05:37.537560+0000","last_peered":"2024-09-20T21:05:37.537560+0000","last_clean":"2024-09-20T21:05:37.537560+0000","last_became_active":"2024-09-20T21:05:33.506544+0000","last_became_peered":"2024-09-20T21:05:33.506544+0000","last_unstale":"2024-09-20T21:05:37.537560+0000","last_undegraded":"2024-09-20T21:05:37.537560+0000","last_fullsized":"2024-09-20T21:05:37.537560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:00.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537730+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:37.537730+0000","last_peered":"2024-09-20T21:05:37.537730+0000","last_clean":"2024-09-20T21:05:37.537730+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:37.537730+0000","last_undegraded":"2024-09-20T21:05:37.537730+0000","last_fullsized":"2024-09-20T21:05:37.537730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:49.172273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538143+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:37.538143+0000","last_peered":"2024-09-20T21:05:37.538143+0000","last_clean":"2024-09-20T21:05:37.538143+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:37.538143+0000","last_undegraded":"2024-09-20T21:05:37.538143+0000","last_fullsized":"2024-09-20T21:05:37.538143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:07:07.242939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":147,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.333792+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:05:39.333792+0000","last_peered":"2024-09-20T21:05:39.333792+0000","last_clean":"2024-09-20T21:05:39.333792+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:05:39.333792+0000","last_undegraded":"2024-09-20T21:05:39.333792+0000","last_fullsized":"2024-09-20T21:05:39.333792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538305+0000","last_change":"2024-09-20T21:05:33.528236+0000","last_active":"2024-09-20T21:05:37.538305+0000","last_peered":"2024-09-20T21:05:37.538305+0000","last_clean":"2024-09-20T21:05:37.538305+0000","last_became_active":"2024-09-20T21:05:33.516911+0000","last_became_peered":"2024-09-20T21:05:33.516911+0000","last_unstale":"2024-09-20T21:05:37.538305+0000","last_undegraded":"2024-09-20T21:05:37.538305+0000","last_fullsized":"2024-09-20T21:05:37.538305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:52.563724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.538170+0000","last_change":"2024-09-20T21:05:33.525151+0000","last_active":"2024-09-20T21:05:37.538170+0000","last_peered":"2024-09-20T21:05:37.538170+0000","last_clean":"2024-09-20T21:05:37.538170+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:05:37.538170+0000","last_undegraded":"2024-09-20T21:05:37.538170+0000","last_fullsized":"2024-09-20T21:05:37.538170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:51.245496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537746+0000","last_change":"2024-09-20T21:05:33.525313+0000","last_active":"2024-09-20T21:05:37.537746+0000","last_peered":"2024-09-20T21:05:37.537746+0000","last_clean":"2024-09-20T21:05:37.537746+0000","last_became_active":"2024-09-20T21:05:33.517931+0000","last_became_peered":"2024-09-20T21:05:33.517931+0000","last_unstale":"2024-09-20T21:05:37.537746+0000","last_undegraded":"2024-09-20T21:05:37.537746+0000","last_fullsized":"2024-09-20T21:05:37.537746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:15.962153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.335572+0000","last_change":"2024-09-20T21:05:34.264735+0000","last_active":"2024-09-20T21:05:39.335572+0000","last_peered":"2024-09-20T21:05:39.335572+0000","last_clean":"2024-09-20T21:05:39.335572+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:05:39.335572+0000","last_undegraded":"2024-09-20T21:05:39.335572+0000","last_fullsized":"2024-09-20T21:05:39.335572+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:16.718841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":68,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.265399+0000","last_change":"2024-09-20T21:05:37.271547+0000","last_active":"2024-09-20T21:05:38.265399+0000","last_peered":"2024-09-20T21:05:38.265399+0000","last_clean":"2024-09-20T21:05:38.265399+0000","last_became_active":"2024-09-20T21:05:37.270710+0000","last_became_peered":"2024-09-20T21:05:37.270710+0000","last_unstale":"2024-09-20T21:05:38.265399+0000","last_undegraded":"2024-09-20T21:05:38.265399+0000","last_fullsized":"2024-09-20T21:05:38.265399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.882020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":154,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.268104+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:38.268104+0000","last_peered":"2024-09-20T21:05:38.268104+0000","last_clean":"2024-09-20T21:05:38.268104+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:38.268104+0000","last_undegraded":"2024-09-20T21:05:38.268104+0000","last_fullsized":"2024-09-20T21:05:38.268104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:39.486200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.333178+0000","last_change":"2024-09-20T21:05:37.269662+0000","last_active":"2024-09-20T21:05:39.333178+0000","last_peered":"2024-09-20T21:05:39.333178+0000","last_clean":"2024-09-20T21:05:39.333178+0000","last_became_active":"2024-09-20T21:05:37.268982+0000","last_became_peered":"2024-09-20T21:05:37.268982+0000","last_unstale":"2024-09-20T21:05:39.333178+0000","last_undegraded":"2024-09-20T21:05:39.333178+0000","last_fullsized":"2024-09-20T21:05:39.333178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:38.474304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537853+0000","last_change":"2024-09-20T21:05:33.525291+0000","last_active":"2024-09-20T21:05:37.537853+0000","last_peered":"2024-09-20T21:05:37.537853+0000","last_clean":"2024-09-20T21:05:37.537853+0000","last_became_active":"2024-09-20T21:05:33.523537+0000","last_became_peered":"2024-09-20T21:05:33.523537+0000","last_unstale":"2024-09-20T21:05:37.537853+0000","last_undegraded":"2024-09-20T21:05:37.537853+0000","last_fullsized":"2024-09-20T21:05:37.537853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:42.985077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536324+0000","last_change":"2024-09-20T21:05:36.539030+0000","last_active":"2024-09-20T21:05:37.536324+0000","last_peered":"2024-09-20T21:05:37.536324+0000","last_clean":"2024-09-20T21:05:37.536324+0000","last_became_active":"2024-09-20T21:05:36.538325+0000","last_became_peered":"2024-09-20T21:05:36.538325+0000","last_unstale":"2024-09-20T21:05:37.536324+0000","last_undegraded":"2024-09-20T21:05:37.536324+0000","last_fullsized":"2024-09-20T21:05:37.536324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:48.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537992+0000","last_change":"2024-09-20T21:05:33.528150+0000","last_active":"2024-09-20T21:05:37.537992+0000","last_peered":"2024-09-20T21:05:37.537992+0000","last_clean":"2024-09-20T21:05:37.537992+0000","last_became_active":"2024-09-20T21:05:33.512623+0000","last_became_peered":"2024-09-20T21:05:33.512623+0000","last_unstale":"2024-09-20T21:05:37.537992+0000","last_undegraded":"2024-09-20T21:05:37.537992+0000","last_fullsized":"2024-09-20T21:05:37.537992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:08.142904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":104,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266632+0000","last_change":"2024-09-20T21:03:00.182809+0000","last_active":"2024-09-20T21:05:38.266632+0000","last_peered":"2024-09-20T21:05:38.266632+0000","last_clean":"2024-09-20T21:05:38.266632+0000","last_became_active":"2024-09-20T21:03:00.182423+0000","last_became_peered":"2024-09-20T21:03:00.182423+0000","last_unstale":"2024-09-20T21:05:38.266632+0000","last_undegraded":"2024-09-20T21:05:38.266632+0000","last_fullsized":"2024-09-20T21:05:38.266632+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:26.732116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":105,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266905+0000","last_change":"2024-09-20T21:05:37.272630+0000","last_active":"2024-09-20T21:05:38.266905+0000","last_peered":"2024-09-20T21:05:38.266905+0000","last_clean":"2024-09-20T21:05:38.266905+0000","last_became_active":"2024-09-20T21:05:37.271856+0000","last_became_peered":"2024-09-20T21:05:37.271856+0000","last_unstale":"2024-09-20T21:05:38.266905+0000","last_undegraded":"2024-09-20T21:05:38.266905+0000","last_fullsized":"2024-09-20T21:05:38.266905+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:22:06.703099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537152+0000","last_change":"2024-09-20T21:05:33.508991+0000","last_active":"2024-09-20T21:05:37.537152+0000","last_peered":"2024-09-20T21:05:37.537152+0000","last_clean":"2024-09-20T21:05:37.537152+0000","last_became_active":"2024-09-20T21:05:33.507155+0000","last_became_peered":"2024-09-20T21:05:33.507155+0000","last_unstale":"2024-09-20T21:05:37.537152+0000","last_undegraded":"2024-09-20T21:05:37.537152+0000","last_fullsized":"2024-09-20T21:05:37.537152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:04:20.632178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537470+0000","last_change":"2024-09-20T21:05:33.523783+0000","last_active":"2024-09-20T21:05:37.537470+0000","last_peered":"2024-09-20T21:05:37.537470+0000","last_clean":"2024-09-20T21:05:37.537470+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:05:37.537470+0000","last_undegraded":"2024-09-20T21:05:37.537470+0000","last_fullsized":"2024-09-20T21:05:37.537470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:29.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537085+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:37.537085+0000","last_peered":"2024-09-20T21:05:37.537085+0000","last_clean":"2024-09-20T21:05:37.537085+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:37.537085+0000","last_undegraded":"2024-09-20T21:05:37.537085+0000","last_fullsized":"2024-09-20T21:05:37.537085+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:45:47.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537803+0000","last_change":"2024-09-20T21:05:33.525036+0000","last_active":"2024-09-20T21:05:37.537803+0000","last_peered":"2024-09-20T21:05:37.537803+0000","last_clean":"2024-09-20T21:05:37.537803+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:05:37.537803+0000","last_undegraded":"2024-09-20T21:05:37.537803+0000","last_fullsized":"2024-09-20T21:05:37.537803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:13.120671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.537310+0000","last_change":"2024-09-20T21:05:33.525496+0000","last_active":"2024-09-20T21:05:37.537310+0000","last_peered":"2024-09-20T21:05:37.537310+0000","last_clean":"2024-09-20T21:05:37.537310+0000","last_became_active":"2024-09-20T21:05:33.511914+0000","last_became_peered":"2024-09-20T21:05:33.511914+0000","last_unstale":"2024-09-20T21:05:37.537310+0000","last_undegraded":"2024-09-20T21:05:37.537310+0000","last_fullsized":"2024-09-20T21:05:37.537310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:47:40.771092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:38.266507+0000","last_change":"2024-09-20T21:03:00.186986+0000","last_active":"2024-09-20T21:05:38.266507+0000","last_peered":"2024-09-20T21:05:38.266507+0000","last_clean":"2024-09-20T21:05:38.266507+0000","last_became_active":"2024-09-20T21:03:00.186450+0000","last_became_peered":"2024-09-20T21:03:00.186450+0000","last_unstale":"2024-09-20T21:05:38.266507+0000","last_undegraded":"2024-09-20T21:05:38.266507+0000","last_fullsized":"2024-09-20T21:05:38.266507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:16:39.776258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":151,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:39.335424+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:39.335424+0000","last_peered":"2024-09-20T21:05:39.335424+0000","last_clean":"2024-09-20T21:05:39.335424+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:39.335424+0000","last_undegraded":"2024-09-20T21:05:39.335424+0000","last_fullsized":"2024-09-20T21:05:39.335424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.536847+0000","last_change":"2024-09-20T21:05:33.529399+0000","last_active":"2024-09-20T21:05:37.536847+0000","last_peered":"2024-09-20T21:05:37.536847+0000","last_clean":"2024-09-20T21:05:37.536847+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:05:37.536847+0000","last_undegraded":"2024-09-20T21:05:37.536847+0000","last_fullsized":"2024-09-20T21:05:37.536847+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:36.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-20T21:05:37.539388+0000","last_change":"2024-09-20T21:05:36.551627+0000","last_active":"2024-09-20T21:05:37.539388+0000","last_peered":"2024-09-20T21:05:37.539388+0000","last_clean":"2024-09-20T21:05:37.539388+0000","last_became_active":"2024-09-20T21:05:36.542121+0000","last_became_peered":"2024-09-20T21:05:36.542121+0000","last_unstale":"2024-09-20T21:05:37.539388+0000","last_undegraded":"2024-09-20T21:05:37.539388+0000","last_fullsized":"2024-09-20T21:05:37.539388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:30.528499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738428,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216860,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94154980,"statfs":{"total":96636764160,"available":96414699520,"internally_reserved":0,"allocated":1052672,"data_stored":966242,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350979,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54568,"kb_used_data":1040,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317272,"statfs":{"total":96636764160,"available":96580886528,"internally_reserved":0,"allocated":1064960,"data_stored":966877,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325072,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046768,"statfs":{"total":96636764160,"available":96303890432,"internally_reserved":0,"allocated":970752,"data_stored":370483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:05:43.054 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-20T21:05:43.054 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T21:05:43.054 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-20T21:05:43.054 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.704026 2024-09-20T21:05:43.054 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.7040259479562582 2024-09-20T21:05:44.285 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.0 primary-affinity to 0.704026 (8461392) 2024-09-20T21:05:49.315 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-20T21:05:49.459 INFO:teuthology.orchestra.run.smithi112.stdout:mon.a: {} 2024-09-20T21:05:49.460 INFO:teuthology.orchestra.run.smithi112.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T21:05:49.468 INFO:teuthology.orchestra.run.smithi112.stdout:mon.b: {} 2024-09-20T21:05:49.468 INFO:teuthology.orchestra.run.smithi112.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T21:05:49.478 INFO:teuthology.orchestra.run.smithi112.stdout:mon.c: {} 2024-09-20T21:05:49.478 INFO:teuthology.orchestra.run.smithi112.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T21:05:49.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-20T21:05:50.045 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.0 to 1 (10000) 2024-09-20T21:05:50.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-20T21:05:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-20T21:05:51.092 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-20T21:05:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.2 to 1 (10000) 2024-09-20T21:05:52.107 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-20T21:05:53.092 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-20T21:05:53.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-20T21:05:54.106 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.1 to 1 (10000) 2024-09-20T21:05:54.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-20T21:05:55.111 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-20T21:05:55.137 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-20T21:05:55.137 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-20T21:05:55.137 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-20T21:05:55.137 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-20T21:05:55.138 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-20T21:05:55.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:05:55.424 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:55.424 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:05:55.102052+0000","last_up_change":"2024-09-20T21:05:33.199849+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T21:01:05.455429+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T21:01:10.047761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T21:01:10.524533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":47,"up_from":81,"up_thru":84,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6801","nonce":1262267524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6803","nonce":1262267524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6807","nonce":1262267524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6805","nonce":1262267524}]},"public_addr":"172.21.15.161:6801/1262267524","cluster_addr":"172.21.15.161:6803/1262267524","heartbeat_back_addr":"172.21.15.161:6807/1262267524","heartbeat_front_addr":"172.21.15.161:6805/1262267524","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":47},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:05:55.443 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-20T21:05:55.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:05:55.714 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:55.714 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:05:55.102052+0000","last_up_change":"2024-09-20T21:05:33.199849+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T21:01:05.455429+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T21:01:10.047761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T21:01:10.524533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":47,"up_from":81,"up_thru":84,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6801","nonce":1262267524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6803","nonce":1262267524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6807","nonce":1262267524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6805","nonce":1262267524}]},"public_addr":"172.21.15.161:6801/1262267524","cluster_addr":"172.21.15.161:6803/1262267524","heartbeat_back_addr":"172.21.15.161:6807/1262267524","heartbeat_front_addr":"172.21.15.161:6805/1262267524","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":47},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:05:55.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-20T21:05:55.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-20T21:05:55.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-20T21:05:55.882 INFO:teuthology.orchestra.run.smithi112.stdout:34359738432 2024-09-20T21:05:55.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-20T21:05:55.894 INFO:teuthology.orchestra.run.smithi112.stdout:347892350982 2024-09-20T21:05:55.894 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-20T21:05:55.899 INFO:teuthology.orchestra.run.smithi112.stdout:34359738432 2024-09-20T21:05:55.900 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-20T21:05:56.178 INFO:teuthology.orchestra.run.smithi112.stdout:34359738430 2024-09-20T21:05:56.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738432 got 34359738430 for osd.0 2024-09-20T21:05:56.242 INFO:teuthology.orchestra.run.smithi112.stdout:347892350981 2024-09-20T21:05:56.247 INFO:teuthology.orchestra.run.smithi112.stdout:34359738430 2024-09-20T21:05:56.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 347892350982 got 347892350981 for osd.1 2024-09-20T21:05:56.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738432 got 34359738430 for osd.2 2024-09-20T21:05:57.196 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-20T21:05:57.263 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-20T21:05:57.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-20T21:05:57.506 INFO:teuthology.orchestra.run.smithi112.stdout:34359738432 2024-09-20T21:05:57.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738432 got 34359738432 for osd.0 2024-09-20T21:05:57.524 DEBUG:teuthology.parallel:result is None 2024-09-20T21:05:57.557 INFO:teuthology.orchestra.run.smithi112.stdout:347892350982 2024-09-20T21:05:57.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 347892350982 got 347892350982 for osd.1 2024-09-20T21:05:57.574 DEBUG:teuthology.parallel:result is None 2024-09-20T21:05:57.594 INFO:teuthology.orchestra.run.smithi112.stdout:34359738432 2024-09-20T21:05:57.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738432 got 34359738432 for osd.2 2024-09-20T21:05:57.612 DEBUG:teuthology.parallel:result is None 2024-09-20T21:05:57.612 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-20T21:05:57.613 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:05:57.945 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:57.947 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:05:57.962 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-20T21:05:56.992174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596696,"kb_used_data":3216,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282518824,"statfs":{"total":289910292480,"available":289299275776,"internally_reserved":0,"allocated":3293184,"data_stored":2409450,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001472"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117741+0000","last_change":"2024-09-20T21:05:54.129746+0000","last_active":"2024-09-20T21:05:55.117741+0000","last_peered":"2024-09-20T21:05:55.117741+0000","last_clean":"2024-09-20T21:05:55.117741+0000","last_became_active":"2024-09-20T21:05:54.127664+0000","last_became_peered":"2024-09-20T21:05:54.127664+0000","last_unstale":"2024-09-20T21:05:55.117741+0000","last_undegraded":"2024-09-20T21:05:55.117741+0000","last_fullsized":"2024-09-20T21:05:55.117741+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:57.952046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117563+0000","last_change":"2024-09-20T21:05:54.126721+0000","last_active":"2024-09-20T21:05:55.117563+0000","last_peered":"2024-09-20T21:05:55.117563+0000","last_clean":"2024-09-20T21:05:55.117563+0000","last_became_active":"2024-09-20T21:05:54.124269+0000","last_became_peered":"2024-09-20T21:05:54.124269+0000","last_unstale":"2024-09-20T21:05:55.117563+0000","last_undegraded":"2024-09-20T21:05:55.117563+0000","last_fullsized":"2024-09-20T21:05:55.117563+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.389708+0000","last_change":"2024-09-20T21:05:33.529595+0000","last_active":"2024-09-20T21:05:54.389708+0000","last_peered":"2024-09-20T21:05:54.389708+0000","last_clean":"2024-09-20T21:05:54.389708+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:05:54.389708+0000","last_undegraded":"2024-09-20T21:05:54.389708+0000","last_fullsized":"2024-09-20T21:05:54.389708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:08.234369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387690+0000","last_change":"2024-09-20T21:05:33.516896+0000","last_active":"2024-09-20T21:05:54.387690+0000","last_peered":"2024-09-20T21:05:54.387690+0000","last_clean":"2024-09-20T21:05:54.387690+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:05:54.387690+0000","last_undegraded":"2024-09-20T21:05:54.387690+0000","last_fullsized":"2024-09-20T21:05:54.387690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:48.472114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116748+0000","last_change":"2024-09-20T21:05:54.130938+0000","last_active":"2024-09-20T21:05:55.116748+0000","last_peered":"2024-09-20T21:05:55.116748+0000","last_clean":"2024-09-20T21:05:55.116748+0000","last_became_active":"2024-09-20T21:05:54.125511+0000","last_became_peered":"2024-09-20T21:05:54.125511+0000","last_unstale":"2024-09-20T21:05:55.116748+0000","last_undegraded":"2024-09-20T21:05:55.116748+0000","last_fullsized":"2024-09-20T21:05:55.116748+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:55.659526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387752+0000","last_change":"2024-09-20T21:05:33.526021+0000","last_active":"2024-09-20T21:05:54.387752+0000","last_peered":"2024-09-20T21:05:54.387752+0000","last_clean":"2024-09-20T21:05:54.387752+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:05:54.387752+0000","last_undegraded":"2024-09-20T21:05:54.387752+0000","last_fullsized":"2024-09-20T21:05:54.387752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:51.022212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.105261+0000","last_change":"2024-09-20T21:05:45.317731+0000","last_active":"2024-09-20T21:05:54.105261+0000","last_peered":"2024-09-20T21:05:54.105261+0000","last_clean":"2024-09-20T21:05:54.105261+0000","last_became_active":"2024-09-20T21:05:45.315721+0000","last_became_peered":"2024-09-20T21:05:45.315721+0000","last_unstale":"2024-09-20T21:05:54.105261+0000","last_undegraded":"2024-09-20T21:05:54.105261+0000","last_fullsized":"2024-09-20T21:05:54.105261+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.882020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386366+0000","last_change":"2024-09-20T21:05:33.527599+0000","last_active":"2024-09-20T21:05:54.386366+0000","last_peered":"2024-09-20T21:05:54.386366+0000","last_clean":"2024-09-20T21:05:54.386366+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:05:54.386366+0000","last_undegraded":"2024-09-20T21:05:54.386366+0000","last_fullsized":"2024-09-20T21:05:54.386366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:19:18.002155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122816+0000","last_change":"2024-09-20T21:05:45.329452+0000","last_active":"2024-09-20T21:05:55.122816+0000","last_peered":"2024-09-20T21:05:55.122816+0000","last_clean":"2024-09-20T21:05:55.122816+0000","last_became_active":"2024-09-20T21:05:45.327207+0000","last_became_peered":"2024-09-20T21:05:45.327207+0000","last_unstale":"2024-09-20T21:05:55.122816+0000","last_undegraded":"2024-09-20T21:05:55.122816+0000","last_fullsized":"2024-09-20T21:05:55.122816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:42.075068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117093+0000","last_change":"2024-09-20T21:05:54.126680+0000","last_active":"2024-09-20T21:05:55.117093+0000","last_peered":"2024-09-20T21:05:55.117093+0000","last_clean":"2024-09-20T21:05:55.117093+0000","last_became_active":"2024-09-20T21:05:54.124291+0000","last_became_peered":"2024-09-20T21:05:54.124291+0000","last_unstale":"2024-09-20T21:05:55.117093+0000","last_undegraded":"2024-09-20T21:05:55.117093+0000","last_fullsized":"2024-09-20T21:05:55.117093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:05.334214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.389492+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:54.389492+0000","last_peered":"2024-09-20T21:05:54.389492+0000","last_clean":"2024-09-20T21:05:54.389492+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:54.389492+0000","last_undegraded":"2024-09-20T21:05:54.389492+0000","last_fullsized":"2024-09-20T21:05:54.389492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:14:10.131416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116730+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:05:55.116730+0000","last_peered":"2024-09-20T21:05:55.116730+0000","last_clean":"2024-09-20T21:05:55.116730+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:05:55.116730+0000","last_undegraded":"2024-09-20T21:05:55.116730+0000","last_fullsized":"2024-09-20T21:05:55.116730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:51.509743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116172+0000","last_change":"2024-09-20T21:05:54.132356+0000","last_active":"2024-09-20T21:05:55.116172+0000","last_peered":"2024-09-20T21:05:55.116172+0000","last_clean":"2024-09-20T21:05:55.116172+0000","last_became_active":"2024-09-20T21:05:54.128147+0000","last_became_peered":"2024-09-20T21:05:54.128147+0000","last_unstale":"2024-09-20T21:05:55.116172+0000","last_undegraded":"2024-09-20T21:05:55.116172+0000","last_fullsized":"2024-09-20T21:05:55.116172+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:07.742615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387439+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:54.387439+0000","last_peered":"2024-09-20T21:05:54.387439+0000","last_clean":"2024-09-20T21:05:54.387439+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:54.387439+0000","last_undegraded":"2024-09-20T21:05:54.387439+0000","last_fullsized":"2024-09-20T21:05:54.387439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:17.867418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387003+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:54.387003+0000","last_peered":"2024-09-20T21:05:54.387003+0000","last_clean":"2024-09-20T21:05:54.387003+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:54.387003+0000","last_undegraded":"2024-09-20T21:05:54.387003+0000","last_fullsized":"2024-09-20T21:05:54.387003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:36.753632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.105532+0000","last_change":"2024-09-20T21:05:45.318518+0000","last_active":"2024-09-20T21:05:54.105532+0000","last_peered":"2024-09-20T21:05:54.105532+0000","last_clean":"2024-09-20T21:05:54.105532+0000","last_became_active":"2024-09-20T21:05:45.317951+0000","last_became_peered":"2024-09-20T21:05:45.317951+0000","last_unstale":"2024-09-20T21:05:54.105532+0000","last_undegraded":"2024-09-20T21:05:54.105532+0000","last_fullsized":"2024-09-20T21:05:54.105532+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:18:16.849565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124476+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:55.124476+0000","last_peered":"2024-09-20T21:05:55.124476+0000","last_clean":"2024-09-20T21:05:55.124476+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:55.124476+0000","last_undegraded":"2024-09-20T21:05:55.124476+0000","last_fullsized":"2024-09-20T21:05:55.124476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117505+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:55.117505+0000","last_peered":"2024-09-20T21:05:55.117505+0000","last_clean":"2024-09-20T21:05:55.117505+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:55.117505+0000","last_undegraded":"2024-09-20T21:05:55.117505+0000","last_fullsized":"2024-09-20T21:05:55.117505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122128+0000","last_change":"2024-09-20T21:05:45.327807+0000","last_active":"2024-09-20T21:05:55.122128+0000","last_peered":"2024-09-20T21:05:55.122128+0000","last_clean":"2024-09-20T21:05:55.122128+0000","last_became_active":"2024-09-20T21:05:45.326913+0000","last_became_peered":"2024-09-20T21:05:45.326913+0000","last_unstale":"2024-09-20T21:05:55.122128+0000","last_undegraded":"2024-09-20T21:05:55.122128+0000","last_fullsized":"2024-09-20T21:05:55.122128+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.107163+0000","last_change":"2024-09-20T21:05:45.324822+0000","last_active":"2024-09-20T21:05:54.107163+0000","last_peered":"2024-09-20T21:05:54.107163+0000","last_clean":"2024-09-20T21:05:54.107163+0000","last_became_active":"2024-09-20T21:05:45.323994+0000","last_became_peered":"2024-09-20T21:05:45.323994+0000","last_unstale":"2024-09-20T21:05:54.107163+0000","last_undegraded":"2024-09-20T21:05:54.107163+0000","last_fullsized":"2024-09-20T21:05:54.107163+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:36.479778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388741+0000","last_change":"2024-09-20T21:05:33.524928+0000","last_active":"2024-09-20T21:05:54.388741+0000","last_peered":"2024-09-20T21:05:54.388741+0000","last_clean":"2024-09-20T21:05:54.388741+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:05:54.388741+0000","last_undegraded":"2024-09-20T21:05:54.388741+0000","last_fullsized":"2024-09-20T21:05:54.388741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:42.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116038+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:55.116038+0000","last_peered":"2024-09-20T21:05:55.116038+0000","last_clean":"2024-09-20T21:05:55.116038+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:55.116038+0000","last_undegraded":"2024-09-20T21:05:55.116038+0000","last_fullsized":"2024-09-20T21:05:55.116038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123406+0000","last_change":"2024-09-20T21:05:52.103930+0000","last_active":"2024-09-20T21:05:55.123406+0000","last_peered":"2024-09-20T21:05:55.123406+0000","last_clean":"2024-09-20T21:05:55.123406+0000","last_became_active":"2024-09-20T21:05:52.103477+0000","last_became_peered":"2024-09-20T21:05:52.103477+0000","last_unstale":"2024-09-20T21:05:55.123406+0000","last_undegraded":"2024-09-20T21:05:55.123406+0000","last_fullsized":"2024-09-20T21:05:55.123406+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115860+0000","last_change":"2024-09-20T21:05:54.133334+0000","last_active":"2024-09-20T21:05:55.115860+0000","last_peered":"2024-09-20T21:05:55.115860+0000","last_clean":"2024-09-20T21:05:55.115860+0000","last_became_active":"2024-09-20T21:05:54.129639+0000","last_became_peered":"2024-09-20T21:05:54.129639+0000","last_unstale":"2024-09-20T21:05:55.115860+0000","last_undegraded":"2024-09-20T21:05:55.115860+0000","last_fullsized":"2024-09-20T21:05:55.115860+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117793+0000","last_change":"2024-09-20T21:05:54.126793+0000","last_active":"2024-09-20T21:05:55.117793+0000","last_peered":"2024-09-20T21:05:55.117793+0000","last_clean":"2024-09-20T21:05:55.117793+0000","last_became_active":"2024-09-20T21:05:54.124757+0000","last_became_peered":"2024-09-20T21:05:54.124757+0000","last_unstale":"2024-09-20T21:05:55.117793+0000","last_undegraded":"2024-09-20T21:05:55.117793+0000","last_fullsized":"2024-09-20T21:05:55.117793+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:46:28.346590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123336+0000","last_change":"2024-09-20T21:05:45.324835+0000","last_active":"2024-09-20T21:05:55.123336+0000","last_peered":"2024-09-20T21:05:55.123336+0000","last_clean":"2024-09-20T21:05:55.123336+0000","last_became_active":"2024-09-20T21:05:45.321767+0000","last_became_peered":"2024-09-20T21:05:45.321767+0000","last_unstale":"2024-09-20T21:05:55.123336+0000","last_undegraded":"2024-09-20T21:05:55.123336+0000","last_fullsized":"2024-09-20T21:05:55.123336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:16.302231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.389311+0000","last_change":"2024-09-20T21:05:33.528984+0000","last_active":"2024-09-20T21:05:54.389311+0000","last_peered":"2024-09-20T21:05:54.389311+0000","last_clean":"2024-09-20T21:05:54.389311+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:05:54.389311+0000","last_undegraded":"2024-09-20T21:05:54.389311+0000","last_fullsized":"2024-09-20T21:05:54.389311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:53.623013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117367+0000","last_change":"2024-09-20T21:05:54.121935+0000","last_active":"2024-09-20T21:05:55.117367+0000","last_peered":"2024-09-20T21:05:55.117367+0000","last_clean":"2024-09-20T21:05:55.117367+0000","last_became_active":"2024-09-20T21:05:54.120990+0000","last_became_peered":"2024-09-20T21:05:54.120990+0000","last_unstale":"2024-09-20T21:05:55.117367+0000","last_undegraded":"2024-09-20T21:05:55.117367+0000","last_fullsized":"2024-09-20T21:05:55.117367+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122633+0000","last_change":"2024-09-20T21:05:37.268677+0000","last_active":"2024-09-20T21:05:55.122633+0000","last_peered":"2024-09-20T21:05:55.122633+0000","last_clean":"2024-09-20T21:05:55.122633+0000","last_became_active":"2024-09-20T21:05:37.267096+0000","last_became_peered":"2024-09-20T21:05:37.267096+0000","last_unstale":"2024-09-20T21:05:55.122633+0000","last_undegraded":"2024-09-20T21:05:55.122633+0000","last_fullsized":"2024-09-20T21:05:55.122633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116342+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:55.116342+0000","last_peered":"2024-09-20T21:05:55.116342+0000","last_clean":"2024-09-20T21:05:55.116342+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:55.116342+0000","last_undegraded":"2024-09-20T21:05:55.116342+0000","last_fullsized":"2024-09-20T21:05:55.116342+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123564+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:55.123564+0000","last_peered":"2024-09-20T21:05:55.123564+0000","last_clean":"2024-09-20T21:05:55.123564+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:55.123564+0000","last_undegraded":"2024-09-20T21:05:55.123564+0000","last_fullsized":"2024-09-20T21:05:55.123564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386142+0000","last_change":"2024-09-20T21:05:33.520634+0000","last_active":"2024-09-20T21:05:54.386142+0000","last_peered":"2024-09-20T21:05:54.386142+0000","last_clean":"2024-09-20T21:05:54.386142+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:05:54.386142+0000","last_undegraded":"2024-09-20T21:05:54.386142+0000","last_fullsized":"2024-09-20T21:05:54.386142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.341860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117126+0000","last_change":"2024-09-20T21:05:54.132673+0000","last_active":"2024-09-20T21:05:55.117126+0000","last_peered":"2024-09-20T21:05:55.117126+0000","last_clean":"2024-09-20T21:05:55.117126+0000","last_became_active":"2024-09-20T21:05:54.128119+0000","last_became_peered":"2024-09-20T21:05:54.128119+0000","last_unstale":"2024-09-20T21:05:55.117126+0000","last_undegraded":"2024-09-20T21:05:55.117126+0000","last_fullsized":"2024-09-20T21:05:55.117126+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":54,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387210+0000","last_change":"2024-09-20T21:05:33.523453+0000","last_active":"2024-09-20T21:05:54.387210+0000","last_peered":"2024-09-20T21:05:54.387210+0000","last_clean":"2024-09-20T21:05:54.387210+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:05:54.387210+0000","last_undegraded":"2024-09-20T21:05:54.387210+0000","last_fullsized":"2024-09-20T21:05:54.387210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:59.275158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117521+0000","last_change":"2024-09-20T21:05:54.133190+0000","last_active":"2024-09-20T21:05:55.117521+0000","last_peered":"2024-09-20T21:05:55.117521+0000","last_clean":"2024-09-20T21:05:55.117521+0000","last_became_active":"2024-09-20T21:05:54.130889+0000","last_became_peered":"2024-09-20T21:05:54.130889+0000","last_unstale":"2024-09-20T21:05:55.117521+0000","last_undegraded":"2024-09-20T21:05:55.117521+0000","last_fullsized":"2024-09-20T21:05:55.117521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122870+0000","last_change":"2024-09-20T21:05:34.265360+0000","last_active":"2024-09-20T21:05:55.122870+0000","last_peered":"2024-09-20T21:05:55.122870+0000","last_clean":"2024-09-20T21:05:55.122870+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:05:55.122870+0000","last_undegraded":"2024-09-20T21:05:55.122870+0000","last_fullsized":"2024-09-20T21:05:55.122870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:02.949435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123803+0000","last_change":"2024-09-20T21:05:34.264103+0000","last_active":"2024-09-20T21:05:55.123803+0000","last_peered":"2024-09-20T21:05:55.123803+0000","last_clean":"2024-09-20T21:05:55.123803+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:05:55.123803+0000","last_undegraded":"2024-09-20T21:05:55.123803+0000","last_fullsized":"2024-09-20T21:05:55.123803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.354082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116206+0000","last_change":"2024-09-20T21:05:54.126994+0000","last_active":"2024-09-20T21:05:55.116206+0000","last_peered":"2024-09-20T21:05:55.116206+0000","last_clean":"2024-09-20T21:05:55.116206+0000","last_became_active":"2024-09-20T21:05:54.124655+0000","last_became_peered":"2024-09-20T21:05:54.124655+0000","last_unstale":"2024-09-20T21:05:55.116206+0000","last_undegraded":"2024-09-20T21:05:55.116206+0000","last_fullsized":"2024-09-20T21:05:55.116206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:41.063171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123077+0000","last_change":"2024-09-20T21:05:45.324641+0000","last_active":"2024-09-20T21:05:55.123077+0000","last_peered":"2024-09-20T21:05:55.123077+0000","last_clean":"2024-09-20T21:05:55.123077+0000","last_became_active":"2024-09-20T21:05:45.323784+0000","last_became_peered":"2024-09-20T21:05:45.323784+0000","last_unstale":"2024-09-20T21:05:55.123077+0000","last_undegraded":"2024-09-20T21:05:55.123077+0000","last_fullsized":"2024-09-20T21:05:55.123077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:42.679240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":69,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386096+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:54.386096+0000","last_peered":"2024-09-20T21:05:54.386096+0000","last_clean":"2024-09-20T21:05:54.386096+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:54.386096+0000","last_undegraded":"2024-09-20T21:05:54.386096+0000","last_fullsized":"2024-09-20T21:05:54.386096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:41.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":53,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.389431+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:54.389431+0000","last_peered":"2024-09-20T21:05:54.389431+0000","last_clean":"2024-09-20T21:05:54.389431+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:54.389431+0000","last_undegraded":"2024-09-20T21:05:54.389431+0000","last_fullsized":"2024-09-20T21:05:54.389431+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:04.604590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115866+0000","last_change":"2024-09-20T21:05:54.126691+0000","last_active":"2024-09-20T21:05:55.115866+0000","last_peered":"2024-09-20T21:05:55.115866+0000","last_clean":"2024-09-20T21:05:55.115866+0000","last_became_active":"2024-09-20T21:05:54.124815+0000","last_became_peered":"2024-09-20T21:05:54.124815+0000","last_unstale":"2024-09-20T21:05:55.115866+0000","last_undegraded":"2024-09-20T21:05:55.115866+0000","last_fullsized":"2024-09-20T21:05:55.115866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117867+0000","last_change":"2024-09-20T21:05:54.121201+0000","last_active":"2024-09-20T21:05:55.117867+0000","last_peered":"2024-09-20T21:05:55.117867+0000","last_clean":"2024-09-20T21:05:55.117867+0000","last_became_active":"2024-09-20T21:05:54.119189+0000","last_became_peered":"2024-09-20T21:05:54.119189+0000","last_unstale":"2024-09-20T21:05:55.117867+0000","last_undegraded":"2024-09-20T21:05:55.117867+0000","last_fullsized":"2024-09-20T21:05:55.117867+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:15.290334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115927+0000","last_change":"2024-09-20T21:05:54.130286+0000","last_active":"2024-09-20T21:05:55.115927+0000","last_peered":"2024-09-20T21:05:55.115927+0000","last_clean":"2024-09-20T21:05:55.115927+0000","last_became_active":"2024-09-20T21:05:54.127969+0000","last_became_peered":"2024-09-20T21:05:54.127969+0000","last_unstale":"2024-09-20T21:05:55.115927+0000","last_undegraded":"2024-09-20T21:05:55.115927+0000","last_fullsized":"2024-09-20T21:05:55.115927+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:27.343016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388849+0000","last_change":"2024-09-20T21:05:33.529620+0000","last_active":"2024-09-20T21:05:54.388849+0000","last_peered":"2024-09-20T21:05:54.388849+0000","last_clean":"2024-09-20T21:05:54.388849+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:05:54.388849+0000","last_undegraded":"2024-09-20T21:05:54.388849+0000","last_fullsized":"2024-09-20T21:05:54.388849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:39.374497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388079+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:54.388079+0000","last_peered":"2024-09-20T21:05:54.388079+0000","last_clean":"2024-09-20T21:05:54.388079+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:54.388079+0000","last_undegraded":"2024-09-20T21:05:54.388079+0000","last_fullsized":"2024-09-20T21:05:54.388079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:30.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387945+0000","last_change":"2024-09-20T21:05:33.516924+0000","last_active":"2024-09-20T21:05:54.387945+0000","last_peered":"2024-09-20T21:05:54.387945+0000","last_clean":"2024-09-20T21:05:54.387945+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:05:54.387945+0000","last_undegraded":"2024-09-20T21:05:54.387945+0000","last_fullsized":"2024-09-20T21:05:54.387945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:55.590471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122171+0000","last_change":"2024-09-20T21:05:45.324359+0000","last_active":"2024-09-20T21:05:55.122171+0000","last_peered":"2024-09-20T21:05:55.122171+0000","last_clean":"2024-09-20T21:05:55.122171+0000","last_became_active":"2024-09-20T21:05:45.321407+0000","last_became_peered":"2024-09-20T21:05:45.321407+0000","last_unstale":"2024-09-20T21:05:55.122171+0000","last_undegraded":"2024-09-20T21:05:55.122171+0000","last_fullsized":"2024-09-20T21:05:55.122171+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123544+0000","last_change":"2024-09-20T21:05:34.264426+0000","last_active":"2024-09-20T21:05:55.123544+0000","last_peered":"2024-09-20T21:05:55.123544+0000","last_clean":"2024-09-20T21:05:55.123544+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:05:55.123544+0000","last_undegraded":"2024-09-20T21:05:55.123544+0000","last_fullsized":"2024-09-20T21:05:55.123544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:23.886272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.389124+0000","last_change":"2024-09-20T21:05:33.517281+0000","last_active":"2024-09-20T21:05:54.389124+0000","last_peered":"2024-09-20T21:05:54.389124+0000","last_clean":"2024-09-20T21:05:54.389124+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:05:54.389124+0000","last_undegraded":"2024-09-20T21:05:54.389124+0000","last_fullsized":"2024-09-20T21:05:54.389124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:44.497231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.105860+0000","last_change":"2024-09-20T21:05:45.318892+0000","last_active":"2024-09-20T21:05:54.105860+0000","last_peered":"2024-09-20T21:05:54.105860+0000","last_clean":"2024-09-20T21:05:54.105860+0000","last_became_active":"2024-09-20T21:05:45.318102+0000","last_became_peered":"2024-09-20T21:05:45.318102+0000","last_unstale":"2024-09-20T21:05:54.105860+0000","last_undegraded":"2024-09-20T21:05:54.105860+0000","last_fullsized":"2024-09-20T21:05:54.105860+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:22:05.691202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388713+0000","last_change":"2024-09-20T21:05:33.527473+0000","last_active":"2024-09-20T21:05:54.388713+0000","last_peered":"2024-09-20T21:05:54.388713+0000","last_clean":"2024-09-20T21:05:54.388713+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:05:54.388713+0000","last_undegraded":"2024-09-20T21:05:54.388713+0000","last_fullsized":"2024-09-20T21:05:54.388713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:43.880199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116681+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:55.116681+0000","last_peered":"2024-09-20T21:05:55.116681+0000","last_clean":"2024-09-20T21:05:55.116681+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:55.116681+0000","last_undegraded":"2024-09-20T21:05:55.116681+0000","last_fullsized":"2024-09-20T21:05:55.116681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:06:41.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388760+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:54.388760+0000","last_peered":"2024-09-20T21:05:54.388760+0000","last_clean":"2024-09-20T21:05:54.388760+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:54.388760+0000","last_undegraded":"2024-09-20T21:05:54.388760+0000","last_fullsized":"2024-09-20T21:05:54.388760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:57.275101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116157+0000","last_change":"2024-09-20T21:05:54.121694+0000","last_active":"2024-09-20T21:05:55.116157+0000","last_peered":"2024-09-20T21:05:55.116157+0000","last_clean":"2024-09-20T21:05:55.116157+0000","last_became_active":"2024-09-20T21:05:54.120855+0000","last_became_peered":"2024-09-20T21:05:54.120855+0000","last_unstale":"2024-09-20T21:05:55.116157+0000","last_undegraded":"2024-09-20T21:05:55.116157+0000","last_fullsized":"2024-09-20T21:05:55.116157+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:11.887662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123467+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:05:55.123467+0000","last_peered":"2024-09-20T21:05:55.123467+0000","last_clean":"2024-09-20T21:05:55.123467+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:05:55.123467+0000","last_undegraded":"2024-09-20T21:05:55.123467+0000","last_fullsized":"2024-09-20T21:05:55.123467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":271,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.385971+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:54.385971+0000","last_peered":"2024-09-20T21:05:54.385971+0000","last_clean":"2024-09-20T21:05:54.385971+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:54.385971+0000","last_undegraded":"2024-09-20T21:05:54.385971+0000","last_fullsized":"2024-09-20T21:05:54.385971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:49.545054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386933+0000","last_change":"2024-09-20T21:05:33.516926+0000","last_active":"2024-09-20T21:05:54.386933+0000","last_peered":"2024-09-20T21:05:54.386933+0000","last_clean":"2024-09-20T21:05:54.386933+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:05:54.386933+0000","last_undegraded":"2024-09-20T21:05:54.386933+0000","last_fullsized":"2024-09-20T21:05:54.386933+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:48.429167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123236+0000","last_change":"2024-09-20T21:05:37.268775+0000","last_active":"2024-09-20T21:05:55.123236+0000","last_peered":"2024-09-20T21:05:55.123236+0000","last_clean":"2024-09-20T21:05:55.123236+0000","last_became_active":"2024-09-20T21:05:37.267211+0000","last_became_peered":"2024-09-20T21:05:37.267211+0000","last_unstale":"2024-09-20T21:05:55.123236+0000","last_undegraded":"2024-09-20T21:05:55.123236+0000","last_fullsized":"2024-09-20T21:05:55.123236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:50.497847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388965+0000","last_change":"2024-09-20T21:05:33.527863+0000","last_active":"2024-09-20T21:05:54.388965+0000","last_peered":"2024-09-20T21:05:54.388965+0000","last_clean":"2024-09-20T21:05:54.388965+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:05:54.388965+0000","last_undegraded":"2024-09-20T21:05:54.388965+0000","last_fullsized":"2024-09-20T21:05:54.388965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:28.039071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386462+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:54.386462+0000","last_peered":"2024-09-20T21:05:54.386462+0000","last_clean":"2024-09-20T21:05:54.386462+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:54.386462+0000","last_undegraded":"2024-09-20T21:05:54.386462+0000","last_fullsized":"2024-09-20T21:05:54.386462+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:58.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124493+0000","last_change":"2024-09-20T21:05:45.323068+0000","last_active":"2024-09-20T21:05:55.124493+0000","last_peered":"2024-09-20T21:05:55.124493+0000","last_clean":"2024-09-20T21:05:55.124493+0000","last_became_active":"2024-09-20T21:05:45.321160+0000","last_became_peered":"2024-09-20T21:05:45.321160+0000","last_unstale":"2024-09-20T21:05:55.124493+0000","last_undegraded":"2024-09-20T21:05:55.124493+0000","last_fullsized":"2024-09-20T21:05:55.124493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:32.144771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117798+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:55.117798+0000","last_peered":"2024-09-20T21:05:55.117798+0000","last_clean":"2024-09-20T21:05:55.117798+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:55.117798+0000","last_undegraded":"2024-09-20T21:05:55.117798+0000","last_fullsized":"2024-09-20T21:05:55.117798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124734+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:55.124734+0000","last_peered":"2024-09-20T21:05:55.124734+0000","last_clean":"2024-09-20T21:05:55.124734+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:55.124734+0000","last_undegraded":"2024-09-20T21:05:55.124734+0000","last_fullsized":"2024-09-20T21:05:55.124734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116320+0000","last_change":"2024-09-20T21:05:54.126982+0000","last_active":"2024-09-20T21:05:55.116320+0000","last_peered":"2024-09-20T21:05:55.116320+0000","last_clean":"2024-09-20T21:05:55.116320+0000","last_became_active":"2024-09-20T21:05:54.121776+0000","last_became_peered":"2024-09-20T21:05:54.121776+0000","last_unstale":"2024-09-20T21:05:55.116320+0000","last_undegraded":"2024-09-20T21:05:55.116320+0000","last_fullsized":"2024-09-20T21:05:55.116320+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:46.297334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":114,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123656+0000","last_change":"2024-09-20T21:05:52.101432+0000","last_active":"2024-09-20T21:05:55.123656+0000","last_peered":"2024-09-20T21:05:55.123656+0000","last_clean":"2024-09-20T21:05:55.123656+0000","last_became_active":"2024-09-20T21:05:52.100421+0000","last_became_peered":"2024-09-20T21:05:52.100421+0000","last_unstale":"2024-09-20T21:05:55.123656+0000","last_undegraded":"2024-09-20T21:05:55.123656+0000","last_fullsized":"2024-09-20T21:05:55.123656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386411+0000","last_change":"2024-09-20T21:05:33.525394+0000","last_active":"2024-09-20T21:05:54.386411+0000","last_peered":"2024-09-20T21:05:54.386411+0000","last_clean":"2024-09-20T21:05:54.386411+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:05:54.386411+0000","last_undegraded":"2024-09-20T21:05:54.386411+0000","last_fullsized":"2024-09-20T21:05:54.386411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:51:33.922257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386689+0000","last_change":"2024-09-20T21:05:33.522984+0000","last_active":"2024-09-20T21:05:54.386689+0000","last_peered":"2024-09-20T21:05:54.386689+0000","last_clean":"2024-09-20T21:05:54.386689+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:05:54.386689+0000","last_undegraded":"2024-09-20T21:05:54.386689+0000","last_fullsized":"2024-09-20T21:05:54.386689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:22:14.870718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124538+0000","last_change":"2024-09-20T21:05:45.331015+0000","last_active":"2024-09-20T21:05:55.124538+0000","last_peered":"2024-09-20T21:05:55.124538+0000","last_clean":"2024-09-20T21:05:55.124538+0000","last_became_active":"2024-09-20T21:05:45.330361+0000","last_became_peered":"2024-09-20T21:05:45.330361+0000","last_unstale":"2024-09-20T21:05:55.124538+0000","last_undegraded":"2024-09-20T21:05:55.124538+0000","last_fullsized":"2024-09-20T21:05:55.124538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387781+0000","last_change":"2024-09-20T21:05:33.530100+0000","last_active":"2024-09-20T21:05:54.387781+0000","last_peered":"2024-09-20T21:05:54.387781+0000","last_clean":"2024-09-20T21:05:54.387781+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:05:54.387781+0000","last_undegraded":"2024-09-20T21:05:54.387781+0000","last_fullsized":"2024-09-20T21:05:54.387781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:12.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124786+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:55.124786+0000","last_peered":"2024-09-20T21:05:55.124786+0000","last_clean":"2024-09-20T21:05:55.124786+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:55.124786+0000","last_undegraded":"2024-09-20T21:05:55.124786+0000","last_fullsized":"2024-09-20T21:05:55.124786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116170+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:55.116170+0000","last_peered":"2024-09-20T21:05:55.116170+0000","last_clean":"2024-09-20T21:05:55.116170+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:55.116170+0000","last_undegraded":"2024-09-20T21:05:55.116170+0000","last_fullsized":"2024-09-20T21:05:55.116170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:03.961332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124581+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:55.124581+0000","last_peered":"2024-09-20T21:05:55.124581+0000","last_clean":"2024-09-20T21:05:55.124581+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:55.124581+0000","last_undegraded":"2024-09-20T21:05:55.124581+0000","last_fullsized":"2024-09-20T21:05:55.124581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.118157+0000","last_change":"2024-09-20T21:05:54.121905+0000","last_active":"2024-09-20T21:05:55.118157+0000","last_peered":"2024-09-20T21:05:55.118157+0000","last_clean":"2024-09-20T21:05:55.118157+0000","last_became_active":"2024-09-20T21:05:54.121064+0000","last_became_peered":"2024-09-20T21:05:54.121064+0000","last_unstale":"2024-09-20T21:05:55.118157+0000","last_undegraded":"2024-09-20T21:05:55.118157+0000","last_fullsized":"2024-09-20T21:05:55.118157+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:54:14.429868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116445+0000","last_change":"2024-09-20T21:05:54.132710+0000","last_active":"2024-09-20T21:05:55.116445+0000","last_peered":"2024-09-20T21:05:55.116445+0000","last_clean":"2024-09-20T21:05:55.116445+0000","last_became_active":"2024-09-20T21:05:54.127863+0000","last_became_peered":"2024-09-20T21:05:54.127863+0000","last_unstale":"2024-09-20T21:05:55.116445+0000","last_undegraded":"2024-09-20T21:05:55.116445+0000","last_fullsized":"2024-09-20T21:05:55.116445+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:59.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124756+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:55.124756+0000","last_peered":"2024-09-20T21:05:55.124756+0000","last_clean":"2024-09-20T21:05:55.124756+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:55.124756+0000","last_undegraded":"2024-09-20T21:05:55.124756+0000","last_fullsized":"2024-09-20T21:05:55.124756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124399+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:05:55.124399+0000","last_peered":"2024-09-20T21:05:55.124399+0000","last_clean":"2024-09-20T21:05:55.124399+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:05:55.124399+0000","last_undegraded":"2024-09-20T21:05:55.124399+0000","last_fullsized":"2024-09-20T21:05:55.124399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123360+0000","last_change":"2024-09-20T21:05:37.267287+0000","last_active":"2024-09-20T21:05:55.123360+0000","last_peered":"2024-09-20T21:05:55.123360+0000","last_clean":"2024-09-20T21:05:55.123360+0000","last_became_active":"2024-09-20T21:05:37.266438+0000","last_became_peered":"2024-09-20T21:05:37.266438+0000","last_unstale":"2024-09-20T21:05:55.123360+0000","last_undegraded":"2024-09-20T21:05:55.123360+0000","last_fullsized":"2024-09-20T21:05:55.123360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124163+0000","last_change":"2024-09-20T21:05:34.264862+0000","last_active":"2024-09-20T21:05:55.124163+0000","last_peered":"2024-09-20T21:05:55.124163+0000","last_clean":"2024-09-20T21:05:55.124163+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:05:55.124163+0000","last_undegraded":"2024-09-20T21:05:55.124163+0000","last_fullsized":"2024-09-20T21:05:55.124163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:32.512356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.133860+0000","last_change":"2024-09-20T21:05:54.129999+0000","last_active":"2024-09-20T21:05:54.133860+0000","last_peered":"2024-09-20T21:05:54.133860+0000","last_clean":"2024-09-20T21:05:54.133860+0000","last_became_active":"2024-09-20T21:05:54.120539+0000","last_became_peered":"2024-09-20T21:05:54.120539+0000","last_unstale":"2024-09-20T21:05:54.133860+0000","last_undegraded":"2024-09-20T21:05:54.133860+0000","last_fullsized":"2024-09-20T21:05:54.133860+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:51:33.047862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116571+0000","last_change":"2024-09-20T21:05:54.121933+0000","last_active":"2024-09-20T21:05:55.116571+0000","last_peered":"2024-09-20T21:05:55.116571+0000","last_clean":"2024-09-20T21:05:55.116571+0000","last_became_active":"2024-09-20T21:05:54.119503+0000","last_became_peered":"2024-09-20T21:05:54.119503+0000","last_unstale":"2024-09-20T21:05:55.116571+0000","last_undegraded":"2024-09-20T21:05:55.116571+0000","last_fullsized":"2024-09-20T21:05:55.116571+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:02.194094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387907+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:54.387907+0000","last_peered":"2024-09-20T21:05:54.387907+0000","last_clean":"2024-09-20T21:05:54.387907+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:54.387907+0000","last_undegraded":"2024-09-20T21:05:54.387907+0000","last_fullsized":"2024-09-20T21:05:54.387907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:49.172273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387014+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:54.387014+0000","last_peered":"2024-09-20T21:05:54.387014+0000","last_clean":"2024-09-20T21:05:54.387014+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:54.387014+0000","last_undegraded":"2024-09-20T21:05:54.387014+0000","last_fullsized":"2024-09-20T21:05:54.387014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:07:07.242939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122199+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:05:55.122199+0000","last_peered":"2024-09-20T21:05:55.122199+0000","last_clean":"2024-09-20T21:05:55.122199+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:05:55.122199+0000","last_undegraded":"2024-09-20T21:05:55.122199+0000","last_fullsized":"2024-09-20T21:05:55.122199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117882+0000","last_change":"2024-09-20T21:05:54.130634+0000","last_active":"2024-09-20T21:05:55.117882+0000","last_peered":"2024-09-20T21:05:55.117882+0000","last_clean":"2024-09-20T21:05:55.117882+0000","last_became_active":"2024-09-20T21:05:54.128221+0000","last_became_peered":"2024-09-20T21:05:54.128221+0000","last_unstale":"2024-09-20T21:05:55.117882+0000","last_undegraded":"2024-09-20T21:05:55.117882+0000","last_fullsized":"2024-09-20T21:05:55.117882+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:37.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388967+0000","last_change":"2024-09-20T21:05:33.525151+0000","last_active":"2024-09-20T21:05:54.388967+0000","last_peered":"2024-09-20T21:05:54.388967+0000","last_clean":"2024-09-20T21:05:54.388967+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:05:54.388967+0000","last_undegraded":"2024-09-20T21:05:54.388967+0000","last_fullsized":"2024-09-20T21:05:54.388967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:51.245496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123714+0000","last_change":"2024-09-20T21:05:52.104238+0000","last_active":"2024-09-20T21:05:55.123714+0000","last_peered":"2024-09-20T21:05:55.123714+0000","last_clean":"2024-09-20T21:05:55.123714+0000","last_became_active":"2024-09-20T21:05:52.103630+0000","last_became_peered":"2024-09-20T21:05:52.103630+0000","last_unstale":"2024-09-20T21:05:55.123714+0000","last_undegraded":"2024-09-20T21:05:55.123714+0000","last_fullsized":"2024-09-20T21:05:55.123714+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124560+0000","last_change":"2024-09-20T21:05:34.264735+0000","last_active":"2024-09-20T21:05:55.124560+0000","last_peered":"2024-09-20T21:05:55.124560+0000","last_clean":"2024-09-20T21:05:55.124560+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:05:55.124560+0000","last_undegraded":"2024-09-20T21:05:55.124560+0000","last_fullsized":"2024-09-20T21:05:55.124560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:16.718841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.120856+0000","last_change":"2024-09-20T21:05:52.100914+0000","last_active":"2024-09-20T21:05:55.120856+0000","last_peered":"2024-09-20T21:05:55.120856+0000","last_clean":"2024-09-20T21:05:55.120856+0000","last_became_active":"2024-09-20T21:05:52.100104+0000","last_became_peered":"2024-09-20T21:05:52.100104+0000","last_unstale":"2024-09-20T21:05:55.120856+0000","last_undegraded":"2024-09-20T21:05:55.120856+0000","last_fullsized":"2024-09-20T21:05:55.120856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:51:38.241935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117935+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:55.117935+0000","last_peered":"2024-09-20T21:05:55.117935+0000","last_clean":"2024-09-20T21:05:55.117935+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:55.117935+0000","last_undegraded":"2024-09-20T21:05:55.117935+0000","last_fullsized":"2024-09-20T21:05:55.117935+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:39.486200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.121098+0000","last_change":"2024-09-20T21:05:37.269662+0000","last_active":"2024-09-20T21:05:55.121098+0000","last_peered":"2024-09-20T21:05:55.121098+0000","last_clean":"2024-09-20T21:05:55.121098+0000","last_became_active":"2024-09-20T21:05:37.268982+0000","last_became_peered":"2024-09-20T21:05:37.268982+0000","last_unstale":"2024-09-20T21:05:55.121098+0000","last_undegraded":"2024-09-20T21:05:55.121098+0000","last_fullsized":"2024-09-20T21:05:55.121098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:38.474304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122329+0000","last_change":"2024-09-20T21:05:45.321820+0000","last_active":"2024-09-20T21:05:55.122329+0000","last_peered":"2024-09-20T21:05:55.122329+0000","last_clean":"2024-09-20T21:05:55.122329+0000","last_became_active":"2024-09-20T21:05:45.320924+0000","last_became_peered":"2024-09-20T21:05:45.320924+0000","last_unstale":"2024-09-20T21:05:55.122329+0000","last_undegraded":"2024-09-20T21:05:55.122329+0000","last_fullsized":"2024-09-20T21:05:55.122329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:18:23.772854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123853+0000","last_change":"2024-09-20T21:05:45.321935+0000","last_active":"2024-09-20T21:05:55.123853+0000","last_peered":"2024-09-20T21:05:55.123853+0000","last_clean":"2024-09-20T21:05:55.123853+0000","last_became_active":"2024-09-20T21:05:45.321031+0000","last_became_peered":"2024-09-20T21:05:45.321031+0000","last_unstale":"2024-09-20T21:05:55.123853+0000","last_undegraded":"2024-09-20T21:05:55.123853+0000","last_fullsized":"2024-09-20T21:05:55.123853+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:01.849318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117259+0000","last_change":"2024-09-20T21:05:54.127603+0000","last_active":"2024-09-20T21:05:55.117259+0000","last_peered":"2024-09-20T21:05:55.117259+0000","last_clean":"2024-09-20T21:05:55.117259+0000","last_became_active":"2024-09-20T21:05:54.125123+0000","last_became_peered":"2024-09-20T21:05:54.125123+0000","last_unstale":"2024-09-20T21:05:55.117259+0000","last_undegraded":"2024-09-20T21:05:55.117259+0000","last_fullsized":"2024-09-20T21:05:55.117259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:43:09.663833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116468+0000","last_change":"2024-09-20T21:05:54.122334+0000","last_active":"2024-09-20T21:05:55.116468+0000","last_peered":"2024-09-20T21:05:55.116468+0000","last_clean":"2024-09-20T21:05:55.116468+0000","last_became_active":"2024-09-20T21:05:54.121466+0000","last_became_peered":"2024-09-20T21:05:54.121466+0000","last_unstale":"2024-09-20T21:05:55.116468+0000","last_undegraded":"2024-09-20T21:05:55.116468+0000","last_fullsized":"2024-09-20T21:05:55.116468+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:41.667343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":122,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117020+0000","last_change":"2024-09-20T21:05:54.132657+0000","last_active":"2024-09-20T21:05:55.117020+0000","last_peered":"2024-09-20T21:05:55.117020+0000","last_clean":"2024-09-20T21:05:55.117020+0000","last_became_active":"2024-09-20T21:05:54.129891+0000","last_became_peered":"2024-09-20T21:05:54.129891+0000","last_unstale":"2024-09-20T21:05:55.117020+0000","last_undegraded":"2024-09-20T21:05:55.117020+0000","last_fullsized":"2024-09-20T21:05:55.117020+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:26.911986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116983+0000","last_change":"2024-09-20T21:05:54.127321+0000","last_active":"2024-09-20T21:05:55.116983+0000","last_peered":"2024-09-20T21:05:55.116983+0000","last_clean":"2024-09-20T21:05:55.116983+0000","last_became_active":"2024-09-20T21:05:54.120527+0000","last_became_peered":"2024-09-20T21:05:54.120527+0000","last_unstale":"2024-09-20T21:05:55.116983+0000","last_undegraded":"2024-09-20T21:05:55.116983+0000","last_fullsized":"2024-09-20T21:05:55.116983+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:25.400362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387624+0000","last_change":"2024-09-20T21:05:33.523783+0000","last_active":"2024-09-20T21:05:54.387624+0000","last_peered":"2024-09-20T21:05:54.387624+0000","last_clean":"2024-09-20T21:05:54.387624+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:05:54.387624+0000","last_undegraded":"2024-09-20T21:05:54.387624+0000","last_fullsized":"2024-09-20T21:05:54.387624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:29.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387367+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:54.387367+0000","last_peered":"2024-09-20T21:05:54.387367+0000","last_clean":"2024-09-20T21:05:54.387367+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:54.387367+0000","last_undegraded":"2024-09-20T21:05:54.387367+0000","last_fullsized":"2024-09-20T21:05:54.387367+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:45:47.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386849+0000","last_change":"2024-09-20T21:05:33.525036+0000","last_active":"2024-09-20T21:05:54.386849+0000","last_peered":"2024-09-20T21:05:54.386849+0000","last_clean":"2024-09-20T21:05:54.386849+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:05:54.386849+0000","last_undegraded":"2024-09-20T21:05:54.386849+0000","last_fullsized":"2024-09-20T21:05:54.386849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:13.120671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117548+0000","last_change":"2024-09-20T21:05:54.126814+0000","last_active":"2024-09-20T21:05:55.117548+0000","last_peered":"2024-09-20T21:05:55.117548+0000","last_clean":"2024-09-20T21:05:55.117548+0000","last_became_active":"2024-09-20T21:05:54.124075+0000","last_became_peered":"2024-09-20T21:05:54.124075+0000","last_unstale":"2024-09-20T21:05:55.117548+0000","last_undegraded":"2024-09-20T21:05:55.117548+0000","last_fullsized":"2024-09-20T21:05:55.117548+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:18.839315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116829+0000","last_change":"2024-09-20T21:05:54.122485+0000","last_active":"2024-09-20T21:05:55.116829+0000","last_peered":"2024-09-20T21:05:55.116829+0000","last_clean":"2024-09-20T21:05:55.116829+0000","last_became_active":"2024-09-20T21:05:54.121408+0000","last_became_peered":"2024-09-20T21:05:54.121408+0000","last_unstale":"2024-09-20T21:05:55.116829+0000","last_undegraded":"2024-09-20T21:05:55.116829+0000","last_fullsized":"2024-09-20T21:05:55.116829+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:36.479778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123681+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:55.123681+0000","last_peered":"2024-09-20T21:05:55.123681+0000","last_clean":"2024-09-20T21:05:55.123681+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:55.123681+0000","last_undegraded":"2024-09-20T21:05:55.123681+0000","last_fullsized":"2024-09-20T21:05:55.123681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386617+0000","last_change":"2024-09-20T21:05:33.529399+0000","last_active":"2024-09-20T21:05:54.386617+0000","last_peered":"2024-09-20T21:05:54.386617+0000","last_clean":"2024-09-20T21:05:54.386617+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:05:54.386617+0000","last_undegraded":"2024-09-20T21:05:54.386617+0000","last_fullsized":"2024-09-20T21:05:54.386617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:36.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122854+0000","last_change":"2024-09-20T21:05:45.323879+0000","last_active":"2024-09-20T21:05:55.122854+0000","last_peered":"2024-09-20T21:05:55.122854+0000","last_clean":"2024-09-20T21:05:55.122854+0000","last_became_active":"2024-09-20T21:05:45.321268+0000","last_became_peered":"2024-09-20T21:05:45.321268+0000","last_unstale":"2024-09-20T21:05:55.122854+0000","last_undegraded":"2024-09-20T21:05:55.122854+0000","last_fullsized":"2024-09-20T21:05:55.122854+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:53.346461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216928,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94154912,"statfs":{"total":96636764160,"available":96414629888,"internally_reserved":0,"allocated":1118208,"data_stored":1000114,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350982,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54628,"kb_used_data":1104,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317212,"statfs":{"total":96636764160,"available":96580825088,"internally_reserved":0,"allocated":1130496,"data_stored":1000749,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325140,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046700,"statfs":{"total":96636764160,"available":96303820800,"internally_reserved":0,"allocated":1044480,"data_stored":408587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:05:57.966 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:05:58.304 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:58.306 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:05:58.323 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-20T21:05:56.992174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596696,"kb_used_data":3216,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282518824,"statfs":{"total":289910292480,"available":289299275776,"internally_reserved":0,"allocated":3293184,"data_stored":2409450,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001472"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117741+0000","last_change":"2024-09-20T21:05:54.129746+0000","last_active":"2024-09-20T21:05:55.117741+0000","last_peered":"2024-09-20T21:05:55.117741+0000","last_clean":"2024-09-20T21:05:55.117741+0000","last_became_active":"2024-09-20T21:05:54.127664+0000","last_became_peered":"2024-09-20T21:05:54.127664+0000","last_unstale":"2024-09-20T21:05:55.117741+0000","last_undegraded":"2024-09-20T21:05:55.117741+0000","last_fullsized":"2024-09-20T21:05:55.117741+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:57.952046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117563+0000","last_change":"2024-09-20T21:05:54.126721+0000","last_active":"2024-09-20T21:05:55.117563+0000","last_peered":"2024-09-20T21:05:55.117563+0000","last_clean":"2024-09-20T21:05:55.117563+0000","last_became_active":"2024-09-20T21:05:54.124269+0000","last_became_peered":"2024-09-20T21:05:54.124269+0000","last_unstale":"2024-09-20T21:05:55.117563+0000","last_undegraded":"2024-09-20T21:05:55.117563+0000","last_fullsized":"2024-09-20T21:05:55.117563+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.389708+0000","last_change":"2024-09-20T21:05:33.529595+0000","last_active":"2024-09-20T21:05:54.389708+0000","last_peered":"2024-09-20T21:05:54.389708+0000","last_clean":"2024-09-20T21:05:54.389708+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:05:54.389708+0000","last_undegraded":"2024-09-20T21:05:54.389708+0000","last_fullsized":"2024-09-20T21:05:54.389708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:08.234369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387690+0000","last_change":"2024-09-20T21:05:33.516896+0000","last_active":"2024-09-20T21:05:54.387690+0000","last_peered":"2024-09-20T21:05:54.387690+0000","last_clean":"2024-09-20T21:05:54.387690+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:05:54.387690+0000","last_undegraded":"2024-09-20T21:05:54.387690+0000","last_fullsized":"2024-09-20T21:05:54.387690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:48.472114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116748+0000","last_change":"2024-09-20T21:05:54.130938+0000","last_active":"2024-09-20T21:05:55.116748+0000","last_peered":"2024-09-20T21:05:55.116748+0000","last_clean":"2024-09-20T21:05:55.116748+0000","last_became_active":"2024-09-20T21:05:54.125511+0000","last_became_peered":"2024-09-20T21:05:54.125511+0000","last_unstale":"2024-09-20T21:05:55.116748+0000","last_undegraded":"2024-09-20T21:05:55.116748+0000","last_fullsized":"2024-09-20T21:05:55.116748+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:55.659526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387752+0000","last_change":"2024-09-20T21:05:33.526021+0000","last_active":"2024-09-20T21:05:54.387752+0000","last_peered":"2024-09-20T21:05:54.387752+0000","last_clean":"2024-09-20T21:05:54.387752+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:05:54.387752+0000","last_undegraded":"2024-09-20T21:05:54.387752+0000","last_fullsized":"2024-09-20T21:05:54.387752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:51.022212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.105261+0000","last_change":"2024-09-20T21:05:45.317731+0000","last_active":"2024-09-20T21:05:54.105261+0000","last_peered":"2024-09-20T21:05:54.105261+0000","last_clean":"2024-09-20T21:05:54.105261+0000","last_became_active":"2024-09-20T21:05:45.315721+0000","last_became_peered":"2024-09-20T21:05:45.315721+0000","last_unstale":"2024-09-20T21:05:54.105261+0000","last_undegraded":"2024-09-20T21:05:54.105261+0000","last_fullsized":"2024-09-20T21:05:54.105261+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:02.882020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386366+0000","last_change":"2024-09-20T21:05:33.527599+0000","last_active":"2024-09-20T21:05:54.386366+0000","last_peered":"2024-09-20T21:05:54.386366+0000","last_clean":"2024-09-20T21:05:54.386366+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:05:54.386366+0000","last_undegraded":"2024-09-20T21:05:54.386366+0000","last_fullsized":"2024-09-20T21:05:54.386366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:19:18.002155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122816+0000","last_change":"2024-09-20T21:05:45.329452+0000","last_active":"2024-09-20T21:05:55.122816+0000","last_peered":"2024-09-20T21:05:55.122816+0000","last_clean":"2024-09-20T21:05:55.122816+0000","last_became_active":"2024-09-20T21:05:45.327207+0000","last_became_peered":"2024-09-20T21:05:45.327207+0000","last_unstale":"2024-09-20T21:05:55.122816+0000","last_undegraded":"2024-09-20T21:05:55.122816+0000","last_fullsized":"2024-09-20T21:05:55.122816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:42.075068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117093+0000","last_change":"2024-09-20T21:05:54.126680+0000","last_active":"2024-09-20T21:05:55.117093+0000","last_peered":"2024-09-20T21:05:55.117093+0000","last_clean":"2024-09-20T21:05:55.117093+0000","last_became_active":"2024-09-20T21:05:54.124291+0000","last_became_peered":"2024-09-20T21:05:54.124291+0000","last_unstale":"2024-09-20T21:05:55.117093+0000","last_undegraded":"2024-09-20T21:05:55.117093+0000","last_fullsized":"2024-09-20T21:05:55.117093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:05.334214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.389492+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:54.389492+0000","last_peered":"2024-09-20T21:05:54.389492+0000","last_clean":"2024-09-20T21:05:54.389492+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:54.389492+0000","last_undegraded":"2024-09-20T21:05:54.389492+0000","last_fullsized":"2024-09-20T21:05:54.389492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:14:10.131416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116730+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:05:55.116730+0000","last_peered":"2024-09-20T21:05:55.116730+0000","last_clean":"2024-09-20T21:05:55.116730+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:05:55.116730+0000","last_undegraded":"2024-09-20T21:05:55.116730+0000","last_fullsized":"2024-09-20T21:05:55.116730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:51.509743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116172+0000","last_change":"2024-09-20T21:05:54.132356+0000","last_active":"2024-09-20T21:05:55.116172+0000","last_peered":"2024-09-20T21:05:55.116172+0000","last_clean":"2024-09-20T21:05:55.116172+0000","last_became_active":"2024-09-20T21:05:54.128147+0000","last_became_peered":"2024-09-20T21:05:54.128147+0000","last_unstale":"2024-09-20T21:05:55.116172+0000","last_undegraded":"2024-09-20T21:05:55.116172+0000","last_fullsized":"2024-09-20T21:05:55.116172+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:07.742615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387439+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:54.387439+0000","last_peered":"2024-09-20T21:05:54.387439+0000","last_clean":"2024-09-20T21:05:54.387439+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:54.387439+0000","last_undegraded":"2024-09-20T21:05:54.387439+0000","last_fullsized":"2024-09-20T21:05:54.387439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:17.867418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387003+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:54.387003+0000","last_peered":"2024-09-20T21:05:54.387003+0000","last_clean":"2024-09-20T21:05:54.387003+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:54.387003+0000","last_undegraded":"2024-09-20T21:05:54.387003+0000","last_fullsized":"2024-09-20T21:05:54.387003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:36.753632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.105532+0000","last_change":"2024-09-20T21:05:45.318518+0000","last_active":"2024-09-20T21:05:54.105532+0000","last_peered":"2024-09-20T21:05:54.105532+0000","last_clean":"2024-09-20T21:05:54.105532+0000","last_became_active":"2024-09-20T21:05:45.317951+0000","last_became_peered":"2024-09-20T21:05:45.317951+0000","last_unstale":"2024-09-20T21:05:54.105532+0000","last_undegraded":"2024-09-20T21:05:54.105532+0000","last_fullsized":"2024-09-20T21:05:54.105532+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:18:16.849565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124476+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:55.124476+0000","last_peered":"2024-09-20T21:05:55.124476+0000","last_clean":"2024-09-20T21:05:55.124476+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:55.124476+0000","last_undegraded":"2024-09-20T21:05:55.124476+0000","last_fullsized":"2024-09-20T21:05:55.124476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117505+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:55.117505+0000","last_peered":"2024-09-20T21:05:55.117505+0000","last_clean":"2024-09-20T21:05:55.117505+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:55.117505+0000","last_undegraded":"2024-09-20T21:05:55.117505+0000","last_fullsized":"2024-09-20T21:05:55.117505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122128+0000","last_change":"2024-09-20T21:05:45.327807+0000","last_active":"2024-09-20T21:05:55.122128+0000","last_peered":"2024-09-20T21:05:55.122128+0000","last_clean":"2024-09-20T21:05:55.122128+0000","last_became_active":"2024-09-20T21:05:45.326913+0000","last_became_peered":"2024-09-20T21:05:45.326913+0000","last_unstale":"2024-09-20T21:05:55.122128+0000","last_undegraded":"2024-09-20T21:05:55.122128+0000","last_fullsized":"2024-09-20T21:05:55.122128+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.107163+0000","last_change":"2024-09-20T21:05:45.324822+0000","last_active":"2024-09-20T21:05:54.107163+0000","last_peered":"2024-09-20T21:05:54.107163+0000","last_clean":"2024-09-20T21:05:54.107163+0000","last_became_active":"2024-09-20T21:05:45.323994+0000","last_became_peered":"2024-09-20T21:05:45.323994+0000","last_unstale":"2024-09-20T21:05:54.107163+0000","last_undegraded":"2024-09-20T21:05:54.107163+0000","last_fullsized":"2024-09-20T21:05:54.107163+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:36.479778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388741+0000","last_change":"2024-09-20T21:05:33.524928+0000","last_active":"2024-09-20T21:05:54.388741+0000","last_peered":"2024-09-20T21:05:54.388741+0000","last_clean":"2024-09-20T21:05:54.388741+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:05:54.388741+0000","last_undegraded":"2024-09-20T21:05:54.388741+0000","last_fullsized":"2024-09-20T21:05:54.388741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:42.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116038+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:55.116038+0000","last_peered":"2024-09-20T21:05:55.116038+0000","last_clean":"2024-09-20T21:05:55.116038+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:55.116038+0000","last_undegraded":"2024-09-20T21:05:55.116038+0000","last_fullsized":"2024-09-20T21:05:55.116038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123406+0000","last_change":"2024-09-20T21:05:52.103930+0000","last_active":"2024-09-20T21:05:55.123406+0000","last_peered":"2024-09-20T21:05:55.123406+0000","last_clean":"2024-09-20T21:05:55.123406+0000","last_became_active":"2024-09-20T21:05:52.103477+0000","last_became_peered":"2024-09-20T21:05:52.103477+0000","last_unstale":"2024-09-20T21:05:55.123406+0000","last_undegraded":"2024-09-20T21:05:55.123406+0000","last_fullsized":"2024-09-20T21:05:55.123406+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115860+0000","last_change":"2024-09-20T21:05:54.133334+0000","last_active":"2024-09-20T21:05:55.115860+0000","last_peered":"2024-09-20T21:05:55.115860+0000","last_clean":"2024-09-20T21:05:55.115860+0000","last_became_active":"2024-09-20T21:05:54.129639+0000","last_became_peered":"2024-09-20T21:05:54.129639+0000","last_unstale":"2024-09-20T21:05:55.115860+0000","last_undegraded":"2024-09-20T21:05:55.115860+0000","last_fullsized":"2024-09-20T21:05:55.115860+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117793+0000","last_change":"2024-09-20T21:05:54.126793+0000","last_active":"2024-09-20T21:05:55.117793+0000","last_peered":"2024-09-20T21:05:55.117793+0000","last_clean":"2024-09-20T21:05:55.117793+0000","last_became_active":"2024-09-20T21:05:54.124757+0000","last_became_peered":"2024-09-20T21:05:54.124757+0000","last_unstale":"2024-09-20T21:05:55.117793+0000","last_undegraded":"2024-09-20T21:05:55.117793+0000","last_fullsized":"2024-09-20T21:05:55.117793+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:46:28.346590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123336+0000","last_change":"2024-09-20T21:05:45.324835+0000","last_active":"2024-09-20T21:05:55.123336+0000","last_peered":"2024-09-20T21:05:55.123336+0000","last_clean":"2024-09-20T21:05:55.123336+0000","last_became_active":"2024-09-20T21:05:45.321767+0000","last_became_peered":"2024-09-20T21:05:45.321767+0000","last_unstale":"2024-09-20T21:05:55.123336+0000","last_undegraded":"2024-09-20T21:05:55.123336+0000","last_fullsized":"2024-09-20T21:05:55.123336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:16.302231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.389311+0000","last_change":"2024-09-20T21:05:33.528984+0000","last_active":"2024-09-20T21:05:54.389311+0000","last_peered":"2024-09-20T21:05:54.389311+0000","last_clean":"2024-09-20T21:05:54.389311+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:05:54.389311+0000","last_undegraded":"2024-09-20T21:05:54.389311+0000","last_fullsized":"2024-09-20T21:05:54.389311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:53.623013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117367+0000","last_change":"2024-09-20T21:05:54.121935+0000","last_active":"2024-09-20T21:05:55.117367+0000","last_peered":"2024-09-20T21:05:55.117367+0000","last_clean":"2024-09-20T21:05:55.117367+0000","last_became_active":"2024-09-20T21:05:54.120990+0000","last_became_peered":"2024-09-20T21:05:54.120990+0000","last_unstale":"2024-09-20T21:05:55.117367+0000","last_undegraded":"2024-09-20T21:05:55.117367+0000","last_fullsized":"2024-09-20T21:05:55.117367+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122633+0000","last_change":"2024-09-20T21:05:37.268677+0000","last_active":"2024-09-20T21:05:55.122633+0000","last_peered":"2024-09-20T21:05:55.122633+0000","last_clean":"2024-09-20T21:05:55.122633+0000","last_became_active":"2024-09-20T21:05:37.267096+0000","last_became_peered":"2024-09-20T21:05:37.267096+0000","last_unstale":"2024-09-20T21:05:55.122633+0000","last_undegraded":"2024-09-20T21:05:55.122633+0000","last_fullsized":"2024-09-20T21:05:55.122633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116342+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:55.116342+0000","last_peered":"2024-09-20T21:05:55.116342+0000","last_clean":"2024-09-20T21:05:55.116342+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:55.116342+0000","last_undegraded":"2024-09-20T21:05:55.116342+0000","last_fullsized":"2024-09-20T21:05:55.116342+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123564+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:55.123564+0000","last_peered":"2024-09-20T21:05:55.123564+0000","last_clean":"2024-09-20T21:05:55.123564+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:55.123564+0000","last_undegraded":"2024-09-20T21:05:55.123564+0000","last_fullsized":"2024-09-20T21:05:55.123564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386142+0000","last_change":"2024-09-20T21:05:33.520634+0000","last_active":"2024-09-20T21:05:54.386142+0000","last_peered":"2024-09-20T21:05:54.386142+0000","last_clean":"2024-09-20T21:05:54.386142+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:05:54.386142+0000","last_undegraded":"2024-09-20T21:05:54.386142+0000","last_fullsized":"2024-09-20T21:05:54.386142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.341860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117126+0000","last_change":"2024-09-20T21:05:54.132673+0000","last_active":"2024-09-20T21:05:55.117126+0000","last_peered":"2024-09-20T21:05:55.117126+0000","last_clean":"2024-09-20T21:05:55.117126+0000","last_became_active":"2024-09-20T21:05:54.128119+0000","last_became_peered":"2024-09-20T21:05:54.128119+0000","last_unstale":"2024-09-20T21:05:55.117126+0000","last_undegraded":"2024-09-20T21:05:55.117126+0000","last_fullsized":"2024-09-20T21:05:55.117126+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":54,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387210+0000","last_change":"2024-09-20T21:05:33.523453+0000","last_active":"2024-09-20T21:05:54.387210+0000","last_peered":"2024-09-20T21:05:54.387210+0000","last_clean":"2024-09-20T21:05:54.387210+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:05:54.387210+0000","last_undegraded":"2024-09-20T21:05:54.387210+0000","last_fullsized":"2024-09-20T21:05:54.387210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:59.275158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117521+0000","last_change":"2024-09-20T21:05:54.133190+0000","last_active":"2024-09-20T21:05:55.117521+0000","last_peered":"2024-09-20T21:05:55.117521+0000","last_clean":"2024-09-20T21:05:55.117521+0000","last_became_active":"2024-09-20T21:05:54.130889+0000","last_became_peered":"2024-09-20T21:05:54.130889+0000","last_unstale":"2024-09-20T21:05:55.117521+0000","last_undegraded":"2024-09-20T21:05:55.117521+0000","last_fullsized":"2024-09-20T21:05:55.117521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122870+0000","last_change":"2024-09-20T21:05:34.265360+0000","last_active":"2024-09-20T21:05:55.122870+0000","last_peered":"2024-09-20T21:05:55.122870+0000","last_clean":"2024-09-20T21:05:55.122870+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:05:55.122870+0000","last_undegraded":"2024-09-20T21:05:55.122870+0000","last_fullsized":"2024-09-20T21:05:55.122870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:02.949435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123803+0000","last_change":"2024-09-20T21:05:34.264103+0000","last_active":"2024-09-20T21:05:55.123803+0000","last_peered":"2024-09-20T21:05:55.123803+0000","last_clean":"2024-09-20T21:05:55.123803+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:05:55.123803+0000","last_undegraded":"2024-09-20T21:05:55.123803+0000","last_fullsized":"2024-09-20T21:05:55.123803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.354082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116206+0000","last_change":"2024-09-20T21:05:54.126994+0000","last_active":"2024-09-20T21:05:55.116206+0000","last_peered":"2024-09-20T21:05:55.116206+0000","last_clean":"2024-09-20T21:05:55.116206+0000","last_became_active":"2024-09-20T21:05:54.124655+0000","last_became_peered":"2024-09-20T21:05:54.124655+0000","last_unstale":"2024-09-20T21:05:55.116206+0000","last_undegraded":"2024-09-20T21:05:55.116206+0000","last_fullsized":"2024-09-20T21:05:55.116206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:41.063171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123077+0000","last_change":"2024-09-20T21:05:45.324641+0000","last_active":"2024-09-20T21:05:55.123077+0000","last_peered":"2024-09-20T21:05:55.123077+0000","last_clean":"2024-09-20T21:05:55.123077+0000","last_became_active":"2024-09-20T21:05:45.323784+0000","last_became_peered":"2024-09-20T21:05:45.323784+0000","last_unstale":"2024-09-20T21:05:55.123077+0000","last_undegraded":"2024-09-20T21:05:55.123077+0000","last_fullsized":"2024-09-20T21:05:55.123077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:42.679240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":69,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386096+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:54.386096+0000","last_peered":"2024-09-20T21:05:54.386096+0000","last_clean":"2024-09-20T21:05:54.386096+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:54.386096+0000","last_undegraded":"2024-09-20T21:05:54.386096+0000","last_fullsized":"2024-09-20T21:05:54.386096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:41.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":53,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.389431+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:54.389431+0000","last_peered":"2024-09-20T21:05:54.389431+0000","last_clean":"2024-09-20T21:05:54.389431+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:54.389431+0000","last_undegraded":"2024-09-20T21:05:54.389431+0000","last_fullsized":"2024-09-20T21:05:54.389431+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:04.604590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115866+0000","last_change":"2024-09-20T21:05:54.126691+0000","last_active":"2024-09-20T21:05:55.115866+0000","last_peered":"2024-09-20T21:05:55.115866+0000","last_clean":"2024-09-20T21:05:55.115866+0000","last_became_active":"2024-09-20T21:05:54.124815+0000","last_became_peered":"2024-09-20T21:05:54.124815+0000","last_unstale":"2024-09-20T21:05:55.115866+0000","last_undegraded":"2024-09-20T21:05:55.115866+0000","last_fullsized":"2024-09-20T21:05:55.115866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117867+0000","last_change":"2024-09-20T21:05:54.121201+0000","last_active":"2024-09-20T21:05:55.117867+0000","last_peered":"2024-09-20T21:05:55.117867+0000","last_clean":"2024-09-20T21:05:55.117867+0000","last_became_active":"2024-09-20T21:05:54.119189+0000","last_became_peered":"2024-09-20T21:05:54.119189+0000","last_unstale":"2024-09-20T21:05:55.117867+0000","last_undegraded":"2024-09-20T21:05:55.117867+0000","last_fullsized":"2024-09-20T21:05:55.117867+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:15.290334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115927+0000","last_change":"2024-09-20T21:05:54.130286+0000","last_active":"2024-09-20T21:05:55.115927+0000","last_peered":"2024-09-20T21:05:55.115927+0000","last_clean":"2024-09-20T21:05:55.115927+0000","last_became_active":"2024-09-20T21:05:54.127969+0000","last_became_peered":"2024-09-20T21:05:54.127969+0000","last_unstale":"2024-09-20T21:05:55.115927+0000","last_undegraded":"2024-09-20T21:05:55.115927+0000","last_fullsized":"2024-09-20T21:05:55.115927+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:27.343016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388849+0000","last_change":"2024-09-20T21:05:33.529620+0000","last_active":"2024-09-20T21:05:54.388849+0000","last_peered":"2024-09-20T21:05:54.388849+0000","last_clean":"2024-09-20T21:05:54.388849+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:05:54.388849+0000","last_undegraded":"2024-09-20T21:05:54.388849+0000","last_fullsized":"2024-09-20T21:05:54.388849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:39.374497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388079+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:54.388079+0000","last_peered":"2024-09-20T21:05:54.388079+0000","last_clean":"2024-09-20T21:05:54.388079+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:54.388079+0000","last_undegraded":"2024-09-20T21:05:54.388079+0000","last_fullsized":"2024-09-20T21:05:54.388079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:30.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387945+0000","last_change":"2024-09-20T21:05:33.516924+0000","last_active":"2024-09-20T21:05:54.387945+0000","last_peered":"2024-09-20T21:05:54.387945+0000","last_clean":"2024-09-20T21:05:54.387945+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:05:54.387945+0000","last_undegraded":"2024-09-20T21:05:54.387945+0000","last_fullsized":"2024-09-20T21:05:54.387945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:55.590471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122171+0000","last_change":"2024-09-20T21:05:45.324359+0000","last_active":"2024-09-20T21:05:55.122171+0000","last_peered":"2024-09-20T21:05:55.122171+0000","last_clean":"2024-09-20T21:05:55.122171+0000","last_became_active":"2024-09-20T21:05:45.321407+0000","last_became_peered":"2024-09-20T21:05:45.321407+0000","last_unstale":"2024-09-20T21:05:55.122171+0000","last_undegraded":"2024-09-20T21:05:55.122171+0000","last_fullsized":"2024-09-20T21:05:55.122171+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123544+0000","last_change":"2024-09-20T21:05:34.264426+0000","last_active":"2024-09-20T21:05:55.123544+0000","last_peered":"2024-09-20T21:05:55.123544+0000","last_clean":"2024-09-20T21:05:55.123544+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:05:55.123544+0000","last_undegraded":"2024-09-20T21:05:55.123544+0000","last_fullsized":"2024-09-20T21:05:55.123544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:23.886272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.389124+0000","last_change":"2024-09-20T21:05:33.517281+0000","last_active":"2024-09-20T21:05:54.389124+0000","last_peered":"2024-09-20T21:05:54.389124+0000","last_clean":"2024-09-20T21:05:54.389124+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:05:54.389124+0000","last_undegraded":"2024-09-20T21:05:54.389124+0000","last_fullsized":"2024-09-20T21:05:54.389124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:44.497231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.105860+0000","last_change":"2024-09-20T21:05:45.318892+0000","last_active":"2024-09-20T21:05:54.105860+0000","last_peered":"2024-09-20T21:05:54.105860+0000","last_clean":"2024-09-20T21:05:54.105860+0000","last_became_active":"2024-09-20T21:05:45.318102+0000","last_became_peered":"2024-09-20T21:05:45.318102+0000","last_unstale":"2024-09-20T21:05:54.105860+0000","last_undegraded":"2024-09-20T21:05:54.105860+0000","last_fullsized":"2024-09-20T21:05:54.105860+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:22:05.691202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388713+0000","last_change":"2024-09-20T21:05:33.527473+0000","last_active":"2024-09-20T21:05:54.388713+0000","last_peered":"2024-09-20T21:05:54.388713+0000","last_clean":"2024-09-20T21:05:54.388713+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:05:54.388713+0000","last_undegraded":"2024-09-20T21:05:54.388713+0000","last_fullsized":"2024-09-20T21:05:54.388713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:43.880199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116681+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:55.116681+0000","last_peered":"2024-09-20T21:05:55.116681+0000","last_clean":"2024-09-20T21:05:55.116681+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:55.116681+0000","last_undegraded":"2024-09-20T21:05:55.116681+0000","last_fullsized":"2024-09-20T21:05:55.116681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:06:41.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388760+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:54.388760+0000","last_peered":"2024-09-20T21:05:54.388760+0000","last_clean":"2024-09-20T21:05:54.388760+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:54.388760+0000","last_undegraded":"2024-09-20T21:05:54.388760+0000","last_fullsized":"2024-09-20T21:05:54.388760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:57.275101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116157+0000","last_change":"2024-09-20T21:05:54.121694+0000","last_active":"2024-09-20T21:05:55.116157+0000","last_peered":"2024-09-20T21:05:55.116157+0000","last_clean":"2024-09-20T21:05:55.116157+0000","last_became_active":"2024-09-20T21:05:54.120855+0000","last_became_peered":"2024-09-20T21:05:54.120855+0000","last_unstale":"2024-09-20T21:05:55.116157+0000","last_undegraded":"2024-09-20T21:05:55.116157+0000","last_fullsized":"2024-09-20T21:05:55.116157+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:11.887662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123467+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:05:55.123467+0000","last_peered":"2024-09-20T21:05:55.123467+0000","last_clean":"2024-09-20T21:05:55.123467+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:05:55.123467+0000","last_undegraded":"2024-09-20T21:05:55.123467+0000","last_fullsized":"2024-09-20T21:05:55.123467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":271,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.385971+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:54.385971+0000","last_peered":"2024-09-20T21:05:54.385971+0000","last_clean":"2024-09-20T21:05:54.385971+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:54.385971+0000","last_undegraded":"2024-09-20T21:05:54.385971+0000","last_fullsized":"2024-09-20T21:05:54.385971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:49.545054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386933+0000","last_change":"2024-09-20T21:05:33.516926+0000","last_active":"2024-09-20T21:05:54.386933+0000","last_peered":"2024-09-20T21:05:54.386933+0000","last_clean":"2024-09-20T21:05:54.386933+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:05:54.386933+0000","last_undegraded":"2024-09-20T21:05:54.386933+0000","last_fullsized":"2024-09-20T21:05:54.386933+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:48.429167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123236+0000","last_change":"2024-09-20T21:05:37.268775+0000","last_active":"2024-09-20T21:05:55.123236+0000","last_peered":"2024-09-20T21:05:55.123236+0000","last_clean":"2024-09-20T21:05:55.123236+0000","last_became_active":"2024-09-20T21:05:37.267211+0000","last_became_peered":"2024-09-20T21:05:37.267211+0000","last_unstale":"2024-09-20T21:05:55.123236+0000","last_undegraded":"2024-09-20T21:05:55.123236+0000","last_fullsized":"2024-09-20T21:05:55.123236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:50.497847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388965+0000","last_change":"2024-09-20T21:05:33.527863+0000","last_active":"2024-09-20T21:05:54.388965+0000","last_peered":"2024-09-20T21:05:54.388965+0000","last_clean":"2024-09-20T21:05:54.388965+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:05:54.388965+0000","last_undegraded":"2024-09-20T21:05:54.388965+0000","last_fullsized":"2024-09-20T21:05:54.388965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:28.039071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386462+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:54.386462+0000","last_peered":"2024-09-20T21:05:54.386462+0000","last_clean":"2024-09-20T21:05:54.386462+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:54.386462+0000","last_undegraded":"2024-09-20T21:05:54.386462+0000","last_fullsized":"2024-09-20T21:05:54.386462+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:58.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124493+0000","last_change":"2024-09-20T21:05:45.323068+0000","last_active":"2024-09-20T21:05:55.124493+0000","last_peered":"2024-09-20T21:05:55.124493+0000","last_clean":"2024-09-20T21:05:55.124493+0000","last_became_active":"2024-09-20T21:05:45.321160+0000","last_became_peered":"2024-09-20T21:05:45.321160+0000","last_unstale":"2024-09-20T21:05:55.124493+0000","last_undegraded":"2024-09-20T21:05:55.124493+0000","last_fullsized":"2024-09-20T21:05:55.124493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:32.144771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117798+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:55.117798+0000","last_peered":"2024-09-20T21:05:55.117798+0000","last_clean":"2024-09-20T21:05:55.117798+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:55.117798+0000","last_undegraded":"2024-09-20T21:05:55.117798+0000","last_fullsized":"2024-09-20T21:05:55.117798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124734+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:55.124734+0000","last_peered":"2024-09-20T21:05:55.124734+0000","last_clean":"2024-09-20T21:05:55.124734+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:55.124734+0000","last_undegraded":"2024-09-20T21:05:55.124734+0000","last_fullsized":"2024-09-20T21:05:55.124734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116320+0000","last_change":"2024-09-20T21:05:54.126982+0000","last_active":"2024-09-20T21:05:55.116320+0000","last_peered":"2024-09-20T21:05:55.116320+0000","last_clean":"2024-09-20T21:05:55.116320+0000","last_became_active":"2024-09-20T21:05:54.121776+0000","last_became_peered":"2024-09-20T21:05:54.121776+0000","last_unstale":"2024-09-20T21:05:55.116320+0000","last_undegraded":"2024-09-20T21:05:55.116320+0000","last_fullsized":"2024-09-20T21:05:55.116320+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:46.297334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":114,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123656+0000","last_change":"2024-09-20T21:05:52.101432+0000","last_active":"2024-09-20T21:05:55.123656+0000","last_peered":"2024-09-20T21:05:55.123656+0000","last_clean":"2024-09-20T21:05:55.123656+0000","last_became_active":"2024-09-20T21:05:52.100421+0000","last_became_peered":"2024-09-20T21:05:52.100421+0000","last_unstale":"2024-09-20T21:05:55.123656+0000","last_undegraded":"2024-09-20T21:05:55.123656+0000","last_fullsized":"2024-09-20T21:05:55.123656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386411+0000","last_change":"2024-09-20T21:05:33.525394+0000","last_active":"2024-09-20T21:05:54.386411+0000","last_peered":"2024-09-20T21:05:54.386411+0000","last_clean":"2024-09-20T21:05:54.386411+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:05:54.386411+0000","last_undegraded":"2024-09-20T21:05:54.386411+0000","last_fullsized":"2024-09-20T21:05:54.386411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:51:33.922257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386689+0000","last_change":"2024-09-20T21:05:33.522984+0000","last_active":"2024-09-20T21:05:54.386689+0000","last_peered":"2024-09-20T21:05:54.386689+0000","last_clean":"2024-09-20T21:05:54.386689+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:05:54.386689+0000","last_undegraded":"2024-09-20T21:05:54.386689+0000","last_fullsized":"2024-09-20T21:05:54.386689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:22:14.870718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124538+0000","last_change":"2024-09-20T21:05:45.331015+0000","last_active":"2024-09-20T21:05:55.124538+0000","last_peered":"2024-09-20T21:05:55.124538+0000","last_clean":"2024-09-20T21:05:55.124538+0000","last_became_active":"2024-09-20T21:05:45.330361+0000","last_became_peered":"2024-09-20T21:05:45.330361+0000","last_unstale":"2024-09-20T21:05:55.124538+0000","last_undegraded":"2024-09-20T21:05:55.124538+0000","last_fullsized":"2024-09-20T21:05:55.124538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387781+0000","last_change":"2024-09-20T21:05:33.530100+0000","last_active":"2024-09-20T21:05:54.387781+0000","last_peered":"2024-09-20T21:05:54.387781+0000","last_clean":"2024-09-20T21:05:54.387781+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:05:54.387781+0000","last_undegraded":"2024-09-20T21:05:54.387781+0000","last_fullsized":"2024-09-20T21:05:54.387781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:12.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124786+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:55.124786+0000","last_peered":"2024-09-20T21:05:55.124786+0000","last_clean":"2024-09-20T21:05:55.124786+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:55.124786+0000","last_undegraded":"2024-09-20T21:05:55.124786+0000","last_fullsized":"2024-09-20T21:05:55.124786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116170+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:55.116170+0000","last_peered":"2024-09-20T21:05:55.116170+0000","last_clean":"2024-09-20T21:05:55.116170+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:55.116170+0000","last_undegraded":"2024-09-20T21:05:55.116170+0000","last_fullsized":"2024-09-20T21:05:55.116170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:03.961332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124581+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:55.124581+0000","last_peered":"2024-09-20T21:05:55.124581+0000","last_clean":"2024-09-20T21:05:55.124581+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:55.124581+0000","last_undegraded":"2024-09-20T21:05:55.124581+0000","last_fullsized":"2024-09-20T21:05:55.124581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.118157+0000","last_change":"2024-09-20T21:05:54.121905+0000","last_active":"2024-09-20T21:05:55.118157+0000","last_peered":"2024-09-20T21:05:55.118157+0000","last_clean":"2024-09-20T21:05:55.118157+0000","last_became_active":"2024-09-20T21:05:54.121064+0000","last_became_peered":"2024-09-20T21:05:54.121064+0000","last_unstale":"2024-09-20T21:05:55.118157+0000","last_undegraded":"2024-09-20T21:05:55.118157+0000","last_fullsized":"2024-09-20T21:05:55.118157+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:54:14.429868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116445+0000","last_change":"2024-09-20T21:05:54.132710+0000","last_active":"2024-09-20T21:05:55.116445+0000","last_peered":"2024-09-20T21:05:55.116445+0000","last_clean":"2024-09-20T21:05:55.116445+0000","last_became_active":"2024-09-20T21:05:54.127863+0000","last_became_peered":"2024-09-20T21:05:54.127863+0000","last_unstale":"2024-09-20T21:05:55.116445+0000","last_undegraded":"2024-09-20T21:05:55.116445+0000","last_fullsized":"2024-09-20T21:05:55.116445+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:59.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124756+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:55.124756+0000","last_peered":"2024-09-20T21:05:55.124756+0000","last_clean":"2024-09-20T21:05:55.124756+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:55.124756+0000","last_undegraded":"2024-09-20T21:05:55.124756+0000","last_fullsized":"2024-09-20T21:05:55.124756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124399+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:05:55.124399+0000","last_peered":"2024-09-20T21:05:55.124399+0000","last_clean":"2024-09-20T21:05:55.124399+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:05:55.124399+0000","last_undegraded":"2024-09-20T21:05:55.124399+0000","last_fullsized":"2024-09-20T21:05:55.124399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123360+0000","last_change":"2024-09-20T21:05:37.267287+0000","last_active":"2024-09-20T21:05:55.123360+0000","last_peered":"2024-09-20T21:05:55.123360+0000","last_clean":"2024-09-20T21:05:55.123360+0000","last_became_active":"2024-09-20T21:05:37.266438+0000","last_became_peered":"2024-09-20T21:05:37.266438+0000","last_unstale":"2024-09-20T21:05:55.123360+0000","last_undegraded":"2024-09-20T21:05:55.123360+0000","last_fullsized":"2024-09-20T21:05:55.123360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124163+0000","last_change":"2024-09-20T21:05:34.264862+0000","last_active":"2024-09-20T21:05:55.124163+0000","last_peered":"2024-09-20T21:05:55.124163+0000","last_clean":"2024-09-20T21:05:55.124163+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:05:55.124163+0000","last_undegraded":"2024-09-20T21:05:55.124163+0000","last_fullsized":"2024-09-20T21:05:55.124163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:32.512356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.133860+0000","last_change":"2024-09-20T21:05:54.129999+0000","last_active":"2024-09-20T21:05:54.133860+0000","last_peered":"2024-09-20T21:05:54.133860+0000","last_clean":"2024-09-20T21:05:54.133860+0000","last_became_active":"2024-09-20T21:05:54.120539+0000","last_became_peered":"2024-09-20T21:05:54.120539+0000","last_unstale":"2024-09-20T21:05:54.133860+0000","last_undegraded":"2024-09-20T21:05:54.133860+0000","last_fullsized":"2024-09-20T21:05:54.133860+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:51:33.047862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116571+0000","last_change":"2024-09-20T21:05:54.121933+0000","last_active":"2024-09-20T21:05:55.116571+0000","last_peered":"2024-09-20T21:05:55.116571+0000","last_clean":"2024-09-20T21:05:55.116571+0000","last_became_active":"2024-09-20T21:05:54.119503+0000","last_became_peered":"2024-09-20T21:05:54.119503+0000","last_unstale":"2024-09-20T21:05:55.116571+0000","last_undegraded":"2024-09-20T21:05:55.116571+0000","last_fullsized":"2024-09-20T21:05:55.116571+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:02.194094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387907+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:54.387907+0000","last_peered":"2024-09-20T21:05:54.387907+0000","last_clean":"2024-09-20T21:05:54.387907+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:54.387907+0000","last_undegraded":"2024-09-20T21:05:54.387907+0000","last_fullsized":"2024-09-20T21:05:54.387907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:49.172273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387014+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:54.387014+0000","last_peered":"2024-09-20T21:05:54.387014+0000","last_clean":"2024-09-20T21:05:54.387014+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:54.387014+0000","last_undegraded":"2024-09-20T21:05:54.387014+0000","last_fullsized":"2024-09-20T21:05:54.387014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:07:07.242939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122199+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:05:55.122199+0000","last_peered":"2024-09-20T21:05:55.122199+0000","last_clean":"2024-09-20T21:05:55.122199+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:05:55.122199+0000","last_undegraded":"2024-09-20T21:05:55.122199+0000","last_fullsized":"2024-09-20T21:05:55.122199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117882+0000","last_change":"2024-09-20T21:05:54.130634+0000","last_active":"2024-09-20T21:05:55.117882+0000","last_peered":"2024-09-20T21:05:55.117882+0000","last_clean":"2024-09-20T21:05:55.117882+0000","last_became_active":"2024-09-20T21:05:54.128221+0000","last_became_peered":"2024-09-20T21:05:54.128221+0000","last_unstale":"2024-09-20T21:05:55.117882+0000","last_undegraded":"2024-09-20T21:05:55.117882+0000","last_fullsized":"2024-09-20T21:05:55.117882+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:37.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.388967+0000","last_change":"2024-09-20T21:05:33.525151+0000","last_active":"2024-09-20T21:05:54.388967+0000","last_peered":"2024-09-20T21:05:54.388967+0000","last_clean":"2024-09-20T21:05:54.388967+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:05:54.388967+0000","last_undegraded":"2024-09-20T21:05:54.388967+0000","last_fullsized":"2024-09-20T21:05:54.388967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:51.245496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123714+0000","last_change":"2024-09-20T21:05:52.104238+0000","last_active":"2024-09-20T21:05:55.123714+0000","last_peered":"2024-09-20T21:05:55.123714+0000","last_clean":"2024-09-20T21:05:55.123714+0000","last_became_active":"2024-09-20T21:05:52.103630+0000","last_became_peered":"2024-09-20T21:05:52.103630+0000","last_unstale":"2024-09-20T21:05:55.123714+0000","last_undegraded":"2024-09-20T21:05:55.123714+0000","last_fullsized":"2024-09-20T21:05:55.123714+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124560+0000","last_change":"2024-09-20T21:05:34.264735+0000","last_active":"2024-09-20T21:05:55.124560+0000","last_peered":"2024-09-20T21:05:55.124560+0000","last_clean":"2024-09-20T21:05:55.124560+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:05:55.124560+0000","last_undegraded":"2024-09-20T21:05:55.124560+0000","last_fullsized":"2024-09-20T21:05:55.124560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:16.718841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.120856+0000","last_change":"2024-09-20T21:05:52.100914+0000","last_active":"2024-09-20T21:05:55.120856+0000","last_peered":"2024-09-20T21:05:55.120856+0000","last_clean":"2024-09-20T21:05:55.120856+0000","last_became_active":"2024-09-20T21:05:52.100104+0000","last_became_peered":"2024-09-20T21:05:52.100104+0000","last_unstale":"2024-09-20T21:05:55.120856+0000","last_undegraded":"2024-09-20T21:05:55.120856+0000","last_fullsized":"2024-09-20T21:05:55.120856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:51:38.241935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117935+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:55.117935+0000","last_peered":"2024-09-20T21:05:55.117935+0000","last_clean":"2024-09-20T21:05:55.117935+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:55.117935+0000","last_undegraded":"2024-09-20T21:05:55.117935+0000","last_fullsized":"2024-09-20T21:05:55.117935+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:39.486200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.121098+0000","last_change":"2024-09-20T21:05:37.269662+0000","last_active":"2024-09-20T21:05:55.121098+0000","last_peered":"2024-09-20T21:05:55.121098+0000","last_clean":"2024-09-20T21:05:55.121098+0000","last_became_active":"2024-09-20T21:05:37.268982+0000","last_became_peered":"2024-09-20T21:05:37.268982+0000","last_unstale":"2024-09-20T21:05:55.121098+0000","last_undegraded":"2024-09-20T21:05:55.121098+0000","last_fullsized":"2024-09-20T21:05:55.121098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:38.474304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122329+0000","last_change":"2024-09-20T21:05:45.321820+0000","last_active":"2024-09-20T21:05:55.122329+0000","last_peered":"2024-09-20T21:05:55.122329+0000","last_clean":"2024-09-20T21:05:55.122329+0000","last_became_active":"2024-09-20T21:05:45.320924+0000","last_became_peered":"2024-09-20T21:05:45.320924+0000","last_unstale":"2024-09-20T21:05:55.122329+0000","last_undegraded":"2024-09-20T21:05:55.122329+0000","last_fullsized":"2024-09-20T21:05:55.122329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:18:23.772854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123853+0000","last_change":"2024-09-20T21:05:45.321935+0000","last_active":"2024-09-20T21:05:55.123853+0000","last_peered":"2024-09-20T21:05:55.123853+0000","last_clean":"2024-09-20T21:05:55.123853+0000","last_became_active":"2024-09-20T21:05:45.321031+0000","last_became_peered":"2024-09-20T21:05:45.321031+0000","last_unstale":"2024-09-20T21:05:55.123853+0000","last_undegraded":"2024-09-20T21:05:55.123853+0000","last_fullsized":"2024-09-20T21:05:55.123853+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:01.849318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117259+0000","last_change":"2024-09-20T21:05:54.127603+0000","last_active":"2024-09-20T21:05:55.117259+0000","last_peered":"2024-09-20T21:05:55.117259+0000","last_clean":"2024-09-20T21:05:55.117259+0000","last_became_active":"2024-09-20T21:05:54.125123+0000","last_became_peered":"2024-09-20T21:05:54.125123+0000","last_unstale":"2024-09-20T21:05:55.117259+0000","last_undegraded":"2024-09-20T21:05:55.117259+0000","last_fullsized":"2024-09-20T21:05:55.117259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:43:09.663833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116468+0000","last_change":"2024-09-20T21:05:54.122334+0000","last_active":"2024-09-20T21:05:55.116468+0000","last_peered":"2024-09-20T21:05:55.116468+0000","last_clean":"2024-09-20T21:05:55.116468+0000","last_became_active":"2024-09-20T21:05:54.121466+0000","last_became_peered":"2024-09-20T21:05:54.121466+0000","last_unstale":"2024-09-20T21:05:55.116468+0000","last_undegraded":"2024-09-20T21:05:55.116468+0000","last_fullsized":"2024-09-20T21:05:55.116468+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:41.667343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":122,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117020+0000","last_change":"2024-09-20T21:05:54.132657+0000","last_active":"2024-09-20T21:05:55.117020+0000","last_peered":"2024-09-20T21:05:55.117020+0000","last_clean":"2024-09-20T21:05:55.117020+0000","last_became_active":"2024-09-20T21:05:54.129891+0000","last_became_peered":"2024-09-20T21:05:54.129891+0000","last_unstale":"2024-09-20T21:05:55.117020+0000","last_undegraded":"2024-09-20T21:05:55.117020+0000","last_fullsized":"2024-09-20T21:05:55.117020+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:26.911986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116983+0000","last_change":"2024-09-20T21:05:54.127321+0000","last_active":"2024-09-20T21:05:55.116983+0000","last_peered":"2024-09-20T21:05:55.116983+0000","last_clean":"2024-09-20T21:05:55.116983+0000","last_became_active":"2024-09-20T21:05:54.120527+0000","last_became_peered":"2024-09-20T21:05:54.120527+0000","last_unstale":"2024-09-20T21:05:55.116983+0000","last_undegraded":"2024-09-20T21:05:55.116983+0000","last_fullsized":"2024-09-20T21:05:55.116983+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:25.400362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387624+0000","last_change":"2024-09-20T21:05:33.523783+0000","last_active":"2024-09-20T21:05:54.387624+0000","last_peered":"2024-09-20T21:05:54.387624+0000","last_clean":"2024-09-20T21:05:54.387624+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:05:54.387624+0000","last_undegraded":"2024-09-20T21:05:54.387624+0000","last_fullsized":"2024-09-20T21:05:54.387624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:29.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.387367+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:54.387367+0000","last_peered":"2024-09-20T21:05:54.387367+0000","last_clean":"2024-09-20T21:05:54.387367+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:54.387367+0000","last_undegraded":"2024-09-20T21:05:54.387367+0000","last_fullsized":"2024-09-20T21:05:54.387367+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:45:47.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386849+0000","last_change":"2024-09-20T21:05:33.525036+0000","last_active":"2024-09-20T21:05:54.386849+0000","last_peered":"2024-09-20T21:05:54.386849+0000","last_clean":"2024-09-20T21:05:54.386849+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:05:54.386849+0000","last_undegraded":"2024-09-20T21:05:54.386849+0000","last_fullsized":"2024-09-20T21:05:54.386849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:13.120671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117548+0000","last_change":"2024-09-20T21:05:54.126814+0000","last_active":"2024-09-20T21:05:55.117548+0000","last_peered":"2024-09-20T21:05:55.117548+0000","last_clean":"2024-09-20T21:05:55.117548+0000","last_became_active":"2024-09-20T21:05:54.124075+0000","last_became_peered":"2024-09-20T21:05:54.124075+0000","last_unstale":"2024-09-20T21:05:55.117548+0000","last_undegraded":"2024-09-20T21:05:55.117548+0000","last_fullsized":"2024-09-20T21:05:55.117548+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:18.839315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116829+0000","last_change":"2024-09-20T21:05:54.122485+0000","last_active":"2024-09-20T21:05:55.116829+0000","last_peered":"2024-09-20T21:05:55.116829+0000","last_clean":"2024-09-20T21:05:55.116829+0000","last_became_active":"2024-09-20T21:05:54.121408+0000","last_became_peered":"2024-09-20T21:05:54.121408+0000","last_unstale":"2024-09-20T21:05:55.116829+0000","last_undegraded":"2024-09-20T21:05:55.116829+0000","last_fullsized":"2024-09-20T21:05:55.116829+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:36.479778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123681+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:55.123681+0000","last_peered":"2024-09-20T21:05:55.123681+0000","last_clean":"2024-09-20T21:05:55.123681+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:55.123681+0000","last_undegraded":"2024-09-20T21:05:55.123681+0000","last_fullsized":"2024-09-20T21:05:55.123681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":50,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:54.386617+0000","last_change":"2024-09-20T21:05:33.529399+0000","last_active":"2024-09-20T21:05:54.386617+0000","last_peered":"2024-09-20T21:05:54.386617+0000","last_clean":"2024-09-20T21:05:54.386617+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:05:54.386617+0000","last_undegraded":"2024-09-20T21:05:54.386617+0000","last_fullsized":"2024-09-20T21:05:54.386617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:36.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122854+0000","last_change":"2024-09-20T21:05:45.323879+0000","last_active":"2024-09-20T21:05:55.122854+0000","last_peered":"2024-09-20T21:05:55.122854+0000","last_clean":"2024-09-20T21:05:55.122854+0000","last_became_active":"2024-09-20T21:05:45.321268+0000","last_became_peered":"2024-09-20T21:05:45.321268+0000","last_unstale":"2024-09-20T21:05:55.122854+0000","last_undegraded":"2024-09-20T21:05:55.122854+0000","last_fullsized":"2024-09-20T21:05:55.122854+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:53.346461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216928,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94154912,"statfs":{"total":96636764160,"available":96414629888,"internally_reserved":0,"allocated":1118208,"data_stored":1000114,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350982,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54628,"kb_used_data":1104,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317212,"statfs":{"total":96636764160,"available":96580825088,"internally_reserved":0,"allocated":1130496,"data_stored":1000749,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325140,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046700,"statfs":{"total":96636764160,"available":96303820800,"internally_reserved":0,"allocated":1044480,"data_stored":408587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:05:58.328 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-20T21:05:58.328 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-20T21:05:58.698 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-20T21:05:58.708 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-20T21:05:58.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:05:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:05:59.035 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-09-20T21:05:58.992737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596708,"kb_used_data":3224,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282518812,"statfs":{"total":289910292480,"available":289299263488,"internally_reserved":0,"allocated":3301376,"data_stored":2413682,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.899120"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117741+0000","last_change":"2024-09-20T21:05:54.129746+0000","last_active":"2024-09-20T21:05:55.117741+0000","last_peered":"2024-09-20T21:05:55.117741+0000","last_clean":"2024-09-20T21:05:55.117741+0000","last_became_active":"2024-09-20T21:05:54.127664+0000","last_became_peered":"2024-09-20T21:05:54.127664+0000","last_unstale":"2024-09-20T21:05:55.117741+0000","last_undegraded":"2024-09-20T21:05:55.117741+0000","last_fullsized":"2024-09-20T21:05:55.117741+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:57.952046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117563+0000","last_change":"2024-09-20T21:05:54.126721+0000","last_active":"2024-09-20T21:05:55.117563+0000","last_peered":"2024-09-20T21:05:55.117563+0000","last_clean":"2024-09-20T21:05:55.117563+0000","last_became_active":"2024-09-20T21:05:54.124269+0000","last_became_peered":"2024-09-20T21:05:54.124269+0000","last_unstale":"2024-09-20T21:05:55.117563+0000","last_undegraded":"2024-09-20T21:05:55.117563+0000","last_fullsized":"2024-09-20T21:05:55.117563+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393027+0000","last_change":"2024-09-20T21:05:33.529595+0000","last_active":"2024-09-20T21:05:55.393027+0000","last_peered":"2024-09-20T21:05:55.393027+0000","last_clean":"2024-09-20T21:05:55.393027+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:05:55.393027+0000","last_undegraded":"2024-09-20T21:05:55.393027+0000","last_fullsized":"2024-09-20T21:05:55.393027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:08.234369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391440+0000","last_change":"2024-09-20T21:05:33.516896+0000","last_active":"2024-09-20T21:05:55.391440+0000","last_peered":"2024-09-20T21:05:55.391440+0000","last_clean":"2024-09-20T21:05:55.391440+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:05:55.391440+0000","last_undegraded":"2024-09-20T21:05:55.391440+0000","last_fullsized":"2024-09-20T21:05:55.391440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:48.472114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116748+0000","last_change":"2024-09-20T21:05:54.130938+0000","last_active":"2024-09-20T21:05:55.116748+0000","last_peered":"2024-09-20T21:05:55.116748+0000","last_clean":"2024-09-20T21:05:55.116748+0000","last_became_active":"2024-09-20T21:05:54.125511+0000","last_became_peered":"2024-09-20T21:05:54.125511+0000","last_unstale":"2024-09-20T21:05:55.116748+0000","last_undegraded":"2024-09-20T21:05:55.116748+0000","last_fullsized":"2024-09-20T21:05:55.116748+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:55.659526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391460+0000","last_change":"2024-09-20T21:05:33.526021+0000","last_active":"2024-09-20T21:05:55.391460+0000","last_peered":"2024-09-20T21:05:55.391460+0000","last_clean":"2024-09-20T21:05:55.391460+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:05:55.391460+0000","last_undegraded":"2024-09-20T21:05:55.391460+0000","last_fullsized":"2024-09-20T21:05:55.391460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:51.022212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492841+0000","last_change":"2024-09-20T21:05:55.492841+0000","last_active":"2024-09-20T21:05:55.492841+0000","last_peered":"2024-09-20T21:05:55.492841+0000","last_clean":"2024-09-20T21:05:55.492841+0000","last_became_active":"2024-09-20T21:05:55.492104+0000","last_became_peered":"2024-09-20T21:05:55.492104+0000","last_unstale":"2024-09-20T21:05:55.492841+0000","last_undegraded":"2024-09-20T21:05:55.492841+0000","last_fullsized":"2024-09-20T21:05:55.492841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.580757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390006+0000","last_change":"2024-09-20T21:05:33.527599+0000","last_active":"2024-09-20T21:05:55.390006+0000","last_peered":"2024-09-20T21:05:55.390006+0000","last_clean":"2024-09-20T21:05:55.390006+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:05:55.390006+0000","last_undegraded":"2024-09-20T21:05:55.390006+0000","last_fullsized":"2024-09-20T21:05:55.390006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:19:18.002155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122816+0000","last_change":"2024-09-20T21:05:45.329452+0000","last_active":"2024-09-20T21:05:55.122816+0000","last_peered":"2024-09-20T21:05:55.122816+0000","last_clean":"2024-09-20T21:05:55.122816+0000","last_became_active":"2024-09-20T21:05:45.327207+0000","last_became_peered":"2024-09-20T21:05:45.327207+0000","last_unstale":"2024-09-20T21:05:55.122816+0000","last_undegraded":"2024-09-20T21:05:55.122816+0000","last_fullsized":"2024-09-20T21:05:55.122816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:42.075068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117093+0000","last_change":"2024-09-20T21:05:54.126680+0000","last_active":"2024-09-20T21:05:55.117093+0000","last_peered":"2024-09-20T21:05:55.117093+0000","last_clean":"2024-09-20T21:05:55.117093+0000","last_became_active":"2024-09-20T21:05:54.124291+0000","last_became_peered":"2024-09-20T21:05:54.124291+0000","last_unstale":"2024-09-20T21:05:55.117093+0000","last_undegraded":"2024-09-20T21:05:55.117093+0000","last_fullsized":"2024-09-20T21:05:55.117093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:05.334214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392938+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:55.392938+0000","last_peered":"2024-09-20T21:05:55.392938+0000","last_clean":"2024-09-20T21:05:55.392938+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:55.392938+0000","last_undegraded":"2024-09-20T21:05:55.392938+0000","last_fullsized":"2024-09-20T21:05:55.392938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:14:10.131416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116730+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:05:55.116730+0000","last_peered":"2024-09-20T21:05:55.116730+0000","last_clean":"2024-09-20T21:05:55.116730+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:05:55.116730+0000","last_undegraded":"2024-09-20T21:05:55.116730+0000","last_fullsized":"2024-09-20T21:05:55.116730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:51.509743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116172+0000","last_change":"2024-09-20T21:05:54.132356+0000","last_active":"2024-09-20T21:05:55.116172+0000","last_peered":"2024-09-20T21:05:55.116172+0000","last_clean":"2024-09-20T21:05:55.116172+0000","last_became_active":"2024-09-20T21:05:54.128147+0000","last_became_peered":"2024-09-20T21:05:54.128147+0000","last_unstale":"2024-09-20T21:05:55.116172+0000","last_undegraded":"2024-09-20T21:05:55.116172+0000","last_fullsized":"2024-09-20T21:05:55.116172+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:07.742615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391210+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:55.391210+0000","last_peered":"2024-09-20T21:05:55.391210+0000","last_clean":"2024-09-20T21:05:55.391210+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:55.391210+0000","last_undegraded":"2024-09-20T21:05:55.391210+0000","last_fullsized":"2024-09-20T21:05:55.391210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:17.867418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390735+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:55.390735+0000","last_peered":"2024-09-20T21:05:55.390735+0000","last_clean":"2024-09-20T21:05:55.390735+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:55.390735+0000","last_undegraded":"2024-09-20T21:05:55.390735+0000","last_fullsized":"2024-09-20T21:05:55.390735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:36.753632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.490656+0000","last_change":"2024-09-20T21:05:55.490656+0000","last_active":"2024-09-20T21:05:55.490656+0000","last_peered":"2024-09-20T21:05:55.490656+0000","last_clean":"2024-09-20T21:05:55.490656+0000","last_became_active":"2024-09-20T21:05:55.489879+0000","last_became_peered":"2024-09-20T21:05:55.489879+0000","last_unstale":"2024-09-20T21:05:55.490656+0000","last_undegraded":"2024-09-20T21:05:55.490656+0000","last_fullsized":"2024-09-20T21:05:55.490656+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:01.290416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124476+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:55.124476+0000","last_peered":"2024-09-20T21:05:55.124476+0000","last_clean":"2024-09-20T21:05:55.124476+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:55.124476+0000","last_undegraded":"2024-09-20T21:05:55.124476+0000","last_fullsized":"2024-09-20T21:05:55.124476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117505+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:55.117505+0000","last_peered":"2024-09-20T21:05:55.117505+0000","last_clean":"2024-09-20T21:05:55.117505+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:55.117505+0000","last_undegraded":"2024-09-20T21:05:55.117505+0000","last_fullsized":"2024-09-20T21:05:55.117505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122128+0000","last_change":"2024-09-20T21:05:45.327807+0000","last_active":"2024-09-20T21:05:55.122128+0000","last_peered":"2024-09-20T21:05:55.122128+0000","last_clean":"2024-09-20T21:05:55.122128+0000","last_became_active":"2024-09-20T21:05:45.326913+0000","last_became_peered":"2024-09-20T21:05:45.326913+0000","last_unstale":"2024-09-20T21:05:55.122128+0000","last_undegraded":"2024-09-20T21:05:55.122128+0000","last_fullsized":"2024-09-20T21:05:55.122128+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492609+0000","last_change":"2024-09-20T21:05:55.492609+0000","last_active":"2024-09-20T21:05:55.492609+0000","last_peered":"2024-09-20T21:05:55.492609+0000","last_clean":"2024-09-20T21:05:55.492609+0000","last_became_active":"2024-09-20T21:05:55.491995+0000","last_became_peered":"2024-09-20T21:05:55.491995+0000","last_unstale":"2024-09-20T21:05:55.492609+0000","last_undegraded":"2024-09-20T21:05:55.492609+0000","last_fullsized":"2024-09-20T21:05:55.492609+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:00.972806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392131+0000","last_change":"2024-09-20T21:05:33.524928+0000","last_active":"2024-09-20T21:05:55.392131+0000","last_peered":"2024-09-20T21:05:55.392131+0000","last_clean":"2024-09-20T21:05:55.392131+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:05:55.392131+0000","last_undegraded":"2024-09-20T21:05:55.392131+0000","last_fullsized":"2024-09-20T21:05:55.392131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:42.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116038+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:55.116038+0000","last_peered":"2024-09-20T21:05:55.116038+0000","last_clean":"2024-09-20T21:05:55.116038+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:55.116038+0000","last_undegraded":"2024-09-20T21:05:55.116038+0000","last_fullsized":"2024-09-20T21:05:55.116038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123406+0000","last_change":"2024-09-20T21:05:52.103930+0000","last_active":"2024-09-20T21:05:55.123406+0000","last_peered":"2024-09-20T21:05:55.123406+0000","last_clean":"2024-09-20T21:05:55.123406+0000","last_became_active":"2024-09-20T21:05:52.103477+0000","last_became_peered":"2024-09-20T21:05:52.103477+0000","last_unstale":"2024-09-20T21:05:55.123406+0000","last_undegraded":"2024-09-20T21:05:55.123406+0000","last_fullsized":"2024-09-20T21:05:55.123406+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115860+0000","last_change":"2024-09-20T21:05:54.133334+0000","last_active":"2024-09-20T21:05:55.115860+0000","last_peered":"2024-09-20T21:05:55.115860+0000","last_clean":"2024-09-20T21:05:55.115860+0000","last_became_active":"2024-09-20T21:05:54.129639+0000","last_became_peered":"2024-09-20T21:05:54.129639+0000","last_unstale":"2024-09-20T21:05:55.115860+0000","last_undegraded":"2024-09-20T21:05:55.115860+0000","last_fullsized":"2024-09-20T21:05:55.115860+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117793+0000","last_change":"2024-09-20T21:05:54.126793+0000","last_active":"2024-09-20T21:05:55.117793+0000","last_peered":"2024-09-20T21:05:55.117793+0000","last_clean":"2024-09-20T21:05:55.117793+0000","last_became_active":"2024-09-20T21:05:54.124757+0000","last_became_peered":"2024-09-20T21:05:54.124757+0000","last_unstale":"2024-09-20T21:05:55.117793+0000","last_undegraded":"2024-09-20T21:05:55.117793+0000","last_fullsized":"2024-09-20T21:05:55.117793+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:46:28.346590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123336+0000","last_change":"2024-09-20T21:05:45.324835+0000","last_active":"2024-09-20T21:05:55.123336+0000","last_peered":"2024-09-20T21:05:55.123336+0000","last_clean":"2024-09-20T21:05:55.123336+0000","last_became_active":"2024-09-20T21:05:45.321767+0000","last_became_peered":"2024-09-20T21:05:45.321767+0000","last_unstale":"2024-09-20T21:05:55.123336+0000","last_undegraded":"2024-09-20T21:05:55.123336+0000","last_fullsized":"2024-09-20T21:05:55.123336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:16.302231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392754+0000","last_change":"2024-09-20T21:05:33.528984+0000","last_active":"2024-09-20T21:05:55.392754+0000","last_peered":"2024-09-20T21:05:55.392754+0000","last_clean":"2024-09-20T21:05:55.392754+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:05:55.392754+0000","last_undegraded":"2024-09-20T21:05:55.392754+0000","last_fullsized":"2024-09-20T21:05:55.392754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:53.623013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117367+0000","last_change":"2024-09-20T21:05:54.121935+0000","last_active":"2024-09-20T21:05:55.117367+0000","last_peered":"2024-09-20T21:05:55.117367+0000","last_clean":"2024-09-20T21:05:55.117367+0000","last_became_active":"2024-09-20T21:05:54.120990+0000","last_became_peered":"2024-09-20T21:05:54.120990+0000","last_unstale":"2024-09-20T21:05:55.117367+0000","last_undegraded":"2024-09-20T21:05:55.117367+0000","last_fullsized":"2024-09-20T21:05:55.117367+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122633+0000","last_change":"2024-09-20T21:05:37.268677+0000","last_active":"2024-09-20T21:05:55.122633+0000","last_peered":"2024-09-20T21:05:55.122633+0000","last_clean":"2024-09-20T21:05:55.122633+0000","last_became_active":"2024-09-20T21:05:37.267096+0000","last_became_peered":"2024-09-20T21:05:37.267096+0000","last_unstale":"2024-09-20T21:05:55.122633+0000","last_undegraded":"2024-09-20T21:05:55.122633+0000","last_fullsized":"2024-09-20T21:05:55.122633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116342+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:55.116342+0000","last_peered":"2024-09-20T21:05:55.116342+0000","last_clean":"2024-09-20T21:05:55.116342+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:55.116342+0000","last_undegraded":"2024-09-20T21:05:55.116342+0000","last_fullsized":"2024-09-20T21:05:55.116342+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123564+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:55.123564+0000","last_peered":"2024-09-20T21:05:55.123564+0000","last_clean":"2024-09-20T21:05:55.123564+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:55.123564+0000","last_undegraded":"2024-09-20T21:05:55.123564+0000","last_fullsized":"2024-09-20T21:05:55.123564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389829+0000","last_change":"2024-09-20T21:05:33.520634+0000","last_active":"2024-09-20T21:05:55.389829+0000","last_peered":"2024-09-20T21:05:55.389829+0000","last_clean":"2024-09-20T21:05:55.389829+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:05:55.389829+0000","last_undegraded":"2024-09-20T21:05:55.389829+0000","last_fullsized":"2024-09-20T21:05:55.389829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.341860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117126+0000","last_change":"2024-09-20T21:05:54.132673+0000","last_active":"2024-09-20T21:05:55.117126+0000","last_peered":"2024-09-20T21:05:55.117126+0000","last_clean":"2024-09-20T21:05:55.117126+0000","last_became_active":"2024-09-20T21:05:54.128119+0000","last_became_peered":"2024-09-20T21:05:54.128119+0000","last_unstale":"2024-09-20T21:05:55.117126+0000","last_undegraded":"2024-09-20T21:05:55.117126+0000","last_fullsized":"2024-09-20T21:05:55.117126+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391078+0000","last_change":"2024-09-20T21:05:33.523453+0000","last_active":"2024-09-20T21:05:55.391078+0000","last_peered":"2024-09-20T21:05:55.391078+0000","last_clean":"2024-09-20T21:05:55.391078+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:05:55.391078+0000","last_undegraded":"2024-09-20T21:05:55.391078+0000","last_fullsized":"2024-09-20T21:05:55.391078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:59.275158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117521+0000","last_change":"2024-09-20T21:05:54.133190+0000","last_active":"2024-09-20T21:05:55.117521+0000","last_peered":"2024-09-20T21:05:55.117521+0000","last_clean":"2024-09-20T21:05:55.117521+0000","last_became_active":"2024-09-20T21:05:54.130889+0000","last_became_peered":"2024-09-20T21:05:54.130889+0000","last_unstale":"2024-09-20T21:05:55.117521+0000","last_undegraded":"2024-09-20T21:05:55.117521+0000","last_fullsized":"2024-09-20T21:05:55.117521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122870+0000","last_change":"2024-09-20T21:05:34.265360+0000","last_active":"2024-09-20T21:05:55.122870+0000","last_peered":"2024-09-20T21:05:55.122870+0000","last_clean":"2024-09-20T21:05:55.122870+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:05:55.122870+0000","last_undegraded":"2024-09-20T21:05:55.122870+0000","last_fullsized":"2024-09-20T21:05:55.122870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:02.949435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123803+0000","last_change":"2024-09-20T21:05:34.264103+0000","last_active":"2024-09-20T21:05:55.123803+0000","last_peered":"2024-09-20T21:05:55.123803+0000","last_clean":"2024-09-20T21:05:55.123803+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:05:55.123803+0000","last_undegraded":"2024-09-20T21:05:55.123803+0000","last_fullsized":"2024-09-20T21:05:55.123803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.354082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116206+0000","last_change":"2024-09-20T21:05:54.126994+0000","last_active":"2024-09-20T21:05:55.116206+0000","last_peered":"2024-09-20T21:05:55.116206+0000","last_clean":"2024-09-20T21:05:55.116206+0000","last_became_active":"2024-09-20T21:05:54.124655+0000","last_became_peered":"2024-09-20T21:05:54.124655+0000","last_unstale":"2024-09-20T21:05:55.116206+0000","last_undegraded":"2024-09-20T21:05:55.116206+0000","last_fullsized":"2024-09-20T21:05:55.116206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:41.063171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123077+0000","last_change":"2024-09-20T21:05:45.324641+0000","last_active":"2024-09-20T21:05:55.123077+0000","last_peered":"2024-09-20T21:05:55.123077+0000","last_clean":"2024-09-20T21:05:55.123077+0000","last_became_active":"2024-09-20T21:05:45.323784+0000","last_became_peered":"2024-09-20T21:05:45.323784+0000","last_unstale":"2024-09-20T21:05:55.123077+0000","last_undegraded":"2024-09-20T21:05:55.123077+0000","last_fullsized":"2024-09-20T21:05:55.123077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:42.679240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389770+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:55.389770+0000","last_peered":"2024-09-20T21:05:55.389770+0000","last_clean":"2024-09-20T21:05:55.389770+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:55.389770+0000","last_undegraded":"2024-09-20T21:05:55.389770+0000","last_fullsized":"2024-09-20T21:05:55.389770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:41.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393613+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:55.393613+0000","last_peered":"2024-09-20T21:05:55.393613+0000","last_clean":"2024-09-20T21:05:55.393613+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:55.393613+0000","last_undegraded":"2024-09-20T21:05:55.393613+0000","last_fullsized":"2024-09-20T21:05:55.393613+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:04.604590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115866+0000","last_change":"2024-09-20T21:05:54.126691+0000","last_active":"2024-09-20T21:05:55.115866+0000","last_peered":"2024-09-20T21:05:55.115866+0000","last_clean":"2024-09-20T21:05:55.115866+0000","last_became_active":"2024-09-20T21:05:54.124815+0000","last_became_peered":"2024-09-20T21:05:54.124815+0000","last_unstale":"2024-09-20T21:05:55.115866+0000","last_undegraded":"2024-09-20T21:05:55.115866+0000","last_fullsized":"2024-09-20T21:05:55.115866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117867+0000","last_change":"2024-09-20T21:05:54.121201+0000","last_active":"2024-09-20T21:05:55.117867+0000","last_peered":"2024-09-20T21:05:55.117867+0000","last_clean":"2024-09-20T21:05:55.117867+0000","last_became_active":"2024-09-20T21:05:54.119189+0000","last_became_peered":"2024-09-20T21:05:54.119189+0000","last_unstale":"2024-09-20T21:05:55.117867+0000","last_undegraded":"2024-09-20T21:05:55.117867+0000","last_fullsized":"2024-09-20T21:05:55.117867+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:15.290334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115927+0000","last_change":"2024-09-20T21:05:54.130286+0000","last_active":"2024-09-20T21:05:55.115927+0000","last_peered":"2024-09-20T21:05:55.115927+0000","last_clean":"2024-09-20T21:05:55.115927+0000","last_became_active":"2024-09-20T21:05:54.127969+0000","last_became_peered":"2024-09-20T21:05:54.127969+0000","last_unstale":"2024-09-20T21:05:55.115927+0000","last_undegraded":"2024-09-20T21:05:55.115927+0000","last_fullsized":"2024-09-20T21:05:55.115927+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:27.343016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392395+0000","last_change":"2024-09-20T21:05:33.529620+0000","last_active":"2024-09-20T21:05:55.392395+0000","last_peered":"2024-09-20T21:05:55.392395+0000","last_clean":"2024-09-20T21:05:55.392395+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:05:55.392395+0000","last_undegraded":"2024-09-20T21:05:55.392395+0000","last_fullsized":"2024-09-20T21:05:55.392395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:39.374497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391679+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:55.391679+0000","last_peered":"2024-09-20T21:05:55.391679+0000","last_clean":"2024-09-20T21:05:55.391679+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:55.391679+0000","last_undegraded":"2024-09-20T21:05:55.391679+0000","last_fullsized":"2024-09-20T21:05:55.391679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:30.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391647+0000","last_change":"2024-09-20T21:05:33.516924+0000","last_active":"2024-09-20T21:05:55.391647+0000","last_peered":"2024-09-20T21:05:55.391647+0000","last_clean":"2024-09-20T21:05:55.391647+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:05:55.391647+0000","last_undegraded":"2024-09-20T21:05:55.391647+0000","last_fullsized":"2024-09-20T21:05:55.391647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:55.590471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122171+0000","last_change":"2024-09-20T21:05:45.324359+0000","last_active":"2024-09-20T21:05:55.122171+0000","last_peered":"2024-09-20T21:05:55.122171+0000","last_clean":"2024-09-20T21:05:55.122171+0000","last_became_active":"2024-09-20T21:05:45.321407+0000","last_became_peered":"2024-09-20T21:05:45.321407+0000","last_unstale":"2024-09-20T21:05:55.122171+0000","last_undegraded":"2024-09-20T21:05:55.122171+0000","last_fullsized":"2024-09-20T21:05:55.122171+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123544+0000","last_change":"2024-09-20T21:05:34.264426+0000","last_active":"2024-09-20T21:05:55.123544+0000","last_peered":"2024-09-20T21:05:55.123544+0000","last_clean":"2024-09-20T21:05:55.123544+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:05:55.123544+0000","last_undegraded":"2024-09-20T21:05:55.123544+0000","last_fullsized":"2024-09-20T21:05:55.123544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:23.886272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392114+0000","last_change":"2024-09-20T21:05:33.517281+0000","last_active":"2024-09-20T21:05:55.392114+0000","last_peered":"2024-09-20T21:05:55.392114+0000","last_clean":"2024-09-20T21:05:55.392114+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:05:55.392114+0000","last_undegraded":"2024-09-20T21:05:55.392114+0000","last_fullsized":"2024-09-20T21:05:55.392114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:44.497231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492414+0000","last_change":"2024-09-20T21:05:55.492414+0000","last_active":"2024-09-20T21:05:55.492414+0000","last_peered":"2024-09-20T21:05:55.492414+0000","last_clean":"2024-09-20T21:05:55.492414+0000","last_became_active":"2024-09-20T21:05:55.491897+0000","last_became_peered":"2024-09-20T21:05:55.491897+0000","last_unstale":"2024-09-20T21:05:55.492414+0000","last_undegraded":"2024-09-20T21:05:55.492414+0000","last_fullsized":"2024-09-20T21:05:55.492414+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:23.615352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392280+0000","last_change":"2024-09-20T21:05:33.527473+0000","last_active":"2024-09-20T21:05:55.392280+0000","last_peered":"2024-09-20T21:05:55.392280+0000","last_clean":"2024-09-20T21:05:55.392280+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:05:55.392280+0000","last_undegraded":"2024-09-20T21:05:55.392280+0000","last_fullsized":"2024-09-20T21:05:55.392280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:43.880199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116681+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:55.116681+0000","last_peered":"2024-09-20T21:05:55.116681+0000","last_clean":"2024-09-20T21:05:55.116681+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:55.116681+0000","last_undegraded":"2024-09-20T21:05:55.116681+0000","last_fullsized":"2024-09-20T21:05:55.116681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:06:41.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393346+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:55.393346+0000","last_peered":"2024-09-20T21:05:55.393346+0000","last_clean":"2024-09-20T21:05:55.393346+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:55.393346+0000","last_undegraded":"2024-09-20T21:05:55.393346+0000","last_fullsized":"2024-09-20T21:05:55.393346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:57.275101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116157+0000","last_change":"2024-09-20T21:05:54.121694+0000","last_active":"2024-09-20T21:05:55.116157+0000","last_peered":"2024-09-20T21:05:55.116157+0000","last_clean":"2024-09-20T21:05:55.116157+0000","last_became_active":"2024-09-20T21:05:54.120855+0000","last_became_peered":"2024-09-20T21:05:54.120855+0000","last_unstale":"2024-09-20T21:05:55.116157+0000","last_undegraded":"2024-09-20T21:05:55.116157+0000","last_fullsized":"2024-09-20T21:05:55.116157+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:11.887662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123467+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:05:55.123467+0000","last_peered":"2024-09-20T21:05:55.123467+0000","last_clean":"2024-09-20T21:05:55.123467+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:05:55.123467+0000","last_undegraded":"2024-09-20T21:05:55.123467+0000","last_fullsized":"2024-09-20T21:05:55.123467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":273,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389638+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:55.389638+0000","last_peered":"2024-09-20T21:05:55.389638+0000","last_clean":"2024-09-20T21:05:55.389638+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:55.389638+0000","last_undegraded":"2024-09-20T21:05:55.389638+0000","last_fullsized":"2024-09-20T21:05:55.389638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:49.545054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390696+0000","last_change":"2024-09-20T21:05:33.516926+0000","last_active":"2024-09-20T21:05:55.390696+0000","last_peered":"2024-09-20T21:05:55.390696+0000","last_clean":"2024-09-20T21:05:55.390696+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:05:55.390696+0000","last_undegraded":"2024-09-20T21:05:55.390696+0000","last_fullsized":"2024-09-20T21:05:55.390696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:48.429167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123236+0000","last_change":"2024-09-20T21:05:37.268775+0000","last_active":"2024-09-20T21:05:55.123236+0000","last_peered":"2024-09-20T21:05:55.123236+0000","last_clean":"2024-09-20T21:05:55.123236+0000","last_became_active":"2024-09-20T21:05:37.267211+0000","last_became_peered":"2024-09-20T21:05:37.267211+0000","last_unstale":"2024-09-20T21:05:55.123236+0000","last_undegraded":"2024-09-20T21:05:55.123236+0000","last_fullsized":"2024-09-20T21:05:55.123236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:50.497847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392545+0000","last_change":"2024-09-20T21:05:33.527863+0000","last_active":"2024-09-20T21:05:55.392545+0000","last_peered":"2024-09-20T21:05:55.392545+0000","last_clean":"2024-09-20T21:05:55.392545+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:05:55.392545+0000","last_undegraded":"2024-09-20T21:05:55.392545+0000","last_fullsized":"2024-09-20T21:05:55.392545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:28.039071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390092+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:55.390092+0000","last_peered":"2024-09-20T21:05:55.390092+0000","last_clean":"2024-09-20T21:05:55.390092+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:55.390092+0000","last_undegraded":"2024-09-20T21:05:55.390092+0000","last_fullsized":"2024-09-20T21:05:55.390092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:58.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124493+0000","last_change":"2024-09-20T21:05:45.323068+0000","last_active":"2024-09-20T21:05:55.124493+0000","last_peered":"2024-09-20T21:05:55.124493+0000","last_clean":"2024-09-20T21:05:55.124493+0000","last_became_active":"2024-09-20T21:05:45.321160+0000","last_became_peered":"2024-09-20T21:05:45.321160+0000","last_unstale":"2024-09-20T21:05:55.124493+0000","last_undegraded":"2024-09-20T21:05:55.124493+0000","last_fullsized":"2024-09-20T21:05:55.124493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:32.144771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117798+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:55.117798+0000","last_peered":"2024-09-20T21:05:55.117798+0000","last_clean":"2024-09-20T21:05:55.117798+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:55.117798+0000","last_undegraded":"2024-09-20T21:05:55.117798+0000","last_fullsized":"2024-09-20T21:05:55.117798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124734+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:55.124734+0000","last_peered":"2024-09-20T21:05:55.124734+0000","last_clean":"2024-09-20T21:05:55.124734+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:55.124734+0000","last_undegraded":"2024-09-20T21:05:55.124734+0000","last_fullsized":"2024-09-20T21:05:55.124734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116320+0000","last_change":"2024-09-20T21:05:54.126982+0000","last_active":"2024-09-20T21:05:55.116320+0000","last_peered":"2024-09-20T21:05:55.116320+0000","last_clean":"2024-09-20T21:05:55.116320+0000","last_became_active":"2024-09-20T21:05:54.121776+0000","last_became_peered":"2024-09-20T21:05:54.121776+0000","last_unstale":"2024-09-20T21:05:55.116320+0000","last_undegraded":"2024-09-20T21:05:55.116320+0000","last_fullsized":"2024-09-20T21:05:55.116320+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:46.297334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":114,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123656+0000","last_change":"2024-09-20T21:05:52.101432+0000","last_active":"2024-09-20T21:05:55.123656+0000","last_peered":"2024-09-20T21:05:55.123656+0000","last_clean":"2024-09-20T21:05:55.123656+0000","last_became_active":"2024-09-20T21:05:52.100421+0000","last_became_peered":"2024-09-20T21:05:52.100421+0000","last_unstale":"2024-09-20T21:05:55.123656+0000","last_undegraded":"2024-09-20T21:05:55.123656+0000","last_fullsized":"2024-09-20T21:05:55.123656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390114+0000","last_change":"2024-09-20T21:05:33.525394+0000","last_active":"2024-09-20T21:05:55.390114+0000","last_peered":"2024-09-20T21:05:55.390114+0000","last_clean":"2024-09-20T21:05:55.390114+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:05:55.390114+0000","last_undegraded":"2024-09-20T21:05:55.390114+0000","last_fullsized":"2024-09-20T21:05:55.390114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:51:33.922257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390976+0000","last_change":"2024-09-20T21:05:33.522984+0000","last_active":"2024-09-20T21:05:55.390976+0000","last_peered":"2024-09-20T21:05:55.390976+0000","last_clean":"2024-09-20T21:05:55.390976+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:05:55.390976+0000","last_undegraded":"2024-09-20T21:05:55.390976+0000","last_fullsized":"2024-09-20T21:05:55.390976+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:22:14.870718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124538+0000","last_change":"2024-09-20T21:05:45.331015+0000","last_active":"2024-09-20T21:05:55.124538+0000","last_peered":"2024-09-20T21:05:55.124538+0000","last_clean":"2024-09-20T21:05:55.124538+0000","last_became_active":"2024-09-20T21:05:45.330361+0000","last_became_peered":"2024-09-20T21:05:45.330361+0000","last_unstale":"2024-09-20T21:05:55.124538+0000","last_undegraded":"2024-09-20T21:05:55.124538+0000","last_fullsized":"2024-09-20T21:05:55.124538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390741+0000","last_change":"2024-09-20T21:05:33.530100+0000","last_active":"2024-09-20T21:05:55.390741+0000","last_peered":"2024-09-20T21:05:55.390741+0000","last_clean":"2024-09-20T21:05:55.390741+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:05:55.390741+0000","last_undegraded":"2024-09-20T21:05:55.390741+0000","last_fullsized":"2024-09-20T21:05:55.390741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:12.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124786+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:55.124786+0000","last_peered":"2024-09-20T21:05:55.124786+0000","last_clean":"2024-09-20T21:05:55.124786+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:55.124786+0000","last_undegraded":"2024-09-20T21:05:55.124786+0000","last_fullsized":"2024-09-20T21:05:55.124786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116170+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:55.116170+0000","last_peered":"2024-09-20T21:05:55.116170+0000","last_clean":"2024-09-20T21:05:55.116170+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:55.116170+0000","last_undegraded":"2024-09-20T21:05:55.116170+0000","last_fullsized":"2024-09-20T21:05:55.116170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:03.961332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124581+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:55.124581+0000","last_peered":"2024-09-20T21:05:55.124581+0000","last_clean":"2024-09-20T21:05:55.124581+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:55.124581+0000","last_undegraded":"2024-09-20T21:05:55.124581+0000","last_fullsized":"2024-09-20T21:05:55.124581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.118157+0000","last_change":"2024-09-20T21:05:54.121905+0000","last_active":"2024-09-20T21:05:55.118157+0000","last_peered":"2024-09-20T21:05:55.118157+0000","last_clean":"2024-09-20T21:05:55.118157+0000","last_became_active":"2024-09-20T21:05:54.121064+0000","last_became_peered":"2024-09-20T21:05:54.121064+0000","last_unstale":"2024-09-20T21:05:55.118157+0000","last_undegraded":"2024-09-20T21:05:55.118157+0000","last_fullsized":"2024-09-20T21:05:55.118157+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:54:14.429868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116445+0000","last_change":"2024-09-20T21:05:54.132710+0000","last_active":"2024-09-20T21:05:55.116445+0000","last_peered":"2024-09-20T21:05:55.116445+0000","last_clean":"2024-09-20T21:05:55.116445+0000","last_became_active":"2024-09-20T21:05:54.127863+0000","last_became_peered":"2024-09-20T21:05:54.127863+0000","last_unstale":"2024-09-20T21:05:55.116445+0000","last_undegraded":"2024-09-20T21:05:55.116445+0000","last_fullsized":"2024-09-20T21:05:55.116445+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:59.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124756+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:55.124756+0000","last_peered":"2024-09-20T21:05:55.124756+0000","last_clean":"2024-09-20T21:05:55.124756+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:55.124756+0000","last_undegraded":"2024-09-20T21:05:55.124756+0000","last_fullsized":"2024-09-20T21:05:55.124756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124399+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:05:55.124399+0000","last_peered":"2024-09-20T21:05:55.124399+0000","last_clean":"2024-09-20T21:05:55.124399+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:05:55.124399+0000","last_undegraded":"2024-09-20T21:05:55.124399+0000","last_fullsized":"2024-09-20T21:05:55.124399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123360+0000","last_change":"2024-09-20T21:05:37.267287+0000","last_active":"2024-09-20T21:05:55.123360+0000","last_peered":"2024-09-20T21:05:55.123360+0000","last_clean":"2024-09-20T21:05:55.123360+0000","last_became_active":"2024-09-20T21:05:37.266438+0000","last_became_peered":"2024-09-20T21:05:37.266438+0000","last_unstale":"2024-09-20T21:05:55.123360+0000","last_undegraded":"2024-09-20T21:05:55.123360+0000","last_fullsized":"2024-09-20T21:05:55.123360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124163+0000","last_change":"2024-09-20T21:05:34.264862+0000","last_active":"2024-09-20T21:05:55.124163+0000","last_peered":"2024-09-20T21:05:55.124163+0000","last_clean":"2024-09-20T21:05:55.124163+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:05:55.124163+0000","last_undegraded":"2024-09-20T21:05:55.124163+0000","last_fullsized":"2024-09-20T21:05:55.124163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:32.512356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.395346+0000","last_change":"2024-09-20T21:05:55.395346+0000","last_active":"2024-09-20T21:05:55.395346+0000","last_peered":"2024-09-20T21:05:55.395346+0000","last_clean":"2024-09-20T21:05:55.395346+0000","last_became_active":"2024-09-20T21:05:55.394868+0000","last_became_peered":"2024-09-20T21:05:55.394868+0000","last_unstale":"2024-09-20T21:05:55.395346+0000","last_undegraded":"2024-09-20T21:05:55.395346+0000","last_fullsized":"2024-09-20T21:05:55.395346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:38.909352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116571+0000","last_change":"2024-09-20T21:05:54.121933+0000","last_active":"2024-09-20T21:05:55.116571+0000","last_peered":"2024-09-20T21:05:55.116571+0000","last_clean":"2024-09-20T21:05:55.116571+0000","last_became_active":"2024-09-20T21:05:54.119503+0000","last_became_peered":"2024-09-20T21:05:54.119503+0000","last_unstale":"2024-09-20T21:05:55.116571+0000","last_undegraded":"2024-09-20T21:05:55.116571+0000","last_fullsized":"2024-09-20T21:05:55.116571+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:02.194094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391433+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:55.391433+0000","last_peered":"2024-09-20T21:05:55.391433+0000","last_clean":"2024-09-20T21:05:55.391433+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:55.391433+0000","last_undegraded":"2024-09-20T21:05:55.391433+0000","last_fullsized":"2024-09-20T21:05:55.391433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:49.172273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390555+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:55.390555+0000","last_peered":"2024-09-20T21:05:55.390555+0000","last_clean":"2024-09-20T21:05:55.390555+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:55.390555+0000","last_undegraded":"2024-09-20T21:05:55.390555+0000","last_fullsized":"2024-09-20T21:05:55.390555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:07:07.242939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122199+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:05:55.122199+0000","last_peered":"2024-09-20T21:05:55.122199+0000","last_clean":"2024-09-20T21:05:55.122199+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:05:55.122199+0000","last_undegraded":"2024-09-20T21:05:55.122199+0000","last_fullsized":"2024-09-20T21:05:55.122199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117882+0000","last_change":"2024-09-20T21:05:54.130634+0000","last_active":"2024-09-20T21:05:55.117882+0000","last_peered":"2024-09-20T21:05:55.117882+0000","last_clean":"2024-09-20T21:05:55.117882+0000","last_became_active":"2024-09-20T21:05:54.128221+0000","last_became_peered":"2024-09-20T21:05:54.128221+0000","last_unstale":"2024-09-20T21:05:55.117882+0000","last_undegraded":"2024-09-20T21:05:55.117882+0000","last_fullsized":"2024-09-20T21:05:55.117882+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:37.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392938+0000","last_change":"2024-09-20T21:05:33.525151+0000","last_active":"2024-09-20T21:05:55.392938+0000","last_peered":"2024-09-20T21:05:55.392938+0000","last_clean":"2024-09-20T21:05:55.392938+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:05:55.392938+0000","last_undegraded":"2024-09-20T21:05:55.392938+0000","last_fullsized":"2024-09-20T21:05:55.392938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:51.245496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123714+0000","last_change":"2024-09-20T21:05:52.104238+0000","last_active":"2024-09-20T21:05:55.123714+0000","last_peered":"2024-09-20T21:05:55.123714+0000","last_clean":"2024-09-20T21:05:55.123714+0000","last_became_active":"2024-09-20T21:05:52.103630+0000","last_became_peered":"2024-09-20T21:05:52.103630+0000","last_unstale":"2024-09-20T21:05:55.123714+0000","last_undegraded":"2024-09-20T21:05:55.123714+0000","last_fullsized":"2024-09-20T21:05:55.123714+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124560+0000","last_change":"2024-09-20T21:05:34.264735+0000","last_active":"2024-09-20T21:05:55.124560+0000","last_peered":"2024-09-20T21:05:55.124560+0000","last_clean":"2024-09-20T21:05:55.124560+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:05:55.124560+0000","last_undegraded":"2024-09-20T21:05:55.124560+0000","last_fullsized":"2024-09-20T21:05:55.124560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:16.718841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.120856+0000","last_change":"2024-09-20T21:05:52.100914+0000","last_active":"2024-09-20T21:05:55.120856+0000","last_peered":"2024-09-20T21:05:55.120856+0000","last_clean":"2024-09-20T21:05:55.120856+0000","last_became_active":"2024-09-20T21:05:52.100104+0000","last_became_peered":"2024-09-20T21:05:52.100104+0000","last_unstale":"2024-09-20T21:05:55.120856+0000","last_undegraded":"2024-09-20T21:05:55.120856+0000","last_fullsized":"2024-09-20T21:05:55.120856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:51:38.241935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117935+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:55.117935+0000","last_peered":"2024-09-20T21:05:55.117935+0000","last_clean":"2024-09-20T21:05:55.117935+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:55.117935+0000","last_undegraded":"2024-09-20T21:05:55.117935+0000","last_fullsized":"2024-09-20T21:05:55.117935+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:39.486200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.121098+0000","last_change":"2024-09-20T21:05:37.269662+0000","last_active":"2024-09-20T21:05:55.121098+0000","last_peered":"2024-09-20T21:05:55.121098+0000","last_clean":"2024-09-20T21:05:55.121098+0000","last_became_active":"2024-09-20T21:05:37.268982+0000","last_became_peered":"2024-09-20T21:05:37.268982+0000","last_unstale":"2024-09-20T21:05:55.121098+0000","last_undegraded":"2024-09-20T21:05:55.121098+0000","last_fullsized":"2024-09-20T21:05:55.121098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:38.474304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122329+0000","last_change":"2024-09-20T21:05:45.321820+0000","last_active":"2024-09-20T21:05:55.122329+0000","last_peered":"2024-09-20T21:05:55.122329+0000","last_clean":"2024-09-20T21:05:55.122329+0000","last_became_active":"2024-09-20T21:05:45.320924+0000","last_became_peered":"2024-09-20T21:05:45.320924+0000","last_unstale":"2024-09-20T21:05:55.122329+0000","last_undegraded":"2024-09-20T21:05:55.122329+0000","last_fullsized":"2024-09-20T21:05:55.122329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:18:23.772854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123853+0000","last_change":"2024-09-20T21:05:45.321935+0000","last_active":"2024-09-20T21:05:55.123853+0000","last_peered":"2024-09-20T21:05:55.123853+0000","last_clean":"2024-09-20T21:05:55.123853+0000","last_became_active":"2024-09-20T21:05:45.321031+0000","last_became_peered":"2024-09-20T21:05:45.321031+0000","last_unstale":"2024-09-20T21:05:55.123853+0000","last_undegraded":"2024-09-20T21:05:55.123853+0000","last_fullsized":"2024-09-20T21:05:55.123853+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:01.849318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117259+0000","last_change":"2024-09-20T21:05:54.127603+0000","last_active":"2024-09-20T21:05:55.117259+0000","last_peered":"2024-09-20T21:05:55.117259+0000","last_clean":"2024-09-20T21:05:55.117259+0000","last_became_active":"2024-09-20T21:05:54.125123+0000","last_became_peered":"2024-09-20T21:05:54.125123+0000","last_unstale":"2024-09-20T21:05:55.117259+0000","last_undegraded":"2024-09-20T21:05:55.117259+0000","last_fullsized":"2024-09-20T21:05:55.117259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:43:09.663833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116468+0000","last_change":"2024-09-20T21:05:54.122334+0000","last_active":"2024-09-20T21:05:55.116468+0000","last_peered":"2024-09-20T21:05:55.116468+0000","last_clean":"2024-09-20T21:05:55.116468+0000","last_became_active":"2024-09-20T21:05:54.121466+0000","last_became_peered":"2024-09-20T21:05:54.121466+0000","last_unstale":"2024-09-20T21:05:55.116468+0000","last_undegraded":"2024-09-20T21:05:55.116468+0000","last_fullsized":"2024-09-20T21:05:55.116468+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:41.667343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":122,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117020+0000","last_change":"2024-09-20T21:05:54.132657+0000","last_active":"2024-09-20T21:05:55.117020+0000","last_peered":"2024-09-20T21:05:55.117020+0000","last_clean":"2024-09-20T21:05:55.117020+0000","last_became_active":"2024-09-20T21:05:54.129891+0000","last_became_peered":"2024-09-20T21:05:54.129891+0000","last_unstale":"2024-09-20T21:05:55.117020+0000","last_undegraded":"2024-09-20T21:05:55.117020+0000","last_fullsized":"2024-09-20T21:05:55.117020+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:26.911986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116983+0000","last_change":"2024-09-20T21:05:54.127321+0000","last_active":"2024-09-20T21:05:55.116983+0000","last_peered":"2024-09-20T21:05:55.116983+0000","last_clean":"2024-09-20T21:05:55.116983+0000","last_became_active":"2024-09-20T21:05:54.120527+0000","last_became_peered":"2024-09-20T21:05:54.120527+0000","last_unstale":"2024-09-20T21:05:55.116983+0000","last_undegraded":"2024-09-20T21:05:55.116983+0000","last_fullsized":"2024-09-20T21:05:55.116983+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:25.400362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391620+0000","last_change":"2024-09-20T21:05:33.523783+0000","last_active":"2024-09-20T21:05:55.391620+0000","last_peered":"2024-09-20T21:05:55.391620+0000","last_clean":"2024-09-20T21:05:55.391620+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:05:55.391620+0000","last_undegraded":"2024-09-20T21:05:55.391620+0000","last_fullsized":"2024-09-20T21:05:55.391620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:29.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391369+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:55.391369+0000","last_peered":"2024-09-20T21:05:55.391369+0000","last_clean":"2024-09-20T21:05:55.391369+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:55.391369+0000","last_undegraded":"2024-09-20T21:05:55.391369+0000","last_fullsized":"2024-09-20T21:05:55.391369+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:45:47.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390604+0000","last_change":"2024-09-20T21:05:33.525036+0000","last_active":"2024-09-20T21:05:55.390604+0000","last_peered":"2024-09-20T21:05:55.390604+0000","last_clean":"2024-09-20T21:05:55.390604+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:05:55.390604+0000","last_undegraded":"2024-09-20T21:05:55.390604+0000","last_fullsized":"2024-09-20T21:05:55.390604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:13.120671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117548+0000","last_change":"2024-09-20T21:05:54.126814+0000","last_active":"2024-09-20T21:05:55.117548+0000","last_peered":"2024-09-20T21:05:55.117548+0000","last_clean":"2024-09-20T21:05:55.117548+0000","last_became_active":"2024-09-20T21:05:54.124075+0000","last_became_peered":"2024-09-20T21:05:54.124075+0000","last_unstale":"2024-09-20T21:05:55.117548+0000","last_undegraded":"2024-09-20T21:05:55.117548+0000","last_fullsized":"2024-09-20T21:05:55.117548+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:18.839315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116829+0000","last_change":"2024-09-20T21:05:54.122485+0000","last_active":"2024-09-20T21:05:55.116829+0000","last_peered":"2024-09-20T21:05:55.116829+0000","last_clean":"2024-09-20T21:05:55.116829+0000","last_became_active":"2024-09-20T21:05:54.121408+0000","last_became_peered":"2024-09-20T21:05:54.121408+0000","last_unstale":"2024-09-20T21:05:55.116829+0000","last_undegraded":"2024-09-20T21:05:55.116829+0000","last_fullsized":"2024-09-20T21:05:55.116829+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:36.479778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123681+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:55.123681+0000","last_peered":"2024-09-20T21:05:55.123681+0000","last_clean":"2024-09-20T21:05:55.123681+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:55.123681+0000","last_undegraded":"2024-09-20T21:05:55.123681+0000","last_fullsized":"2024-09-20T21:05:55.123681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390271+0000","last_change":"2024-09-20T21:05:33.529399+0000","last_active":"2024-09-20T21:05:55.390271+0000","last_peered":"2024-09-20T21:05:55.390271+0000","last_clean":"2024-09-20T21:05:55.390271+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:05:55.390271+0000","last_undegraded":"2024-09-20T21:05:55.390271+0000","last_fullsized":"2024-09-20T21:05:55.390271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:36.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122854+0000","last_change":"2024-09-20T21:05:45.323879+0000","last_active":"2024-09-20T21:05:55.122854+0000","last_peered":"2024-09-20T21:05:55.122854+0000","last_clean":"2024-09-20T21:05:55.122854+0000","last_became_active":"2024-09-20T21:05:45.321268+0000","last_became_peered":"2024-09-20T21:05:45.321268+0000","last_unstale":"2024-09-20T21:05:55.122854+0000","last_undegraded":"2024-09-20T21:05:55.122854+0000","last_fullsized":"2024-09-20T21:05:55.122854+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:53.346461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216928,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94154912,"statfs":{"total":96636764160,"available":96414629888,"internally_reserved":0,"allocated":1118208,"data_stored":1000114,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350983,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54640,"kb_used_data":1112,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317200,"statfs":{"total":96636764160,"available":96580812800,"internally_reserved":0,"allocated":1138688,"data_stored":1004981,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325140,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046700,"statfs":{"total":96636764160,"available":96303820800,"internally_reserved":0,"allocated":1044480,"data_stored":408587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:05:59.039 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:05:59.383 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:05:59.399 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-09-20T21:05:58.992737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596708,"kb_used_data":3224,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282518812,"statfs":{"total":289910292480,"available":289299263488,"internally_reserved":0,"allocated":3301376,"data_stored":2413682,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.899120"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117741+0000","last_change":"2024-09-20T21:05:54.129746+0000","last_active":"2024-09-20T21:05:55.117741+0000","last_peered":"2024-09-20T21:05:55.117741+0000","last_clean":"2024-09-20T21:05:55.117741+0000","last_became_active":"2024-09-20T21:05:54.127664+0000","last_became_peered":"2024-09-20T21:05:54.127664+0000","last_unstale":"2024-09-20T21:05:55.117741+0000","last_undegraded":"2024-09-20T21:05:55.117741+0000","last_fullsized":"2024-09-20T21:05:55.117741+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:57.952046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117563+0000","last_change":"2024-09-20T21:05:54.126721+0000","last_active":"2024-09-20T21:05:55.117563+0000","last_peered":"2024-09-20T21:05:55.117563+0000","last_clean":"2024-09-20T21:05:55.117563+0000","last_became_active":"2024-09-20T21:05:54.124269+0000","last_became_peered":"2024-09-20T21:05:54.124269+0000","last_unstale":"2024-09-20T21:05:55.117563+0000","last_undegraded":"2024-09-20T21:05:55.117563+0000","last_fullsized":"2024-09-20T21:05:55.117563+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393027+0000","last_change":"2024-09-20T21:05:33.529595+0000","last_active":"2024-09-20T21:05:55.393027+0000","last_peered":"2024-09-20T21:05:55.393027+0000","last_clean":"2024-09-20T21:05:55.393027+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:05:55.393027+0000","last_undegraded":"2024-09-20T21:05:55.393027+0000","last_fullsized":"2024-09-20T21:05:55.393027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:08.234369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391440+0000","last_change":"2024-09-20T21:05:33.516896+0000","last_active":"2024-09-20T21:05:55.391440+0000","last_peered":"2024-09-20T21:05:55.391440+0000","last_clean":"2024-09-20T21:05:55.391440+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:05:55.391440+0000","last_undegraded":"2024-09-20T21:05:55.391440+0000","last_fullsized":"2024-09-20T21:05:55.391440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:48.472114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116748+0000","last_change":"2024-09-20T21:05:54.130938+0000","last_active":"2024-09-20T21:05:55.116748+0000","last_peered":"2024-09-20T21:05:55.116748+0000","last_clean":"2024-09-20T21:05:55.116748+0000","last_became_active":"2024-09-20T21:05:54.125511+0000","last_became_peered":"2024-09-20T21:05:54.125511+0000","last_unstale":"2024-09-20T21:05:55.116748+0000","last_undegraded":"2024-09-20T21:05:55.116748+0000","last_fullsized":"2024-09-20T21:05:55.116748+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:55.659526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391460+0000","last_change":"2024-09-20T21:05:33.526021+0000","last_active":"2024-09-20T21:05:55.391460+0000","last_peered":"2024-09-20T21:05:55.391460+0000","last_clean":"2024-09-20T21:05:55.391460+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:05:55.391460+0000","last_undegraded":"2024-09-20T21:05:55.391460+0000","last_fullsized":"2024-09-20T21:05:55.391460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:51.022212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492841+0000","last_change":"2024-09-20T21:05:55.492841+0000","last_active":"2024-09-20T21:05:55.492841+0000","last_peered":"2024-09-20T21:05:55.492841+0000","last_clean":"2024-09-20T21:05:55.492841+0000","last_became_active":"2024-09-20T21:05:55.492104+0000","last_became_peered":"2024-09-20T21:05:55.492104+0000","last_unstale":"2024-09-20T21:05:55.492841+0000","last_undegraded":"2024-09-20T21:05:55.492841+0000","last_fullsized":"2024-09-20T21:05:55.492841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.580757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390006+0000","last_change":"2024-09-20T21:05:33.527599+0000","last_active":"2024-09-20T21:05:55.390006+0000","last_peered":"2024-09-20T21:05:55.390006+0000","last_clean":"2024-09-20T21:05:55.390006+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:05:55.390006+0000","last_undegraded":"2024-09-20T21:05:55.390006+0000","last_fullsized":"2024-09-20T21:05:55.390006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:19:18.002155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122816+0000","last_change":"2024-09-20T21:05:45.329452+0000","last_active":"2024-09-20T21:05:55.122816+0000","last_peered":"2024-09-20T21:05:55.122816+0000","last_clean":"2024-09-20T21:05:55.122816+0000","last_became_active":"2024-09-20T21:05:45.327207+0000","last_became_peered":"2024-09-20T21:05:45.327207+0000","last_unstale":"2024-09-20T21:05:55.122816+0000","last_undegraded":"2024-09-20T21:05:55.122816+0000","last_fullsized":"2024-09-20T21:05:55.122816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:42.075068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117093+0000","last_change":"2024-09-20T21:05:54.126680+0000","last_active":"2024-09-20T21:05:55.117093+0000","last_peered":"2024-09-20T21:05:55.117093+0000","last_clean":"2024-09-20T21:05:55.117093+0000","last_became_active":"2024-09-20T21:05:54.124291+0000","last_became_peered":"2024-09-20T21:05:54.124291+0000","last_unstale":"2024-09-20T21:05:55.117093+0000","last_undegraded":"2024-09-20T21:05:55.117093+0000","last_fullsized":"2024-09-20T21:05:55.117093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:05.334214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392938+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:55.392938+0000","last_peered":"2024-09-20T21:05:55.392938+0000","last_clean":"2024-09-20T21:05:55.392938+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:55.392938+0000","last_undegraded":"2024-09-20T21:05:55.392938+0000","last_fullsized":"2024-09-20T21:05:55.392938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:14:10.131416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116730+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:05:55.116730+0000","last_peered":"2024-09-20T21:05:55.116730+0000","last_clean":"2024-09-20T21:05:55.116730+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:05:55.116730+0000","last_undegraded":"2024-09-20T21:05:55.116730+0000","last_fullsized":"2024-09-20T21:05:55.116730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:51.509743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116172+0000","last_change":"2024-09-20T21:05:54.132356+0000","last_active":"2024-09-20T21:05:55.116172+0000","last_peered":"2024-09-20T21:05:55.116172+0000","last_clean":"2024-09-20T21:05:55.116172+0000","last_became_active":"2024-09-20T21:05:54.128147+0000","last_became_peered":"2024-09-20T21:05:54.128147+0000","last_unstale":"2024-09-20T21:05:55.116172+0000","last_undegraded":"2024-09-20T21:05:55.116172+0000","last_fullsized":"2024-09-20T21:05:55.116172+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:07.742615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391210+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:55.391210+0000","last_peered":"2024-09-20T21:05:55.391210+0000","last_clean":"2024-09-20T21:05:55.391210+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:55.391210+0000","last_undegraded":"2024-09-20T21:05:55.391210+0000","last_fullsized":"2024-09-20T21:05:55.391210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:17.867418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390735+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:55.390735+0000","last_peered":"2024-09-20T21:05:55.390735+0000","last_clean":"2024-09-20T21:05:55.390735+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:55.390735+0000","last_undegraded":"2024-09-20T21:05:55.390735+0000","last_fullsized":"2024-09-20T21:05:55.390735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:36.753632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.490656+0000","last_change":"2024-09-20T21:05:55.490656+0000","last_active":"2024-09-20T21:05:55.490656+0000","last_peered":"2024-09-20T21:05:55.490656+0000","last_clean":"2024-09-20T21:05:55.490656+0000","last_became_active":"2024-09-20T21:05:55.489879+0000","last_became_peered":"2024-09-20T21:05:55.489879+0000","last_unstale":"2024-09-20T21:05:55.490656+0000","last_undegraded":"2024-09-20T21:05:55.490656+0000","last_fullsized":"2024-09-20T21:05:55.490656+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:01.290416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124476+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:55.124476+0000","last_peered":"2024-09-20T21:05:55.124476+0000","last_clean":"2024-09-20T21:05:55.124476+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:55.124476+0000","last_undegraded":"2024-09-20T21:05:55.124476+0000","last_fullsized":"2024-09-20T21:05:55.124476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117505+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:55.117505+0000","last_peered":"2024-09-20T21:05:55.117505+0000","last_clean":"2024-09-20T21:05:55.117505+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:55.117505+0000","last_undegraded":"2024-09-20T21:05:55.117505+0000","last_fullsized":"2024-09-20T21:05:55.117505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122128+0000","last_change":"2024-09-20T21:05:45.327807+0000","last_active":"2024-09-20T21:05:55.122128+0000","last_peered":"2024-09-20T21:05:55.122128+0000","last_clean":"2024-09-20T21:05:55.122128+0000","last_became_active":"2024-09-20T21:05:45.326913+0000","last_became_peered":"2024-09-20T21:05:45.326913+0000","last_unstale":"2024-09-20T21:05:55.122128+0000","last_undegraded":"2024-09-20T21:05:55.122128+0000","last_fullsized":"2024-09-20T21:05:55.122128+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492609+0000","last_change":"2024-09-20T21:05:55.492609+0000","last_active":"2024-09-20T21:05:55.492609+0000","last_peered":"2024-09-20T21:05:55.492609+0000","last_clean":"2024-09-20T21:05:55.492609+0000","last_became_active":"2024-09-20T21:05:55.491995+0000","last_became_peered":"2024-09-20T21:05:55.491995+0000","last_unstale":"2024-09-20T21:05:55.492609+0000","last_undegraded":"2024-09-20T21:05:55.492609+0000","last_fullsized":"2024-09-20T21:05:55.492609+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:00.972806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392131+0000","last_change":"2024-09-20T21:05:33.524928+0000","last_active":"2024-09-20T21:05:55.392131+0000","last_peered":"2024-09-20T21:05:55.392131+0000","last_clean":"2024-09-20T21:05:55.392131+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:05:55.392131+0000","last_undegraded":"2024-09-20T21:05:55.392131+0000","last_fullsized":"2024-09-20T21:05:55.392131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:42.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116038+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:55.116038+0000","last_peered":"2024-09-20T21:05:55.116038+0000","last_clean":"2024-09-20T21:05:55.116038+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:55.116038+0000","last_undegraded":"2024-09-20T21:05:55.116038+0000","last_fullsized":"2024-09-20T21:05:55.116038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123406+0000","last_change":"2024-09-20T21:05:52.103930+0000","last_active":"2024-09-20T21:05:55.123406+0000","last_peered":"2024-09-20T21:05:55.123406+0000","last_clean":"2024-09-20T21:05:55.123406+0000","last_became_active":"2024-09-20T21:05:52.103477+0000","last_became_peered":"2024-09-20T21:05:52.103477+0000","last_unstale":"2024-09-20T21:05:55.123406+0000","last_undegraded":"2024-09-20T21:05:55.123406+0000","last_fullsized":"2024-09-20T21:05:55.123406+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115860+0000","last_change":"2024-09-20T21:05:54.133334+0000","last_active":"2024-09-20T21:05:55.115860+0000","last_peered":"2024-09-20T21:05:55.115860+0000","last_clean":"2024-09-20T21:05:55.115860+0000","last_became_active":"2024-09-20T21:05:54.129639+0000","last_became_peered":"2024-09-20T21:05:54.129639+0000","last_unstale":"2024-09-20T21:05:55.115860+0000","last_undegraded":"2024-09-20T21:05:55.115860+0000","last_fullsized":"2024-09-20T21:05:55.115860+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117793+0000","last_change":"2024-09-20T21:05:54.126793+0000","last_active":"2024-09-20T21:05:55.117793+0000","last_peered":"2024-09-20T21:05:55.117793+0000","last_clean":"2024-09-20T21:05:55.117793+0000","last_became_active":"2024-09-20T21:05:54.124757+0000","last_became_peered":"2024-09-20T21:05:54.124757+0000","last_unstale":"2024-09-20T21:05:55.117793+0000","last_undegraded":"2024-09-20T21:05:55.117793+0000","last_fullsized":"2024-09-20T21:05:55.117793+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:46:28.346590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123336+0000","last_change":"2024-09-20T21:05:45.324835+0000","last_active":"2024-09-20T21:05:55.123336+0000","last_peered":"2024-09-20T21:05:55.123336+0000","last_clean":"2024-09-20T21:05:55.123336+0000","last_became_active":"2024-09-20T21:05:45.321767+0000","last_became_peered":"2024-09-20T21:05:45.321767+0000","last_unstale":"2024-09-20T21:05:55.123336+0000","last_undegraded":"2024-09-20T21:05:55.123336+0000","last_fullsized":"2024-09-20T21:05:55.123336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:16.302231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392754+0000","last_change":"2024-09-20T21:05:33.528984+0000","last_active":"2024-09-20T21:05:55.392754+0000","last_peered":"2024-09-20T21:05:55.392754+0000","last_clean":"2024-09-20T21:05:55.392754+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:05:55.392754+0000","last_undegraded":"2024-09-20T21:05:55.392754+0000","last_fullsized":"2024-09-20T21:05:55.392754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:53.623013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117367+0000","last_change":"2024-09-20T21:05:54.121935+0000","last_active":"2024-09-20T21:05:55.117367+0000","last_peered":"2024-09-20T21:05:55.117367+0000","last_clean":"2024-09-20T21:05:55.117367+0000","last_became_active":"2024-09-20T21:05:54.120990+0000","last_became_peered":"2024-09-20T21:05:54.120990+0000","last_unstale":"2024-09-20T21:05:55.117367+0000","last_undegraded":"2024-09-20T21:05:55.117367+0000","last_fullsized":"2024-09-20T21:05:55.117367+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122633+0000","last_change":"2024-09-20T21:05:37.268677+0000","last_active":"2024-09-20T21:05:55.122633+0000","last_peered":"2024-09-20T21:05:55.122633+0000","last_clean":"2024-09-20T21:05:55.122633+0000","last_became_active":"2024-09-20T21:05:37.267096+0000","last_became_peered":"2024-09-20T21:05:37.267096+0000","last_unstale":"2024-09-20T21:05:55.122633+0000","last_undegraded":"2024-09-20T21:05:55.122633+0000","last_fullsized":"2024-09-20T21:05:55.122633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116342+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:55.116342+0000","last_peered":"2024-09-20T21:05:55.116342+0000","last_clean":"2024-09-20T21:05:55.116342+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:55.116342+0000","last_undegraded":"2024-09-20T21:05:55.116342+0000","last_fullsized":"2024-09-20T21:05:55.116342+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123564+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:55.123564+0000","last_peered":"2024-09-20T21:05:55.123564+0000","last_clean":"2024-09-20T21:05:55.123564+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:55.123564+0000","last_undegraded":"2024-09-20T21:05:55.123564+0000","last_fullsized":"2024-09-20T21:05:55.123564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389829+0000","last_change":"2024-09-20T21:05:33.520634+0000","last_active":"2024-09-20T21:05:55.389829+0000","last_peered":"2024-09-20T21:05:55.389829+0000","last_clean":"2024-09-20T21:05:55.389829+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:05:55.389829+0000","last_undegraded":"2024-09-20T21:05:55.389829+0000","last_fullsized":"2024-09-20T21:05:55.389829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.341860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117126+0000","last_change":"2024-09-20T21:05:54.132673+0000","last_active":"2024-09-20T21:05:55.117126+0000","last_peered":"2024-09-20T21:05:55.117126+0000","last_clean":"2024-09-20T21:05:55.117126+0000","last_became_active":"2024-09-20T21:05:54.128119+0000","last_became_peered":"2024-09-20T21:05:54.128119+0000","last_unstale":"2024-09-20T21:05:55.117126+0000","last_undegraded":"2024-09-20T21:05:55.117126+0000","last_fullsized":"2024-09-20T21:05:55.117126+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391078+0000","last_change":"2024-09-20T21:05:33.523453+0000","last_active":"2024-09-20T21:05:55.391078+0000","last_peered":"2024-09-20T21:05:55.391078+0000","last_clean":"2024-09-20T21:05:55.391078+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:05:55.391078+0000","last_undegraded":"2024-09-20T21:05:55.391078+0000","last_fullsized":"2024-09-20T21:05:55.391078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:59.275158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117521+0000","last_change":"2024-09-20T21:05:54.133190+0000","last_active":"2024-09-20T21:05:55.117521+0000","last_peered":"2024-09-20T21:05:55.117521+0000","last_clean":"2024-09-20T21:05:55.117521+0000","last_became_active":"2024-09-20T21:05:54.130889+0000","last_became_peered":"2024-09-20T21:05:54.130889+0000","last_unstale":"2024-09-20T21:05:55.117521+0000","last_undegraded":"2024-09-20T21:05:55.117521+0000","last_fullsized":"2024-09-20T21:05:55.117521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122870+0000","last_change":"2024-09-20T21:05:34.265360+0000","last_active":"2024-09-20T21:05:55.122870+0000","last_peered":"2024-09-20T21:05:55.122870+0000","last_clean":"2024-09-20T21:05:55.122870+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:05:55.122870+0000","last_undegraded":"2024-09-20T21:05:55.122870+0000","last_fullsized":"2024-09-20T21:05:55.122870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:02.949435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123803+0000","last_change":"2024-09-20T21:05:34.264103+0000","last_active":"2024-09-20T21:05:55.123803+0000","last_peered":"2024-09-20T21:05:55.123803+0000","last_clean":"2024-09-20T21:05:55.123803+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:05:55.123803+0000","last_undegraded":"2024-09-20T21:05:55.123803+0000","last_fullsized":"2024-09-20T21:05:55.123803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.354082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116206+0000","last_change":"2024-09-20T21:05:54.126994+0000","last_active":"2024-09-20T21:05:55.116206+0000","last_peered":"2024-09-20T21:05:55.116206+0000","last_clean":"2024-09-20T21:05:55.116206+0000","last_became_active":"2024-09-20T21:05:54.124655+0000","last_became_peered":"2024-09-20T21:05:54.124655+0000","last_unstale":"2024-09-20T21:05:55.116206+0000","last_undegraded":"2024-09-20T21:05:55.116206+0000","last_fullsized":"2024-09-20T21:05:55.116206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:41.063171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123077+0000","last_change":"2024-09-20T21:05:45.324641+0000","last_active":"2024-09-20T21:05:55.123077+0000","last_peered":"2024-09-20T21:05:55.123077+0000","last_clean":"2024-09-20T21:05:55.123077+0000","last_became_active":"2024-09-20T21:05:45.323784+0000","last_became_peered":"2024-09-20T21:05:45.323784+0000","last_unstale":"2024-09-20T21:05:55.123077+0000","last_undegraded":"2024-09-20T21:05:55.123077+0000","last_fullsized":"2024-09-20T21:05:55.123077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:42.679240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389770+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:55.389770+0000","last_peered":"2024-09-20T21:05:55.389770+0000","last_clean":"2024-09-20T21:05:55.389770+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:55.389770+0000","last_undegraded":"2024-09-20T21:05:55.389770+0000","last_fullsized":"2024-09-20T21:05:55.389770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:41.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393613+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:55.393613+0000","last_peered":"2024-09-20T21:05:55.393613+0000","last_clean":"2024-09-20T21:05:55.393613+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:55.393613+0000","last_undegraded":"2024-09-20T21:05:55.393613+0000","last_fullsized":"2024-09-20T21:05:55.393613+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:04.604590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115866+0000","last_change":"2024-09-20T21:05:54.126691+0000","last_active":"2024-09-20T21:05:55.115866+0000","last_peered":"2024-09-20T21:05:55.115866+0000","last_clean":"2024-09-20T21:05:55.115866+0000","last_became_active":"2024-09-20T21:05:54.124815+0000","last_became_peered":"2024-09-20T21:05:54.124815+0000","last_unstale":"2024-09-20T21:05:55.115866+0000","last_undegraded":"2024-09-20T21:05:55.115866+0000","last_fullsized":"2024-09-20T21:05:55.115866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117867+0000","last_change":"2024-09-20T21:05:54.121201+0000","last_active":"2024-09-20T21:05:55.117867+0000","last_peered":"2024-09-20T21:05:55.117867+0000","last_clean":"2024-09-20T21:05:55.117867+0000","last_became_active":"2024-09-20T21:05:54.119189+0000","last_became_peered":"2024-09-20T21:05:54.119189+0000","last_unstale":"2024-09-20T21:05:55.117867+0000","last_undegraded":"2024-09-20T21:05:55.117867+0000","last_fullsized":"2024-09-20T21:05:55.117867+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:15.290334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115927+0000","last_change":"2024-09-20T21:05:54.130286+0000","last_active":"2024-09-20T21:05:55.115927+0000","last_peered":"2024-09-20T21:05:55.115927+0000","last_clean":"2024-09-20T21:05:55.115927+0000","last_became_active":"2024-09-20T21:05:54.127969+0000","last_became_peered":"2024-09-20T21:05:54.127969+0000","last_unstale":"2024-09-20T21:05:55.115927+0000","last_undegraded":"2024-09-20T21:05:55.115927+0000","last_fullsized":"2024-09-20T21:05:55.115927+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:27.343016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392395+0000","last_change":"2024-09-20T21:05:33.529620+0000","last_active":"2024-09-20T21:05:55.392395+0000","last_peered":"2024-09-20T21:05:55.392395+0000","last_clean":"2024-09-20T21:05:55.392395+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:05:55.392395+0000","last_undegraded":"2024-09-20T21:05:55.392395+0000","last_fullsized":"2024-09-20T21:05:55.392395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:39.374497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391679+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:55.391679+0000","last_peered":"2024-09-20T21:05:55.391679+0000","last_clean":"2024-09-20T21:05:55.391679+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:55.391679+0000","last_undegraded":"2024-09-20T21:05:55.391679+0000","last_fullsized":"2024-09-20T21:05:55.391679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:30.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391647+0000","last_change":"2024-09-20T21:05:33.516924+0000","last_active":"2024-09-20T21:05:55.391647+0000","last_peered":"2024-09-20T21:05:55.391647+0000","last_clean":"2024-09-20T21:05:55.391647+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:05:55.391647+0000","last_undegraded":"2024-09-20T21:05:55.391647+0000","last_fullsized":"2024-09-20T21:05:55.391647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:55.590471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122171+0000","last_change":"2024-09-20T21:05:45.324359+0000","last_active":"2024-09-20T21:05:55.122171+0000","last_peered":"2024-09-20T21:05:55.122171+0000","last_clean":"2024-09-20T21:05:55.122171+0000","last_became_active":"2024-09-20T21:05:45.321407+0000","last_became_peered":"2024-09-20T21:05:45.321407+0000","last_unstale":"2024-09-20T21:05:55.122171+0000","last_undegraded":"2024-09-20T21:05:55.122171+0000","last_fullsized":"2024-09-20T21:05:55.122171+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123544+0000","last_change":"2024-09-20T21:05:34.264426+0000","last_active":"2024-09-20T21:05:55.123544+0000","last_peered":"2024-09-20T21:05:55.123544+0000","last_clean":"2024-09-20T21:05:55.123544+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:05:55.123544+0000","last_undegraded":"2024-09-20T21:05:55.123544+0000","last_fullsized":"2024-09-20T21:05:55.123544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:23.886272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392114+0000","last_change":"2024-09-20T21:05:33.517281+0000","last_active":"2024-09-20T21:05:55.392114+0000","last_peered":"2024-09-20T21:05:55.392114+0000","last_clean":"2024-09-20T21:05:55.392114+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:05:55.392114+0000","last_undegraded":"2024-09-20T21:05:55.392114+0000","last_fullsized":"2024-09-20T21:05:55.392114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:44.497231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492414+0000","last_change":"2024-09-20T21:05:55.492414+0000","last_active":"2024-09-20T21:05:55.492414+0000","last_peered":"2024-09-20T21:05:55.492414+0000","last_clean":"2024-09-20T21:05:55.492414+0000","last_became_active":"2024-09-20T21:05:55.491897+0000","last_became_peered":"2024-09-20T21:05:55.491897+0000","last_unstale":"2024-09-20T21:05:55.492414+0000","last_undegraded":"2024-09-20T21:05:55.492414+0000","last_fullsized":"2024-09-20T21:05:55.492414+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:23.615352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392280+0000","last_change":"2024-09-20T21:05:33.527473+0000","last_active":"2024-09-20T21:05:55.392280+0000","last_peered":"2024-09-20T21:05:55.392280+0000","last_clean":"2024-09-20T21:05:55.392280+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:05:55.392280+0000","last_undegraded":"2024-09-20T21:05:55.392280+0000","last_fullsized":"2024-09-20T21:05:55.392280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:43.880199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116681+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:55.116681+0000","last_peered":"2024-09-20T21:05:55.116681+0000","last_clean":"2024-09-20T21:05:55.116681+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:55.116681+0000","last_undegraded":"2024-09-20T21:05:55.116681+0000","last_fullsized":"2024-09-20T21:05:55.116681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:06:41.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393346+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:55.393346+0000","last_peered":"2024-09-20T21:05:55.393346+0000","last_clean":"2024-09-20T21:05:55.393346+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:55.393346+0000","last_undegraded":"2024-09-20T21:05:55.393346+0000","last_fullsized":"2024-09-20T21:05:55.393346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:57.275101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116157+0000","last_change":"2024-09-20T21:05:54.121694+0000","last_active":"2024-09-20T21:05:55.116157+0000","last_peered":"2024-09-20T21:05:55.116157+0000","last_clean":"2024-09-20T21:05:55.116157+0000","last_became_active":"2024-09-20T21:05:54.120855+0000","last_became_peered":"2024-09-20T21:05:54.120855+0000","last_unstale":"2024-09-20T21:05:55.116157+0000","last_undegraded":"2024-09-20T21:05:55.116157+0000","last_fullsized":"2024-09-20T21:05:55.116157+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:11.887662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123467+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:05:55.123467+0000","last_peered":"2024-09-20T21:05:55.123467+0000","last_clean":"2024-09-20T21:05:55.123467+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:05:55.123467+0000","last_undegraded":"2024-09-20T21:05:55.123467+0000","last_fullsized":"2024-09-20T21:05:55.123467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":273,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389638+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:55.389638+0000","last_peered":"2024-09-20T21:05:55.389638+0000","last_clean":"2024-09-20T21:05:55.389638+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:55.389638+0000","last_undegraded":"2024-09-20T21:05:55.389638+0000","last_fullsized":"2024-09-20T21:05:55.389638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:49.545054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390696+0000","last_change":"2024-09-20T21:05:33.516926+0000","last_active":"2024-09-20T21:05:55.390696+0000","last_peered":"2024-09-20T21:05:55.390696+0000","last_clean":"2024-09-20T21:05:55.390696+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:05:55.390696+0000","last_undegraded":"2024-09-20T21:05:55.390696+0000","last_fullsized":"2024-09-20T21:05:55.390696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:48.429167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123236+0000","last_change":"2024-09-20T21:05:37.268775+0000","last_active":"2024-09-20T21:05:55.123236+0000","last_peered":"2024-09-20T21:05:55.123236+0000","last_clean":"2024-09-20T21:05:55.123236+0000","last_became_active":"2024-09-20T21:05:37.267211+0000","last_became_peered":"2024-09-20T21:05:37.267211+0000","last_unstale":"2024-09-20T21:05:55.123236+0000","last_undegraded":"2024-09-20T21:05:55.123236+0000","last_fullsized":"2024-09-20T21:05:55.123236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:50.497847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392545+0000","last_change":"2024-09-20T21:05:33.527863+0000","last_active":"2024-09-20T21:05:55.392545+0000","last_peered":"2024-09-20T21:05:55.392545+0000","last_clean":"2024-09-20T21:05:55.392545+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:05:55.392545+0000","last_undegraded":"2024-09-20T21:05:55.392545+0000","last_fullsized":"2024-09-20T21:05:55.392545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:28.039071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390092+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:55.390092+0000","last_peered":"2024-09-20T21:05:55.390092+0000","last_clean":"2024-09-20T21:05:55.390092+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:55.390092+0000","last_undegraded":"2024-09-20T21:05:55.390092+0000","last_fullsized":"2024-09-20T21:05:55.390092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:58.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124493+0000","last_change":"2024-09-20T21:05:45.323068+0000","last_active":"2024-09-20T21:05:55.124493+0000","last_peered":"2024-09-20T21:05:55.124493+0000","last_clean":"2024-09-20T21:05:55.124493+0000","last_became_active":"2024-09-20T21:05:45.321160+0000","last_became_peered":"2024-09-20T21:05:45.321160+0000","last_unstale":"2024-09-20T21:05:55.124493+0000","last_undegraded":"2024-09-20T21:05:55.124493+0000","last_fullsized":"2024-09-20T21:05:55.124493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:32.144771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117798+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:55.117798+0000","last_peered":"2024-09-20T21:05:55.117798+0000","last_clean":"2024-09-20T21:05:55.117798+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:55.117798+0000","last_undegraded":"2024-09-20T21:05:55.117798+0000","last_fullsized":"2024-09-20T21:05:55.117798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124734+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:55.124734+0000","last_peered":"2024-09-20T21:05:55.124734+0000","last_clean":"2024-09-20T21:05:55.124734+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:55.124734+0000","last_undegraded":"2024-09-20T21:05:55.124734+0000","last_fullsized":"2024-09-20T21:05:55.124734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116320+0000","last_change":"2024-09-20T21:05:54.126982+0000","last_active":"2024-09-20T21:05:55.116320+0000","last_peered":"2024-09-20T21:05:55.116320+0000","last_clean":"2024-09-20T21:05:55.116320+0000","last_became_active":"2024-09-20T21:05:54.121776+0000","last_became_peered":"2024-09-20T21:05:54.121776+0000","last_unstale":"2024-09-20T21:05:55.116320+0000","last_undegraded":"2024-09-20T21:05:55.116320+0000","last_fullsized":"2024-09-20T21:05:55.116320+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:46.297334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":114,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123656+0000","last_change":"2024-09-20T21:05:52.101432+0000","last_active":"2024-09-20T21:05:55.123656+0000","last_peered":"2024-09-20T21:05:55.123656+0000","last_clean":"2024-09-20T21:05:55.123656+0000","last_became_active":"2024-09-20T21:05:52.100421+0000","last_became_peered":"2024-09-20T21:05:52.100421+0000","last_unstale":"2024-09-20T21:05:55.123656+0000","last_undegraded":"2024-09-20T21:05:55.123656+0000","last_fullsized":"2024-09-20T21:05:55.123656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390114+0000","last_change":"2024-09-20T21:05:33.525394+0000","last_active":"2024-09-20T21:05:55.390114+0000","last_peered":"2024-09-20T21:05:55.390114+0000","last_clean":"2024-09-20T21:05:55.390114+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:05:55.390114+0000","last_undegraded":"2024-09-20T21:05:55.390114+0000","last_fullsized":"2024-09-20T21:05:55.390114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:51:33.922257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390976+0000","last_change":"2024-09-20T21:05:33.522984+0000","last_active":"2024-09-20T21:05:55.390976+0000","last_peered":"2024-09-20T21:05:55.390976+0000","last_clean":"2024-09-20T21:05:55.390976+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:05:55.390976+0000","last_undegraded":"2024-09-20T21:05:55.390976+0000","last_fullsized":"2024-09-20T21:05:55.390976+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:22:14.870718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124538+0000","last_change":"2024-09-20T21:05:45.331015+0000","last_active":"2024-09-20T21:05:55.124538+0000","last_peered":"2024-09-20T21:05:55.124538+0000","last_clean":"2024-09-20T21:05:55.124538+0000","last_became_active":"2024-09-20T21:05:45.330361+0000","last_became_peered":"2024-09-20T21:05:45.330361+0000","last_unstale":"2024-09-20T21:05:55.124538+0000","last_undegraded":"2024-09-20T21:05:55.124538+0000","last_fullsized":"2024-09-20T21:05:55.124538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390741+0000","last_change":"2024-09-20T21:05:33.530100+0000","last_active":"2024-09-20T21:05:55.390741+0000","last_peered":"2024-09-20T21:05:55.390741+0000","last_clean":"2024-09-20T21:05:55.390741+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:05:55.390741+0000","last_undegraded":"2024-09-20T21:05:55.390741+0000","last_fullsized":"2024-09-20T21:05:55.390741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:12.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124786+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:55.124786+0000","last_peered":"2024-09-20T21:05:55.124786+0000","last_clean":"2024-09-20T21:05:55.124786+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:55.124786+0000","last_undegraded":"2024-09-20T21:05:55.124786+0000","last_fullsized":"2024-09-20T21:05:55.124786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116170+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:55.116170+0000","last_peered":"2024-09-20T21:05:55.116170+0000","last_clean":"2024-09-20T21:05:55.116170+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:55.116170+0000","last_undegraded":"2024-09-20T21:05:55.116170+0000","last_fullsized":"2024-09-20T21:05:55.116170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:03.961332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124581+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:55.124581+0000","last_peered":"2024-09-20T21:05:55.124581+0000","last_clean":"2024-09-20T21:05:55.124581+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:55.124581+0000","last_undegraded":"2024-09-20T21:05:55.124581+0000","last_fullsized":"2024-09-20T21:05:55.124581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.118157+0000","last_change":"2024-09-20T21:05:54.121905+0000","last_active":"2024-09-20T21:05:55.118157+0000","last_peered":"2024-09-20T21:05:55.118157+0000","last_clean":"2024-09-20T21:05:55.118157+0000","last_became_active":"2024-09-20T21:05:54.121064+0000","last_became_peered":"2024-09-20T21:05:54.121064+0000","last_unstale":"2024-09-20T21:05:55.118157+0000","last_undegraded":"2024-09-20T21:05:55.118157+0000","last_fullsized":"2024-09-20T21:05:55.118157+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:54:14.429868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116445+0000","last_change":"2024-09-20T21:05:54.132710+0000","last_active":"2024-09-20T21:05:55.116445+0000","last_peered":"2024-09-20T21:05:55.116445+0000","last_clean":"2024-09-20T21:05:55.116445+0000","last_became_active":"2024-09-20T21:05:54.127863+0000","last_became_peered":"2024-09-20T21:05:54.127863+0000","last_unstale":"2024-09-20T21:05:55.116445+0000","last_undegraded":"2024-09-20T21:05:55.116445+0000","last_fullsized":"2024-09-20T21:05:55.116445+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:59.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124756+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:55.124756+0000","last_peered":"2024-09-20T21:05:55.124756+0000","last_clean":"2024-09-20T21:05:55.124756+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:55.124756+0000","last_undegraded":"2024-09-20T21:05:55.124756+0000","last_fullsized":"2024-09-20T21:05:55.124756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124399+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:05:55.124399+0000","last_peered":"2024-09-20T21:05:55.124399+0000","last_clean":"2024-09-20T21:05:55.124399+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:05:55.124399+0000","last_undegraded":"2024-09-20T21:05:55.124399+0000","last_fullsized":"2024-09-20T21:05:55.124399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123360+0000","last_change":"2024-09-20T21:05:37.267287+0000","last_active":"2024-09-20T21:05:55.123360+0000","last_peered":"2024-09-20T21:05:55.123360+0000","last_clean":"2024-09-20T21:05:55.123360+0000","last_became_active":"2024-09-20T21:05:37.266438+0000","last_became_peered":"2024-09-20T21:05:37.266438+0000","last_unstale":"2024-09-20T21:05:55.123360+0000","last_undegraded":"2024-09-20T21:05:55.123360+0000","last_fullsized":"2024-09-20T21:05:55.123360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124163+0000","last_change":"2024-09-20T21:05:34.264862+0000","last_active":"2024-09-20T21:05:55.124163+0000","last_peered":"2024-09-20T21:05:55.124163+0000","last_clean":"2024-09-20T21:05:55.124163+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:05:55.124163+0000","last_undegraded":"2024-09-20T21:05:55.124163+0000","last_fullsized":"2024-09-20T21:05:55.124163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:32.512356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.395346+0000","last_change":"2024-09-20T21:05:55.395346+0000","last_active":"2024-09-20T21:05:55.395346+0000","last_peered":"2024-09-20T21:05:55.395346+0000","last_clean":"2024-09-20T21:05:55.395346+0000","last_became_active":"2024-09-20T21:05:55.394868+0000","last_became_peered":"2024-09-20T21:05:55.394868+0000","last_unstale":"2024-09-20T21:05:55.395346+0000","last_undegraded":"2024-09-20T21:05:55.395346+0000","last_fullsized":"2024-09-20T21:05:55.395346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:38.909352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116571+0000","last_change":"2024-09-20T21:05:54.121933+0000","last_active":"2024-09-20T21:05:55.116571+0000","last_peered":"2024-09-20T21:05:55.116571+0000","last_clean":"2024-09-20T21:05:55.116571+0000","last_became_active":"2024-09-20T21:05:54.119503+0000","last_became_peered":"2024-09-20T21:05:54.119503+0000","last_unstale":"2024-09-20T21:05:55.116571+0000","last_undegraded":"2024-09-20T21:05:55.116571+0000","last_fullsized":"2024-09-20T21:05:55.116571+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:02.194094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391433+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:55.391433+0000","last_peered":"2024-09-20T21:05:55.391433+0000","last_clean":"2024-09-20T21:05:55.391433+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:55.391433+0000","last_undegraded":"2024-09-20T21:05:55.391433+0000","last_fullsized":"2024-09-20T21:05:55.391433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:49.172273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390555+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:55.390555+0000","last_peered":"2024-09-20T21:05:55.390555+0000","last_clean":"2024-09-20T21:05:55.390555+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:55.390555+0000","last_undegraded":"2024-09-20T21:05:55.390555+0000","last_fullsized":"2024-09-20T21:05:55.390555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:07:07.242939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122199+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:05:55.122199+0000","last_peered":"2024-09-20T21:05:55.122199+0000","last_clean":"2024-09-20T21:05:55.122199+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:05:55.122199+0000","last_undegraded":"2024-09-20T21:05:55.122199+0000","last_fullsized":"2024-09-20T21:05:55.122199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117882+0000","last_change":"2024-09-20T21:05:54.130634+0000","last_active":"2024-09-20T21:05:55.117882+0000","last_peered":"2024-09-20T21:05:55.117882+0000","last_clean":"2024-09-20T21:05:55.117882+0000","last_became_active":"2024-09-20T21:05:54.128221+0000","last_became_peered":"2024-09-20T21:05:54.128221+0000","last_unstale":"2024-09-20T21:05:55.117882+0000","last_undegraded":"2024-09-20T21:05:55.117882+0000","last_fullsized":"2024-09-20T21:05:55.117882+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:37.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392938+0000","last_change":"2024-09-20T21:05:33.525151+0000","last_active":"2024-09-20T21:05:55.392938+0000","last_peered":"2024-09-20T21:05:55.392938+0000","last_clean":"2024-09-20T21:05:55.392938+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:05:55.392938+0000","last_undegraded":"2024-09-20T21:05:55.392938+0000","last_fullsized":"2024-09-20T21:05:55.392938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:51.245496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123714+0000","last_change":"2024-09-20T21:05:52.104238+0000","last_active":"2024-09-20T21:05:55.123714+0000","last_peered":"2024-09-20T21:05:55.123714+0000","last_clean":"2024-09-20T21:05:55.123714+0000","last_became_active":"2024-09-20T21:05:52.103630+0000","last_became_peered":"2024-09-20T21:05:52.103630+0000","last_unstale":"2024-09-20T21:05:55.123714+0000","last_undegraded":"2024-09-20T21:05:55.123714+0000","last_fullsized":"2024-09-20T21:05:55.123714+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124560+0000","last_change":"2024-09-20T21:05:34.264735+0000","last_active":"2024-09-20T21:05:55.124560+0000","last_peered":"2024-09-20T21:05:55.124560+0000","last_clean":"2024-09-20T21:05:55.124560+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:05:55.124560+0000","last_undegraded":"2024-09-20T21:05:55.124560+0000","last_fullsized":"2024-09-20T21:05:55.124560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:16.718841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.120856+0000","last_change":"2024-09-20T21:05:52.100914+0000","last_active":"2024-09-20T21:05:55.120856+0000","last_peered":"2024-09-20T21:05:55.120856+0000","last_clean":"2024-09-20T21:05:55.120856+0000","last_became_active":"2024-09-20T21:05:52.100104+0000","last_became_peered":"2024-09-20T21:05:52.100104+0000","last_unstale":"2024-09-20T21:05:55.120856+0000","last_undegraded":"2024-09-20T21:05:55.120856+0000","last_fullsized":"2024-09-20T21:05:55.120856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:51:38.241935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117935+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:55.117935+0000","last_peered":"2024-09-20T21:05:55.117935+0000","last_clean":"2024-09-20T21:05:55.117935+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:55.117935+0000","last_undegraded":"2024-09-20T21:05:55.117935+0000","last_fullsized":"2024-09-20T21:05:55.117935+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:39.486200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.121098+0000","last_change":"2024-09-20T21:05:37.269662+0000","last_active":"2024-09-20T21:05:55.121098+0000","last_peered":"2024-09-20T21:05:55.121098+0000","last_clean":"2024-09-20T21:05:55.121098+0000","last_became_active":"2024-09-20T21:05:37.268982+0000","last_became_peered":"2024-09-20T21:05:37.268982+0000","last_unstale":"2024-09-20T21:05:55.121098+0000","last_undegraded":"2024-09-20T21:05:55.121098+0000","last_fullsized":"2024-09-20T21:05:55.121098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:38.474304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122329+0000","last_change":"2024-09-20T21:05:45.321820+0000","last_active":"2024-09-20T21:05:55.122329+0000","last_peered":"2024-09-20T21:05:55.122329+0000","last_clean":"2024-09-20T21:05:55.122329+0000","last_became_active":"2024-09-20T21:05:45.320924+0000","last_became_peered":"2024-09-20T21:05:45.320924+0000","last_unstale":"2024-09-20T21:05:55.122329+0000","last_undegraded":"2024-09-20T21:05:55.122329+0000","last_fullsized":"2024-09-20T21:05:55.122329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:18:23.772854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123853+0000","last_change":"2024-09-20T21:05:45.321935+0000","last_active":"2024-09-20T21:05:55.123853+0000","last_peered":"2024-09-20T21:05:55.123853+0000","last_clean":"2024-09-20T21:05:55.123853+0000","last_became_active":"2024-09-20T21:05:45.321031+0000","last_became_peered":"2024-09-20T21:05:45.321031+0000","last_unstale":"2024-09-20T21:05:55.123853+0000","last_undegraded":"2024-09-20T21:05:55.123853+0000","last_fullsized":"2024-09-20T21:05:55.123853+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:01.849318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117259+0000","last_change":"2024-09-20T21:05:54.127603+0000","last_active":"2024-09-20T21:05:55.117259+0000","last_peered":"2024-09-20T21:05:55.117259+0000","last_clean":"2024-09-20T21:05:55.117259+0000","last_became_active":"2024-09-20T21:05:54.125123+0000","last_became_peered":"2024-09-20T21:05:54.125123+0000","last_unstale":"2024-09-20T21:05:55.117259+0000","last_undegraded":"2024-09-20T21:05:55.117259+0000","last_fullsized":"2024-09-20T21:05:55.117259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:43:09.663833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116468+0000","last_change":"2024-09-20T21:05:54.122334+0000","last_active":"2024-09-20T21:05:55.116468+0000","last_peered":"2024-09-20T21:05:55.116468+0000","last_clean":"2024-09-20T21:05:55.116468+0000","last_became_active":"2024-09-20T21:05:54.121466+0000","last_became_peered":"2024-09-20T21:05:54.121466+0000","last_unstale":"2024-09-20T21:05:55.116468+0000","last_undegraded":"2024-09-20T21:05:55.116468+0000","last_fullsized":"2024-09-20T21:05:55.116468+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:41.667343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":122,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117020+0000","last_change":"2024-09-20T21:05:54.132657+0000","last_active":"2024-09-20T21:05:55.117020+0000","last_peered":"2024-09-20T21:05:55.117020+0000","last_clean":"2024-09-20T21:05:55.117020+0000","last_became_active":"2024-09-20T21:05:54.129891+0000","last_became_peered":"2024-09-20T21:05:54.129891+0000","last_unstale":"2024-09-20T21:05:55.117020+0000","last_undegraded":"2024-09-20T21:05:55.117020+0000","last_fullsized":"2024-09-20T21:05:55.117020+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:26.911986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116983+0000","last_change":"2024-09-20T21:05:54.127321+0000","last_active":"2024-09-20T21:05:55.116983+0000","last_peered":"2024-09-20T21:05:55.116983+0000","last_clean":"2024-09-20T21:05:55.116983+0000","last_became_active":"2024-09-20T21:05:54.120527+0000","last_became_peered":"2024-09-20T21:05:54.120527+0000","last_unstale":"2024-09-20T21:05:55.116983+0000","last_undegraded":"2024-09-20T21:05:55.116983+0000","last_fullsized":"2024-09-20T21:05:55.116983+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:25.400362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391620+0000","last_change":"2024-09-20T21:05:33.523783+0000","last_active":"2024-09-20T21:05:55.391620+0000","last_peered":"2024-09-20T21:05:55.391620+0000","last_clean":"2024-09-20T21:05:55.391620+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:05:55.391620+0000","last_undegraded":"2024-09-20T21:05:55.391620+0000","last_fullsized":"2024-09-20T21:05:55.391620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:29.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391369+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:55.391369+0000","last_peered":"2024-09-20T21:05:55.391369+0000","last_clean":"2024-09-20T21:05:55.391369+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:55.391369+0000","last_undegraded":"2024-09-20T21:05:55.391369+0000","last_fullsized":"2024-09-20T21:05:55.391369+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:45:47.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390604+0000","last_change":"2024-09-20T21:05:33.525036+0000","last_active":"2024-09-20T21:05:55.390604+0000","last_peered":"2024-09-20T21:05:55.390604+0000","last_clean":"2024-09-20T21:05:55.390604+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:05:55.390604+0000","last_undegraded":"2024-09-20T21:05:55.390604+0000","last_fullsized":"2024-09-20T21:05:55.390604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:13.120671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117548+0000","last_change":"2024-09-20T21:05:54.126814+0000","last_active":"2024-09-20T21:05:55.117548+0000","last_peered":"2024-09-20T21:05:55.117548+0000","last_clean":"2024-09-20T21:05:55.117548+0000","last_became_active":"2024-09-20T21:05:54.124075+0000","last_became_peered":"2024-09-20T21:05:54.124075+0000","last_unstale":"2024-09-20T21:05:55.117548+0000","last_undegraded":"2024-09-20T21:05:55.117548+0000","last_fullsized":"2024-09-20T21:05:55.117548+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:18.839315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116829+0000","last_change":"2024-09-20T21:05:54.122485+0000","last_active":"2024-09-20T21:05:55.116829+0000","last_peered":"2024-09-20T21:05:55.116829+0000","last_clean":"2024-09-20T21:05:55.116829+0000","last_became_active":"2024-09-20T21:05:54.121408+0000","last_became_peered":"2024-09-20T21:05:54.121408+0000","last_unstale":"2024-09-20T21:05:55.116829+0000","last_undegraded":"2024-09-20T21:05:55.116829+0000","last_fullsized":"2024-09-20T21:05:55.116829+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:36.479778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123681+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:55.123681+0000","last_peered":"2024-09-20T21:05:55.123681+0000","last_clean":"2024-09-20T21:05:55.123681+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:55.123681+0000","last_undegraded":"2024-09-20T21:05:55.123681+0000","last_fullsized":"2024-09-20T21:05:55.123681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390271+0000","last_change":"2024-09-20T21:05:33.529399+0000","last_active":"2024-09-20T21:05:55.390271+0000","last_peered":"2024-09-20T21:05:55.390271+0000","last_clean":"2024-09-20T21:05:55.390271+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:05:55.390271+0000","last_undegraded":"2024-09-20T21:05:55.390271+0000","last_fullsized":"2024-09-20T21:05:55.390271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:36.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122854+0000","last_change":"2024-09-20T21:05:45.323879+0000","last_active":"2024-09-20T21:05:55.122854+0000","last_peered":"2024-09-20T21:05:55.122854+0000","last_clean":"2024-09-20T21:05:55.122854+0000","last_became_active":"2024-09-20T21:05:45.321268+0000","last_became_peered":"2024-09-20T21:05:45.321268+0000","last_unstale":"2024-09-20T21:05:55.122854+0000","last_undegraded":"2024-09-20T21:05:55.122854+0000","last_fullsized":"2024-09-20T21:05:55.122854+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:53.346461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216928,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94154912,"statfs":{"total":96636764160,"available":96414629888,"internally_reserved":0,"allocated":1118208,"data_stored":1000114,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350983,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54640,"kb_used_data":1112,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317200,"statfs":{"total":96636764160,"available":96580812800,"internally_reserved":0,"allocated":1138688,"data_stored":1004981,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325140,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046700,"statfs":{"total":96636764160,"available":96303820800,"internally_reserved":0,"allocated":1044480,"data_stored":408587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:05:59.403 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-20T21:05:59.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:05:59.737 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:05:59.739 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:05:59.754 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-09-20T21:05:58.992737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596708,"kb_used_data":3224,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282518812,"statfs":{"total":289910292480,"available":289299263488,"internally_reserved":0,"allocated":3301376,"data_stored":2413682,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.899120"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117741+0000","last_change":"2024-09-20T21:05:54.129746+0000","last_active":"2024-09-20T21:05:55.117741+0000","last_peered":"2024-09-20T21:05:55.117741+0000","last_clean":"2024-09-20T21:05:55.117741+0000","last_became_active":"2024-09-20T21:05:54.127664+0000","last_became_peered":"2024-09-20T21:05:54.127664+0000","last_unstale":"2024-09-20T21:05:55.117741+0000","last_undegraded":"2024-09-20T21:05:55.117741+0000","last_fullsized":"2024-09-20T21:05:55.117741+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:57.952046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117563+0000","last_change":"2024-09-20T21:05:54.126721+0000","last_active":"2024-09-20T21:05:55.117563+0000","last_peered":"2024-09-20T21:05:55.117563+0000","last_clean":"2024-09-20T21:05:55.117563+0000","last_became_active":"2024-09-20T21:05:54.124269+0000","last_became_peered":"2024-09-20T21:05:54.124269+0000","last_unstale":"2024-09-20T21:05:55.117563+0000","last_undegraded":"2024-09-20T21:05:55.117563+0000","last_fullsized":"2024-09-20T21:05:55.117563+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393027+0000","last_change":"2024-09-20T21:05:33.529595+0000","last_active":"2024-09-20T21:05:55.393027+0000","last_peered":"2024-09-20T21:05:55.393027+0000","last_clean":"2024-09-20T21:05:55.393027+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:05:55.393027+0000","last_undegraded":"2024-09-20T21:05:55.393027+0000","last_fullsized":"2024-09-20T21:05:55.393027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:08.234369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391440+0000","last_change":"2024-09-20T21:05:33.516896+0000","last_active":"2024-09-20T21:05:55.391440+0000","last_peered":"2024-09-20T21:05:55.391440+0000","last_clean":"2024-09-20T21:05:55.391440+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:05:55.391440+0000","last_undegraded":"2024-09-20T21:05:55.391440+0000","last_fullsized":"2024-09-20T21:05:55.391440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:48.472114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116748+0000","last_change":"2024-09-20T21:05:54.130938+0000","last_active":"2024-09-20T21:05:55.116748+0000","last_peered":"2024-09-20T21:05:55.116748+0000","last_clean":"2024-09-20T21:05:55.116748+0000","last_became_active":"2024-09-20T21:05:54.125511+0000","last_became_peered":"2024-09-20T21:05:54.125511+0000","last_unstale":"2024-09-20T21:05:55.116748+0000","last_undegraded":"2024-09-20T21:05:55.116748+0000","last_fullsized":"2024-09-20T21:05:55.116748+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:55.659526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391460+0000","last_change":"2024-09-20T21:05:33.526021+0000","last_active":"2024-09-20T21:05:55.391460+0000","last_peered":"2024-09-20T21:05:55.391460+0000","last_clean":"2024-09-20T21:05:55.391460+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:05:55.391460+0000","last_undegraded":"2024-09-20T21:05:55.391460+0000","last_fullsized":"2024-09-20T21:05:55.391460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:51.022212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492841+0000","last_change":"2024-09-20T21:05:55.492841+0000","last_active":"2024-09-20T21:05:55.492841+0000","last_peered":"2024-09-20T21:05:55.492841+0000","last_clean":"2024-09-20T21:05:55.492841+0000","last_became_active":"2024-09-20T21:05:55.492104+0000","last_became_peered":"2024-09-20T21:05:55.492104+0000","last_unstale":"2024-09-20T21:05:55.492841+0000","last_undegraded":"2024-09-20T21:05:55.492841+0000","last_fullsized":"2024-09-20T21:05:55.492841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.580757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390006+0000","last_change":"2024-09-20T21:05:33.527599+0000","last_active":"2024-09-20T21:05:55.390006+0000","last_peered":"2024-09-20T21:05:55.390006+0000","last_clean":"2024-09-20T21:05:55.390006+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:05:55.390006+0000","last_undegraded":"2024-09-20T21:05:55.390006+0000","last_fullsized":"2024-09-20T21:05:55.390006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:19:18.002155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122816+0000","last_change":"2024-09-20T21:05:45.329452+0000","last_active":"2024-09-20T21:05:55.122816+0000","last_peered":"2024-09-20T21:05:55.122816+0000","last_clean":"2024-09-20T21:05:55.122816+0000","last_became_active":"2024-09-20T21:05:45.327207+0000","last_became_peered":"2024-09-20T21:05:45.327207+0000","last_unstale":"2024-09-20T21:05:55.122816+0000","last_undegraded":"2024-09-20T21:05:55.122816+0000","last_fullsized":"2024-09-20T21:05:55.122816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:42.075068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117093+0000","last_change":"2024-09-20T21:05:54.126680+0000","last_active":"2024-09-20T21:05:55.117093+0000","last_peered":"2024-09-20T21:05:55.117093+0000","last_clean":"2024-09-20T21:05:55.117093+0000","last_became_active":"2024-09-20T21:05:54.124291+0000","last_became_peered":"2024-09-20T21:05:54.124291+0000","last_unstale":"2024-09-20T21:05:55.117093+0000","last_undegraded":"2024-09-20T21:05:55.117093+0000","last_fullsized":"2024-09-20T21:05:55.117093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:05.334214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392938+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:55.392938+0000","last_peered":"2024-09-20T21:05:55.392938+0000","last_clean":"2024-09-20T21:05:55.392938+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:55.392938+0000","last_undegraded":"2024-09-20T21:05:55.392938+0000","last_fullsized":"2024-09-20T21:05:55.392938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:14:10.131416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116730+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:05:55.116730+0000","last_peered":"2024-09-20T21:05:55.116730+0000","last_clean":"2024-09-20T21:05:55.116730+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:05:55.116730+0000","last_undegraded":"2024-09-20T21:05:55.116730+0000","last_fullsized":"2024-09-20T21:05:55.116730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:51.509743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116172+0000","last_change":"2024-09-20T21:05:54.132356+0000","last_active":"2024-09-20T21:05:55.116172+0000","last_peered":"2024-09-20T21:05:55.116172+0000","last_clean":"2024-09-20T21:05:55.116172+0000","last_became_active":"2024-09-20T21:05:54.128147+0000","last_became_peered":"2024-09-20T21:05:54.128147+0000","last_unstale":"2024-09-20T21:05:55.116172+0000","last_undegraded":"2024-09-20T21:05:55.116172+0000","last_fullsized":"2024-09-20T21:05:55.116172+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:07.742615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391210+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:55.391210+0000","last_peered":"2024-09-20T21:05:55.391210+0000","last_clean":"2024-09-20T21:05:55.391210+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:55.391210+0000","last_undegraded":"2024-09-20T21:05:55.391210+0000","last_fullsized":"2024-09-20T21:05:55.391210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:17.867418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390735+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:55.390735+0000","last_peered":"2024-09-20T21:05:55.390735+0000","last_clean":"2024-09-20T21:05:55.390735+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:55.390735+0000","last_undegraded":"2024-09-20T21:05:55.390735+0000","last_fullsized":"2024-09-20T21:05:55.390735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:36.753632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.490656+0000","last_change":"2024-09-20T21:05:55.490656+0000","last_active":"2024-09-20T21:05:55.490656+0000","last_peered":"2024-09-20T21:05:55.490656+0000","last_clean":"2024-09-20T21:05:55.490656+0000","last_became_active":"2024-09-20T21:05:55.489879+0000","last_became_peered":"2024-09-20T21:05:55.489879+0000","last_unstale":"2024-09-20T21:05:55.490656+0000","last_undegraded":"2024-09-20T21:05:55.490656+0000","last_fullsized":"2024-09-20T21:05:55.490656+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:01.290416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124476+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:55.124476+0000","last_peered":"2024-09-20T21:05:55.124476+0000","last_clean":"2024-09-20T21:05:55.124476+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:55.124476+0000","last_undegraded":"2024-09-20T21:05:55.124476+0000","last_fullsized":"2024-09-20T21:05:55.124476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117505+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:55.117505+0000","last_peered":"2024-09-20T21:05:55.117505+0000","last_clean":"2024-09-20T21:05:55.117505+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:55.117505+0000","last_undegraded":"2024-09-20T21:05:55.117505+0000","last_fullsized":"2024-09-20T21:05:55.117505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122128+0000","last_change":"2024-09-20T21:05:45.327807+0000","last_active":"2024-09-20T21:05:55.122128+0000","last_peered":"2024-09-20T21:05:55.122128+0000","last_clean":"2024-09-20T21:05:55.122128+0000","last_became_active":"2024-09-20T21:05:45.326913+0000","last_became_peered":"2024-09-20T21:05:45.326913+0000","last_unstale":"2024-09-20T21:05:55.122128+0000","last_undegraded":"2024-09-20T21:05:55.122128+0000","last_fullsized":"2024-09-20T21:05:55.122128+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492609+0000","last_change":"2024-09-20T21:05:55.492609+0000","last_active":"2024-09-20T21:05:55.492609+0000","last_peered":"2024-09-20T21:05:55.492609+0000","last_clean":"2024-09-20T21:05:55.492609+0000","last_became_active":"2024-09-20T21:05:55.491995+0000","last_became_peered":"2024-09-20T21:05:55.491995+0000","last_unstale":"2024-09-20T21:05:55.492609+0000","last_undegraded":"2024-09-20T21:05:55.492609+0000","last_fullsized":"2024-09-20T21:05:55.492609+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:00.972806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392131+0000","last_change":"2024-09-20T21:05:33.524928+0000","last_active":"2024-09-20T21:05:55.392131+0000","last_peered":"2024-09-20T21:05:55.392131+0000","last_clean":"2024-09-20T21:05:55.392131+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:05:55.392131+0000","last_undegraded":"2024-09-20T21:05:55.392131+0000","last_fullsized":"2024-09-20T21:05:55.392131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:42.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116038+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:55.116038+0000","last_peered":"2024-09-20T21:05:55.116038+0000","last_clean":"2024-09-20T21:05:55.116038+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:55.116038+0000","last_undegraded":"2024-09-20T21:05:55.116038+0000","last_fullsized":"2024-09-20T21:05:55.116038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123406+0000","last_change":"2024-09-20T21:05:52.103930+0000","last_active":"2024-09-20T21:05:55.123406+0000","last_peered":"2024-09-20T21:05:55.123406+0000","last_clean":"2024-09-20T21:05:55.123406+0000","last_became_active":"2024-09-20T21:05:52.103477+0000","last_became_peered":"2024-09-20T21:05:52.103477+0000","last_unstale":"2024-09-20T21:05:55.123406+0000","last_undegraded":"2024-09-20T21:05:55.123406+0000","last_fullsized":"2024-09-20T21:05:55.123406+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115860+0000","last_change":"2024-09-20T21:05:54.133334+0000","last_active":"2024-09-20T21:05:55.115860+0000","last_peered":"2024-09-20T21:05:55.115860+0000","last_clean":"2024-09-20T21:05:55.115860+0000","last_became_active":"2024-09-20T21:05:54.129639+0000","last_became_peered":"2024-09-20T21:05:54.129639+0000","last_unstale":"2024-09-20T21:05:55.115860+0000","last_undegraded":"2024-09-20T21:05:55.115860+0000","last_fullsized":"2024-09-20T21:05:55.115860+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117793+0000","last_change":"2024-09-20T21:05:54.126793+0000","last_active":"2024-09-20T21:05:55.117793+0000","last_peered":"2024-09-20T21:05:55.117793+0000","last_clean":"2024-09-20T21:05:55.117793+0000","last_became_active":"2024-09-20T21:05:54.124757+0000","last_became_peered":"2024-09-20T21:05:54.124757+0000","last_unstale":"2024-09-20T21:05:55.117793+0000","last_undegraded":"2024-09-20T21:05:55.117793+0000","last_fullsized":"2024-09-20T21:05:55.117793+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:46:28.346590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123336+0000","last_change":"2024-09-20T21:05:45.324835+0000","last_active":"2024-09-20T21:05:55.123336+0000","last_peered":"2024-09-20T21:05:55.123336+0000","last_clean":"2024-09-20T21:05:55.123336+0000","last_became_active":"2024-09-20T21:05:45.321767+0000","last_became_peered":"2024-09-20T21:05:45.321767+0000","last_unstale":"2024-09-20T21:05:55.123336+0000","last_undegraded":"2024-09-20T21:05:55.123336+0000","last_fullsized":"2024-09-20T21:05:55.123336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:16.302231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392754+0000","last_change":"2024-09-20T21:05:33.528984+0000","last_active":"2024-09-20T21:05:55.392754+0000","last_peered":"2024-09-20T21:05:55.392754+0000","last_clean":"2024-09-20T21:05:55.392754+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:05:55.392754+0000","last_undegraded":"2024-09-20T21:05:55.392754+0000","last_fullsized":"2024-09-20T21:05:55.392754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:53.623013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117367+0000","last_change":"2024-09-20T21:05:54.121935+0000","last_active":"2024-09-20T21:05:55.117367+0000","last_peered":"2024-09-20T21:05:55.117367+0000","last_clean":"2024-09-20T21:05:55.117367+0000","last_became_active":"2024-09-20T21:05:54.120990+0000","last_became_peered":"2024-09-20T21:05:54.120990+0000","last_unstale":"2024-09-20T21:05:55.117367+0000","last_undegraded":"2024-09-20T21:05:55.117367+0000","last_fullsized":"2024-09-20T21:05:55.117367+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122633+0000","last_change":"2024-09-20T21:05:37.268677+0000","last_active":"2024-09-20T21:05:55.122633+0000","last_peered":"2024-09-20T21:05:55.122633+0000","last_clean":"2024-09-20T21:05:55.122633+0000","last_became_active":"2024-09-20T21:05:37.267096+0000","last_became_peered":"2024-09-20T21:05:37.267096+0000","last_unstale":"2024-09-20T21:05:55.122633+0000","last_undegraded":"2024-09-20T21:05:55.122633+0000","last_fullsized":"2024-09-20T21:05:55.122633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116342+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:55.116342+0000","last_peered":"2024-09-20T21:05:55.116342+0000","last_clean":"2024-09-20T21:05:55.116342+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:55.116342+0000","last_undegraded":"2024-09-20T21:05:55.116342+0000","last_fullsized":"2024-09-20T21:05:55.116342+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123564+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:55.123564+0000","last_peered":"2024-09-20T21:05:55.123564+0000","last_clean":"2024-09-20T21:05:55.123564+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:55.123564+0000","last_undegraded":"2024-09-20T21:05:55.123564+0000","last_fullsized":"2024-09-20T21:05:55.123564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389829+0000","last_change":"2024-09-20T21:05:33.520634+0000","last_active":"2024-09-20T21:05:55.389829+0000","last_peered":"2024-09-20T21:05:55.389829+0000","last_clean":"2024-09-20T21:05:55.389829+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:05:55.389829+0000","last_undegraded":"2024-09-20T21:05:55.389829+0000","last_fullsized":"2024-09-20T21:05:55.389829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.341860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117126+0000","last_change":"2024-09-20T21:05:54.132673+0000","last_active":"2024-09-20T21:05:55.117126+0000","last_peered":"2024-09-20T21:05:55.117126+0000","last_clean":"2024-09-20T21:05:55.117126+0000","last_became_active":"2024-09-20T21:05:54.128119+0000","last_became_peered":"2024-09-20T21:05:54.128119+0000","last_unstale":"2024-09-20T21:05:55.117126+0000","last_undegraded":"2024-09-20T21:05:55.117126+0000","last_fullsized":"2024-09-20T21:05:55.117126+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391078+0000","last_change":"2024-09-20T21:05:33.523453+0000","last_active":"2024-09-20T21:05:55.391078+0000","last_peered":"2024-09-20T21:05:55.391078+0000","last_clean":"2024-09-20T21:05:55.391078+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:05:55.391078+0000","last_undegraded":"2024-09-20T21:05:55.391078+0000","last_fullsized":"2024-09-20T21:05:55.391078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:59.275158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117521+0000","last_change":"2024-09-20T21:05:54.133190+0000","last_active":"2024-09-20T21:05:55.117521+0000","last_peered":"2024-09-20T21:05:55.117521+0000","last_clean":"2024-09-20T21:05:55.117521+0000","last_became_active":"2024-09-20T21:05:54.130889+0000","last_became_peered":"2024-09-20T21:05:54.130889+0000","last_unstale":"2024-09-20T21:05:55.117521+0000","last_undegraded":"2024-09-20T21:05:55.117521+0000","last_fullsized":"2024-09-20T21:05:55.117521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122870+0000","last_change":"2024-09-20T21:05:34.265360+0000","last_active":"2024-09-20T21:05:55.122870+0000","last_peered":"2024-09-20T21:05:55.122870+0000","last_clean":"2024-09-20T21:05:55.122870+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:05:55.122870+0000","last_undegraded":"2024-09-20T21:05:55.122870+0000","last_fullsized":"2024-09-20T21:05:55.122870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:02.949435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123803+0000","last_change":"2024-09-20T21:05:34.264103+0000","last_active":"2024-09-20T21:05:55.123803+0000","last_peered":"2024-09-20T21:05:55.123803+0000","last_clean":"2024-09-20T21:05:55.123803+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:05:55.123803+0000","last_undegraded":"2024-09-20T21:05:55.123803+0000","last_fullsized":"2024-09-20T21:05:55.123803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.354082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116206+0000","last_change":"2024-09-20T21:05:54.126994+0000","last_active":"2024-09-20T21:05:55.116206+0000","last_peered":"2024-09-20T21:05:55.116206+0000","last_clean":"2024-09-20T21:05:55.116206+0000","last_became_active":"2024-09-20T21:05:54.124655+0000","last_became_peered":"2024-09-20T21:05:54.124655+0000","last_unstale":"2024-09-20T21:05:55.116206+0000","last_undegraded":"2024-09-20T21:05:55.116206+0000","last_fullsized":"2024-09-20T21:05:55.116206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:41.063171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123077+0000","last_change":"2024-09-20T21:05:45.324641+0000","last_active":"2024-09-20T21:05:55.123077+0000","last_peered":"2024-09-20T21:05:55.123077+0000","last_clean":"2024-09-20T21:05:55.123077+0000","last_became_active":"2024-09-20T21:05:45.323784+0000","last_became_peered":"2024-09-20T21:05:45.323784+0000","last_unstale":"2024-09-20T21:05:55.123077+0000","last_undegraded":"2024-09-20T21:05:55.123077+0000","last_fullsized":"2024-09-20T21:05:55.123077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:42.679240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389770+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:55.389770+0000","last_peered":"2024-09-20T21:05:55.389770+0000","last_clean":"2024-09-20T21:05:55.389770+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:55.389770+0000","last_undegraded":"2024-09-20T21:05:55.389770+0000","last_fullsized":"2024-09-20T21:05:55.389770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:41.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393613+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:55.393613+0000","last_peered":"2024-09-20T21:05:55.393613+0000","last_clean":"2024-09-20T21:05:55.393613+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:55.393613+0000","last_undegraded":"2024-09-20T21:05:55.393613+0000","last_fullsized":"2024-09-20T21:05:55.393613+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:04.604590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115866+0000","last_change":"2024-09-20T21:05:54.126691+0000","last_active":"2024-09-20T21:05:55.115866+0000","last_peered":"2024-09-20T21:05:55.115866+0000","last_clean":"2024-09-20T21:05:55.115866+0000","last_became_active":"2024-09-20T21:05:54.124815+0000","last_became_peered":"2024-09-20T21:05:54.124815+0000","last_unstale":"2024-09-20T21:05:55.115866+0000","last_undegraded":"2024-09-20T21:05:55.115866+0000","last_fullsized":"2024-09-20T21:05:55.115866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117867+0000","last_change":"2024-09-20T21:05:54.121201+0000","last_active":"2024-09-20T21:05:55.117867+0000","last_peered":"2024-09-20T21:05:55.117867+0000","last_clean":"2024-09-20T21:05:55.117867+0000","last_became_active":"2024-09-20T21:05:54.119189+0000","last_became_peered":"2024-09-20T21:05:54.119189+0000","last_unstale":"2024-09-20T21:05:55.117867+0000","last_undegraded":"2024-09-20T21:05:55.117867+0000","last_fullsized":"2024-09-20T21:05:55.117867+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:15.290334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.115927+0000","last_change":"2024-09-20T21:05:54.130286+0000","last_active":"2024-09-20T21:05:55.115927+0000","last_peered":"2024-09-20T21:05:55.115927+0000","last_clean":"2024-09-20T21:05:55.115927+0000","last_became_active":"2024-09-20T21:05:54.127969+0000","last_became_peered":"2024-09-20T21:05:54.127969+0000","last_unstale":"2024-09-20T21:05:55.115927+0000","last_undegraded":"2024-09-20T21:05:55.115927+0000","last_fullsized":"2024-09-20T21:05:55.115927+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:27.343016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392395+0000","last_change":"2024-09-20T21:05:33.529620+0000","last_active":"2024-09-20T21:05:55.392395+0000","last_peered":"2024-09-20T21:05:55.392395+0000","last_clean":"2024-09-20T21:05:55.392395+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:05:55.392395+0000","last_undegraded":"2024-09-20T21:05:55.392395+0000","last_fullsized":"2024-09-20T21:05:55.392395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:39.374497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391679+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:55.391679+0000","last_peered":"2024-09-20T21:05:55.391679+0000","last_clean":"2024-09-20T21:05:55.391679+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:55.391679+0000","last_undegraded":"2024-09-20T21:05:55.391679+0000","last_fullsized":"2024-09-20T21:05:55.391679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:30.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391647+0000","last_change":"2024-09-20T21:05:33.516924+0000","last_active":"2024-09-20T21:05:55.391647+0000","last_peered":"2024-09-20T21:05:55.391647+0000","last_clean":"2024-09-20T21:05:55.391647+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:05:55.391647+0000","last_undegraded":"2024-09-20T21:05:55.391647+0000","last_fullsized":"2024-09-20T21:05:55.391647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:55.590471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122171+0000","last_change":"2024-09-20T21:05:45.324359+0000","last_active":"2024-09-20T21:05:55.122171+0000","last_peered":"2024-09-20T21:05:55.122171+0000","last_clean":"2024-09-20T21:05:55.122171+0000","last_became_active":"2024-09-20T21:05:45.321407+0000","last_became_peered":"2024-09-20T21:05:45.321407+0000","last_unstale":"2024-09-20T21:05:55.122171+0000","last_undegraded":"2024-09-20T21:05:55.122171+0000","last_fullsized":"2024-09-20T21:05:55.122171+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123544+0000","last_change":"2024-09-20T21:05:34.264426+0000","last_active":"2024-09-20T21:05:55.123544+0000","last_peered":"2024-09-20T21:05:55.123544+0000","last_clean":"2024-09-20T21:05:55.123544+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:05:55.123544+0000","last_undegraded":"2024-09-20T21:05:55.123544+0000","last_fullsized":"2024-09-20T21:05:55.123544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:23.886272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392114+0000","last_change":"2024-09-20T21:05:33.517281+0000","last_active":"2024-09-20T21:05:55.392114+0000","last_peered":"2024-09-20T21:05:55.392114+0000","last_clean":"2024-09-20T21:05:55.392114+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:05:55.392114+0000","last_undegraded":"2024-09-20T21:05:55.392114+0000","last_fullsized":"2024-09-20T21:05:55.392114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:44.497231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492414+0000","last_change":"2024-09-20T21:05:55.492414+0000","last_active":"2024-09-20T21:05:55.492414+0000","last_peered":"2024-09-20T21:05:55.492414+0000","last_clean":"2024-09-20T21:05:55.492414+0000","last_became_active":"2024-09-20T21:05:55.491897+0000","last_became_peered":"2024-09-20T21:05:55.491897+0000","last_unstale":"2024-09-20T21:05:55.492414+0000","last_undegraded":"2024-09-20T21:05:55.492414+0000","last_fullsized":"2024-09-20T21:05:55.492414+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:23.615352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392280+0000","last_change":"2024-09-20T21:05:33.527473+0000","last_active":"2024-09-20T21:05:55.392280+0000","last_peered":"2024-09-20T21:05:55.392280+0000","last_clean":"2024-09-20T21:05:55.392280+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:05:55.392280+0000","last_undegraded":"2024-09-20T21:05:55.392280+0000","last_fullsized":"2024-09-20T21:05:55.392280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:43.880199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116681+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:55.116681+0000","last_peered":"2024-09-20T21:05:55.116681+0000","last_clean":"2024-09-20T21:05:55.116681+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:55.116681+0000","last_undegraded":"2024-09-20T21:05:55.116681+0000","last_fullsized":"2024-09-20T21:05:55.116681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:06:41.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393346+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:55.393346+0000","last_peered":"2024-09-20T21:05:55.393346+0000","last_clean":"2024-09-20T21:05:55.393346+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:55.393346+0000","last_undegraded":"2024-09-20T21:05:55.393346+0000","last_fullsized":"2024-09-20T21:05:55.393346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:57.275101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116157+0000","last_change":"2024-09-20T21:05:54.121694+0000","last_active":"2024-09-20T21:05:55.116157+0000","last_peered":"2024-09-20T21:05:55.116157+0000","last_clean":"2024-09-20T21:05:55.116157+0000","last_became_active":"2024-09-20T21:05:54.120855+0000","last_became_peered":"2024-09-20T21:05:54.120855+0000","last_unstale":"2024-09-20T21:05:55.116157+0000","last_undegraded":"2024-09-20T21:05:55.116157+0000","last_fullsized":"2024-09-20T21:05:55.116157+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:11.887662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123467+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:05:55.123467+0000","last_peered":"2024-09-20T21:05:55.123467+0000","last_clean":"2024-09-20T21:05:55.123467+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:05:55.123467+0000","last_undegraded":"2024-09-20T21:05:55.123467+0000","last_fullsized":"2024-09-20T21:05:55.123467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":273,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389638+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:55.389638+0000","last_peered":"2024-09-20T21:05:55.389638+0000","last_clean":"2024-09-20T21:05:55.389638+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:55.389638+0000","last_undegraded":"2024-09-20T21:05:55.389638+0000","last_fullsized":"2024-09-20T21:05:55.389638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:49.545054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390696+0000","last_change":"2024-09-20T21:05:33.516926+0000","last_active":"2024-09-20T21:05:55.390696+0000","last_peered":"2024-09-20T21:05:55.390696+0000","last_clean":"2024-09-20T21:05:55.390696+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:05:55.390696+0000","last_undegraded":"2024-09-20T21:05:55.390696+0000","last_fullsized":"2024-09-20T21:05:55.390696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:48.429167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123236+0000","last_change":"2024-09-20T21:05:37.268775+0000","last_active":"2024-09-20T21:05:55.123236+0000","last_peered":"2024-09-20T21:05:55.123236+0000","last_clean":"2024-09-20T21:05:55.123236+0000","last_became_active":"2024-09-20T21:05:37.267211+0000","last_became_peered":"2024-09-20T21:05:37.267211+0000","last_unstale":"2024-09-20T21:05:55.123236+0000","last_undegraded":"2024-09-20T21:05:55.123236+0000","last_fullsized":"2024-09-20T21:05:55.123236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:50.497847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392545+0000","last_change":"2024-09-20T21:05:33.527863+0000","last_active":"2024-09-20T21:05:55.392545+0000","last_peered":"2024-09-20T21:05:55.392545+0000","last_clean":"2024-09-20T21:05:55.392545+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:05:55.392545+0000","last_undegraded":"2024-09-20T21:05:55.392545+0000","last_fullsized":"2024-09-20T21:05:55.392545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:28.039071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390092+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:55.390092+0000","last_peered":"2024-09-20T21:05:55.390092+0000","last_clean":"2024-09-20T21:05:55.390092+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:55.390092+0000","last_undegraded":"2024-09-20T21:05:55.390092+0000","last_fullsized":"2024-09-20T21:05:55.390092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:58.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124493+0000","last_change":"2024-09-20T21:05:45.323068+0000","last_active":"2024-09-20T21:05:55.124493+0000","last_peered":"2024-09-20T21:05:55.124493+0000","last_clean":"2024-09-20T21:05:55.124493+0000","last_became_active":"2024-09-20T21:05:45.321160+0000","last_became_peered":"2024-09-20T21:05:45.321160+0000","last_unstale":"2024-09-20T21:05:55.124493+0000","last_undegraded":"2024-09-20T21:05:55.124493+0000","last_fullsized":"2024-09-20T21:05:55.124493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:32.144771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117798+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:55.117798+0000","last_peered":"2024-09-20T21:05:55.117798+0000","last_clean":"2024-09-20T21:05:55.117798+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:55.117798+0000","last_undegraded":"2024-09-20T21:05:55.117798+0000","last_fullsized":"2024-09-20T21:05:55.117798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124734+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:55.124734+0000","last_peered":"2024-09-20T21:05:55.124734+0000","last_clean":"2024-09-20T21:05:55.124734+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:55.124734+0000","last_undegraded":"2024-09-20T21:05:55.124734+0000","last_fullsized":"2024-09-20T21:05:55.124734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116320+0000","last_change":"2024-09-20T21:05:54.126982+0000","last_active":"2024-09-20T21:05:55.116320+0000","last_peered":"2024-09-20T21:05:55.116320+0000","last_clean":"2024-09-20T21:05:55.116320+0000","last_became_active":"2024-09-20T21:05:54.121776+0000","last_became_peered":"2024-09-20T21:05:54.121776+0000","last_unstale":"2024-09-20T21:05:55.116320+0000","last_undegraded":"2024-09-20T21:05:55.116320+0000","last_fullsized":"2024-09-20T21:05:55.116320+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:46.297334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":114,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123656+0000","last_change":"2024-09-20T21:05:52.101432+0000","last_active":"2024-09-20T21:05:55.123656+0000","last_peered":"2024-09-20T21:05:55.123656+0000","last_clean":"2024-09-20T21:05:55.123656+0000","last_became_active":"2024-09-20T21:05:52.100421+0000","last_became_peered":"2024-09-20T21:05:52.100421+0000","last_unstale":"2024-09-20T21:05:55.123656+0000","last_undegraded":"2024-09-20T21:05:55.123656+0000","last_fullsized":"2024-09-20T21:05:55.123656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390114+0000","last_change":"2024-09-20T21:05:33.525394+0000","last_active":"2024-09-20T21:05:55.390114+0000","last_peered":"2024-09-20T21:05:55.390114+0000","last_clean":"2024-09-20T21:05:55.390114+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:05:55.390114+0000","last_undegraded":"2024-09-20T21:05:55.390114+0000","last_fullsized":"2024-09-20T21:05:55.390114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:51:33.922257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390976+0000","last_change":"2024-09-20T21:05:33.522984+0000","last_active":"2024-09-20T21:05:55.390976+0000","last_peered":"2024-09-20T21:05:55.390976+0000","last_clean":"2024-09-20T21:05:55.390976+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:05:55.390976+0000","last_undegraded":"2024-09-20T21:05:55.390976+0000","last_fullsized":"2024-09-20T21:05:55.390976+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:22:14.870718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":120,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124538+0000","last_change":"2024-09-20T21:05:45.331015+0000","last_active":"2024-09-20T21:05:55.124538+0000","last_peered":"2024-09-20T21:05:55.124538+0000","last_clean":"2024-09-20T21:05:55.124538+0000","last_became_active":"2024-09-20T21:05:45.330361+0000","last_became_peered":"2024-09-20T21:05:45.330361+0000","last_unstale":"2024-09-20T21:05:55.124538+0000","last_undegraded":"2024-09-20T21:05:55.124538+0000","last_fullsized":"2024-09-20T21:05:55.124538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390741+0000","last_change":"2024-09-20T21:05:33.530100+0000","last_active":"2024-09-20T21:05:55.390741+0000","last_peered":"2024-09-20T21:05:55.390741+0000","last_clean":"2024-09-20T21:05:55.390741+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:05:55.390741+0000","last_undegraded":"2024-09-20T21:05:55.390741+0000","last_fullsized":"2024-09-20T21:05:55.390741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:12.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124786+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:55.124786+0000","last_peered":"2024-09-20T21:05:55.124786+0000","last_clean":"2024-09-20T21:05:55.124786+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:55.124786+0000","last_undegraded":"2024-09-20T21:05:55.124786+0000","last_fullsized":"2024-09-20T21:05:55.124786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116170+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:55.116170+0000","last_peered":"2024-09-20T21:05:55.116170+0000","last_clean":"2024-09-20T21:05:55.116170+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:55.116170+0000","last_undegraded":"2024-09-20T21:05:55.116170+0000","last_fullsized":"2024-09-20T21:05:55.116170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:03.961332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124581+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:55.124581+0000","last_peered":"2024-09-20T21:05:55.124581+0000","last_clean":"2024-09-20T21:05:55.124581+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:55.124581+0000","last_undegraded":"2024-09-20T21:05:55.124581+0000","last_fullsized":"2024-09-20T21:05:55.124581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.118157+0000","last_change":"2024-09-20T21:05:54.121905+0000","last_active":"2024-09-20T21:05:55.118157+0000","last_peered":"2024-09-20T21:05:55.118157+0000","last_clean":"2024-09-20T21:05:55.118157+0000","last_became_active":"2024-09-20T21:05:54.121064+0000","last_became_peered":"2024-09-20T21:05:54.121064+0000","last_unstale":"2024-09-20T21:05:55.118157+0000","last_undegraded":"2024-09-20T21:05:55.118157+0000","last_fullsized":"2024-09-20T21:05:55.118157+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:54:14.429868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116445+0000","last_change":"2024-09-20T21:05:54.132710+0000","last_active":"2024-09-20T21:05:55.116445+0000","last_peered":"2024-09-20T21:05:55.116445+0000","last_clean":"2024-09-20T21:05:55.116445+0000","last_became_active":"2024-09-20T21:05:54.127863+0000","last_became_peered":"2024-09-20T21:05:54.127863+0000","last_unstale":"2024-09-20T21:05:55.116445+0000","last_undegraded":"2024-09-20T21:05:55.116445+0000","last_fullsized":"2024-09-20T21:05:55.116445+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:59.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124756+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:55.124756+0000","last_peered":"2024-09-20T21:05:55.124756+0000","last_clean":"2024-09-20T21:05:55.124756+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:55.124756+0000","last_undegraded":"2024-09-20T21:05:55.124756+0000","last_fullsized":"2024-09-20T21:05:55.124756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124399+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:05:55.124399+0000","last_peered":"2024-09-20T21:05:55.124399+0000","last_clean":"2024-09-20T21:05:55.124399+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:05:55.124399+0000","last_undegraded":"2024-09-20T21:05:55.124399+0000","last_fullsized":"2024-09-20T21:05:55.124399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123360+0000","last_change":"2024-09-20T21:05:37.267287+0000","last_active":"2024-09-20T21:05:55.123360+0000","last_peered":"2024-09-20T21:05:55.123360+0000","last_clean":"2024-09-20T21:05:55.123360+0000","last_became_active":"2024-09-20T21:05:37.266438+0000","last_became_peered":"2024-09-20T21:05:37.266438+0000","last_unstale":"2024-09-20T21:05:55.123360+0000","last_undegraded":"2024-09-20T21:05:55.123360+0000","last_fullsized":"2024-09-20T21:05:55.123360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124163+0000","last_change":"2024-09-20T21:05:34.264862+0000","last_active":"2024-09-20T21:05:55.124163+0000","last_peered":"2024-09-20T21:05:55.124163+0000","last_clean":"2024-09-20T21:05:55.124163+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:05:55.124163+0000","last_undegraded":"2024-09-20T21:05:55.124163+0000","last_fullsized":"2024-09-20T21:05:55.124163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:32.512356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.395346+0000","last_change":"2024-09-20T21:05:55.395346+0000","last_active":"2024-09-20T21:05:55.395346+0000","last_peered":"2024-09-20T21:05:55.395346+0000","last_clean":"2024-09-20T21:05:55.395346+0000","last_became_active":"2024-09-20T21:05:55.394868+0000","last_became_peered":"2024-09-20T21:05:55.394868+0000","last_unstale":"2024-09-20T21:05:55.395346+0000","last_undegraded":"2024-09-20T21:05:55.395346+0000","last_fullsized":"2024-09-20T21:05:55.395346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:38.909352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116571+0000","last_change":"2024-09-20T21:05:54.121933+0000","last_active":"2024-09-20T21:05:55.116571+0000","last_peered":"2024-09-20T21:05:55.116571+0000","last_clean":"2024-09-20T21:05:55.116571+0000","last_became_active":"2024-09-20T21:05:54.119503+0000","last_became_peered":"2024-09-20T21:05:54.119503+0000","last_unstale":"2024-09-20T21:05:55.116571+0000","last_undegraded":"2024-09-20T21:05:55.116571+0000","last_fullsized":"2024-09-20T21:05:55.116571+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:02.194094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391433+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:55.391433+0000","last_peered":"2024-09-20T21:05:55.391433+0000","last_clean":"2024-09-20T21:05:55.391433+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:55.391433+0000","last_undegraded":"2024-09-20T21:05:55.391433+0000","last_fullsized":"2024-09-20T21:05:55.391433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:49.172273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390555+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:55.390555+0000","last_peered":"2024-09-20T21:05:55.390555+0000","last_clean":"2024-09-20T21:05:55.390555+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:55.390555+0000","last_undegraded":"2024-09-20T21:05:55.390555+0000","last_fullsized":"2024-09-20T21:05:55.390555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:07:07.242939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122199+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:05:55.122199+0000","last_peered":"2024-09-20T21:05:55.122199+0000","last_clean":"2024-09-20T21:05:55.122199+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:05:55.122199+0000","last_undegraded":"2024-09-20T21:05:55.122199+0000","last_fullsized":"2024-09-20T21:05:55.122199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117882+0000","last_change":"2024-09-20T21:05:54.130634+0000","last_active":"2024-09-20T21:05:55.117882+0000","last_peered":"2024-09-20T21:05:55.117882+0000","last_clean":"2024-09-20T21:05:55.117882+0000","last_became_active":"2024-09-20T21:05:54.128221+0000","last_became_peered":"2024-09-20T21:05:54.128221+0000","last_unstale":"2024-09-20T21:05:55.117882+0000","last_undegraded":"2024-09-20T21:05:55.117882+0000","last_fullsized":"2024-09-20T21:05:55.117882+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:37.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392938+0000","last_change":"2024-09-20T21:05:33.525151+0000","last_active":"2024-09-20T21:05:55.392938+0000","last_peered":"2024-09-20T21:05:55.392938+0000","last_clean":"2024-09-20T21:05:55.392938+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:05:55.392938+0000","last_undegraded":"2024-09-20T21:05:55.392938+0000","last_fullsized":"2024-09-20T21:05:55.392938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:51.245496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123714+0000","last_change":"2024-09-20T21:05:52.104238+0000","last_active":"2024-09-20T21:05:55.123714+0000","last_peered":"2024-09-20T21:05:55.123714+0000","last_clean":"2024-09-20T21:05:55.123714+0000","last_became_active":"2024-09-20T21:05:52.103630+0000","last_became_peered":"2024-09-20T21:05:52.103630+0000","last_unstale":"2024-09-20T21:05:55.123714+0000","last_undegraded":"2024-09-20T21:05:55.123714+0000","last_fullsized":"2024-09-20T21:05:55.123714+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.124560+0000","last_change":"2024-09-20T21:05:34.264735+0000","last_active":"2024-09-20T21:05:55.124560+0000","last_peered":"2024-09-20T21:05:55.124560+0000","last_clean":"2024-09-20T21:05:55.124560+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:05:55.124560+0000","last_undegraded":"2024-09-20T21:05:55.124560+0000","last_fullsized":"2024-09-20T21:05:55.124560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:16.718841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.120856+0000","last_change":"2024-09-20T21:05:52.100914+0000","last_active":"2024-09-20T21:05:55.120856+0000","last_peered":"2024-09-20T21:05:55.120856+0000","last_clean":"2024-09-20T21:05:55.120856+0000","last_became_active":"2024-09-20T21:05:52.100104+0000","last_became_peered":"2024-09-20T21:05:52.100104+0000","last_unstale":"2024-09-20T21:05:55.120856+0000","last_undegraded":"2024-09-20T21:05:55.120856+0000","last_fullsized":"2024-09-20T21:05:55.120856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:51:38.241935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117935+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:55.117935+0000","last_peered":"2024-09-20T21:05:55.117935+0000","last_clean":"2024-09-20T21:05:55.117935+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:55.117935+0000","last_undegraded":"2024-09-20T21:05:55.117935+0000","last_fullsized":"2024-09-20T21:05:55.117935+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:39.486200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.121098+0000","last_change":"2024-09-20T21:05:37.269662+0000","last_active":"2024-09-20T21:05:55.121098+0000","last_peered":"2024-09-20T21:05:55.121098+0000","last_clean":"2024-09-20T21:05:55.121098+0000","last_became_active":"2024-09-20T21:05:37.268982+0000","last_became_peered":"2024-09-20T21:05:37.268982+0000","last_unstale":"2024-09-20T21:05:55.121098+0000","last_undegraded":"2024-09-20T21:05:55.121098+0000","last_fullsized":"2024-09-20T21:05:55.121098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:38.474304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122329+0000","last_change":"2024-09-20T21:05:45.321820+0000","last_active":"2024-09-20T21:05:55.122329+0000","last_peered":"2024-09-20T21:05:55.122329+0000","last_clean":"2024-09-20T21:05:55.122329+0000","last_became_active":"2024-09-20T21:05:45.320924+0000","last_became_peered":"2024-09-20T21:05:45.320924+0000","last_unstale":"2024-09-20T21:05:55.122329+0000","last_undegraded":"2024-09-20T21:05:55.122329+0000","last_fullsized":"2024-09-20T21:05:55.122329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:18:23.772854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123853+0000","last_change":"2024-09-20T21:05:45.321935+0000","last_active":"2024-09-20T21:05:55.123853+0000","last_peered":"2024-09-20T21:05:55.123853+0000","last_clean":"2024-09-20T21:05:55.123853+0000","last_became_active":"2024-09-20T21:05:45.321031+0000","last_became_peered":"2024-09-20T21:05:45.321031+0000","last_unstale":"2024-09-20T21:05:55.123853+0000","last_undegraded":"2024-09-20T21:05:55.123853+0000","last_fullsized":"2024-09-20T21:05:55.123853+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:01.849318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117259+0000","last_change":"2024-09-20T21:05:54.127603+0000","last_active":"2024-09-20T21:05:55.117259+0000","last_peered":"2024-09-20T21:05:55.117259+0000","last_clean":"2024-09-20T21:05:55.117259+0000","last_became_active":"2024-09-20T21:05:54.125123+0000","last_became_peered":"2024-09-20T21:05:54.125123+0000","last_unstale":"2024-09-20T21:05:55.117259+0000","last_undegraded":"2024-09-20T21:05:55.117259+0000","last_fullsized":"2024-09-20T21:05:55.117259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:43:09.663833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116468+0000","last_change":"2024-09-20T21:05:54.122334+0000","last_active":"2024-09-20T21:05:55.116468+0000","last_peered":"2024-09-20T21:05:55.116468+0000","last_clean":"2024-09-20T21:05:55.116468+0000","last_became_active":"2024-09-20T21:05:54.121466+0000","last_became_peered":"2024-09-20T21:05:54.121466+0000","last_unstale":"2024-09-20T21:05:55.116468+0000","last_undegraded":"2024-09-20T21:05:55.116468+0000","last_fullsized":"2024-09-20T21:05:55.116468+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:41.667343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":122,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117020+0000","last_change":"2024-09-20T21:05:54.132657+0000","last_active":"2024-09-20T21:05:55.117020+0000","last_peered":"2024-09-20T21:05:55.117020+0000","last_clean":"2024-09-20T21:05:55.117020+0000","last_became_active":"2024-09-20T21:05:54.129891+0000","last_became_peered":"2024-09-20T21:05:54.129891+0000","last_unstale":"2024-09-20T21:05:55.117020+0000","last_undegraded":"2024-09-20T21:05:55.117020+0000","last_fullsized":"2024-09-20T21:05:55.117020+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:26.911986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116983+0000","last_change":"2024-09-20T21:05:54.127321+0000","last_active":"2024-09-20T21:05:55.116983+0000","last_peered":"2024-09-20T21:05:55.116983+0000","last_clean":"2024-09-20T21:05:55.116983+0000","last_became_active":"2024-09-20T21:05:54.120527+0000","last_became_peered":"2024-09-20T21:05:54.120527+0000","last_unstale":"2024-09-20T21:05:55.116983+0000","last_undegraded":"2024-09-20T21:05:55.116983+0000","last_fullsized":"2024-09-20T21:05:55.116983+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:25.400362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391620+0000","last_change":"2024-09-20T21:05:33.523783+0000","last_active":"2024-09-20T21:05:55.391620+0000","last_peered":"2024-09-20T21:05:55.391620+0000","last_clean":"2024-09-20T21:05:55.391620+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:05:55.391620+0000","last_undegraded":"2024-09-20T21:05:55.391620+0000","last_fullsized":"2024-09-20T21:05:55.391620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:29.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391369+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:55.391369+0000","last_peered":"2024-09-20T21:05:55.391369+0000","last_clean":"2024-09-20T21:05:55.391369+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:55.391369+0000","last_undegraded":"2024-09-20T21:05:55.391369+0000","last_fullsized":"2024-09-20T21:05:55.391369+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:45:47.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390604+0000","last_change":"2024-09-20T21:05:33.525036+0000","last_active":"2024-09-20T21:05:55.390604+0000","last_peered":"2024-09-20T21:05:55.390604+0000","last_clean":"2024-09-20T21:05:55.390604+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:05:55.390604+0000","last_undegraded":"2024-09-20T21:05:55.390604+0000","last_fullsized":"2024-09-20T21:05:55.390604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:13.120671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.117548+0000","last_change":"2024-09-20T21:05:54.126814+0000","last_active":"2024-09-20T21:05:55.117548+0000","last_peered":"2024-09-20T21:05:55.117548+0000","last_clean":"2024-09-20T21:05:55.117548+0000","last_became_active":"2024-09-20T21:05:54.124075+0000","last_became_peered":"2024-09-20T21:05:54.124075+0000","last_unstale":"2024-09-20T21:05:55.117548+0000","last_undegraded":"2024-09-20T21:05:55.117548+0000","last_fullsized":"2024-09-20T21:05:55.117548+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:18.839315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.116829+0000","last_change":"2024-09-20T21:05:54.122485+0000","last_active":"2024-09-20T21:05:55.116829+0000","last_peered":"2024-09-20T21:05:55.116829+0000","last_clean":"2024-09-20T21:05:55.116829+0000","last_became_active":"2024-09-20T21:05:54.121408+0000","last_became_peered":"2024-09-20T21:05:54.121408+0000","last_unstale":"2024-09-20T21:05:55.116829+0000","last_undegraded":"2024-09-20T21:05:55.116829+0000","last_fullsized":"2024-09-20T21:05:55.116829+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:36.479778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.123681+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:55.123681+0000","last_peered":"2024-09-20T21:05:55.123681+0000","last_clean":"2024-09-20T21:05:55.123681+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:55.123681+0000","last_undegraded":"2024-09-20T21:05:55.123681+0000","last_fullsized":"2024-09-20T21:05:55.123681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390271+0000","last_change":"2024-09-20T21:05:33.529399+0000","last_active":"2024-09-20T21:05:55.390271+0000","last_peered":"2024-09-20T21:05:55.390271+0000","last_clean":"2024-09-20T21:05:55.390271+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:05:55.390271+0000","last_undegraded":"2024-09-20T21:05:55.390271+0000","last_fullsized":"2024-09-20T21:05:55.390271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:36.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.122854+0000","last_change":"2024-09-20T21:05:45.323879+0000","last_active":"2024-09-20T21:05:55.122854+0000","last_peered":"2024-09-20T21:05:55.122854+0000","last_clean":"2024-09-20T21:05:55.122854+0000","last_became_active":"2024-09-20T21:05:45.321268+0000","last_became_peered":"2024-09-20T21:05:45.321268+0000","last_unstale":"2024-09-20T21:05:55.122854+0000","last_undegraded":"2024-09-20T21:05:55.122854+0000","last_fullsized":"2024-09-20T21:05:55.122854+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:53.346461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216928,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94154912,"statfs":{"total":96636764160,"available":96414629888,"internally_reserved":0,"allocated":1118208,"data_stored":1000114,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350983,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54640,"kb_used_data":1112,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317200,"statfs":{"total":96636764160,"available":96580812800,"internally_reserved":0,"allocated":1138688,"data_stored":1004981,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325140,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046700,"statfs":{"total":96636764160,"available":96303820800,"internally_reserved":0,"allocated":1044480,"data_stored":408587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:05:59.758 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:06:00.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:06:00.096 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":95,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:05:56.110600+0000","last_up_change":"2024-09-20T21:05:33.199849+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T21:01:05.455429+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T21:01:10.047761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T21:01:10.524533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":47,"up_from":81,"up_thru":94,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6801","nonce":1262267524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6803","nonce":1262267524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6807","nonce":1262267524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6805","nonce":1262267524}]},"public_addr":"172.21.15.161:6801/1262267524","cluster_addr":"172.21.15.161:6803/1262267524","heartbeat_back_addr":"172.21.15.161:6807/1262267524","heartbeat_front_addr":"172.21.15.161:6805/1262267524","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":47},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:06:01.115 INFO:tasks.ceph:Scrubbing osd.0 2024-09-20T21:06:01.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-20T21:06:01.278 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-20T21:06:01.279 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-20T21:06:01.279 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-20T21:06:01.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-20T21:06:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 0 to deep-scrub 2024-09-20T21:06:01.600 INFO:tasks.ceph:Scrubbing osd.1 2024-09-20T21:06:01.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-20T21:06:01.752 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-20T21:06:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-20T21:06:01.753 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-20T21:06:01.769 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-20T21:06:02.043 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 1 to deep-scrub 2024-09-20T21:06:02.061 INFO:tasks.ceph:Scrubbing osd.2 2024-09-20T21:06:02.062 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-20T21:06:02.211 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-20T21:06:02.211 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-20T21:06:02.211 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-20T21:06:02.227 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-20T21:06:02.517 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 2 to deep-scrub 2024-09-20T21:06:02.534 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:06:02.818 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:06:02.820 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:06:02.835 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-20T21:06:00.993412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596712,"kb_used_data":3240,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282518808,"statfs":{"total":289910292480,"available":289299259392,"internally_reserved":0,"allocated":3317760,"data_stored":2422146,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.890729"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":115,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.120198+0000","last_change":"2024-09-20T21:05:54.129746+0000","last_active":"2024-09-20T21:05:56.120198+0000","last_peered":"2024-09-20T21:05:56.120198+0000","last_clean":"2024-09-20T21:05:56.120198+0000","last_became_active":"2024-09-20T21:05:54.127664+0000","last_became_peered":"2024-09-20T21:05:54.127664+0000","last_unstale":"2024-09-20T21:05:56.120198+0000","last_undegraded":"2024-09-20T21:05:56.120198+0000","last_fullsized":"2024-09-20T21:05:56.120198+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:57.952046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":121,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119019+0000","last_change":"2024-09-20T21:05:54.126721+0000","last_active":"2024-09-20T21:05:56.119019+0000","last_peered":"2024-09-20T21:05:56.119019+0000","last_clean":"2024-09-20T21:05:56.119019+0000","last_became_active":"2024-09-20T21:05:54.124269+0000","last_became_peered":"2024-09-20T21:05:54.124269+0000","last_unstale":"2024-09-20T21:05:56.119019+0000","last_undegraded":"2024-09-20T21:05:56.119019+0000","last_fullsized":"2024-09-20T21:05:56.119019+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393027+0000","last_change":"2024-09-20T21:05:33.529595+0000","last_active":"2024-09-20T21:05:55.393027+0000","last_peered":"2024-09-20T21:05:55.393027+0000","last_clean":"2024-09-20T21:05:55.393027+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:05:55.393027+0000","last_undegraded":"2024-09-20T21:05:55.393027+0000","last_fullsized":"2024-09-20T21:05:55.393027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:08.234369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391440+0000","last_change":"2024-09-20T21:05:33.516896+0000","last_active":"2024-09-20T21:05:55.391440+0000","last_peered":"2024-09-20T21:05:55.391440+0000","last_clean":"2024-09-20T21:05:55.391440+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:05:55.391440+0000","last_undegraded":"2024-09-20T21:05:55.391440+0000","last_fullsized":"2024-09-20T21:05:55.391440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:48.472114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":114,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119215+0000","last_change":"2024-09-20T21:05:54.130938+0000","last_active":"2024-09-20T21:05:56.119215+0000","last_peered":"2024-09-20T21:05:56.119215+0000","last_clean":"2024-09-20T21:05:56.119215+0000","last_became_active":"2024-09-20T21:05:54.125511+0000","last_became_peered":"2024-09-20T21:05:54.125511+0000","last_unstale":"2024-09-20T21:05:56.119215+0000","last_undegraded":"2024-09-20T21:05:56.119215+0000","last_fullsized":"2024-09-20T21:05:56.119215+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:55.659526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391460+0000","last_change":"2024-09-20T21:05:33.526021+0000","last_active":"2024-09-20T21:05:55.391460+0000","last_peered":"2024-09-20T21:05:55.391460+0000","last_clean":"2024-09-20T21:05:55.391460+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:05:55.391460+0000","last_undegraded":"2024-09-20T21:05:55.391460+0000","last_fullsized":"2024-09-20T21:05:55.391460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:51.022212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492841+0000","last_change":"2024-09-20T21:05:55.492841+0000","last_active":"2024-09-20T21:05:55.492841+0000","last_peered":"2024-09-20T21:05:55.492841+0000","last_clean":"2024-09-20T21:05:55.492841+0000","last_became_active":"2024-09-20T21:05:55.492104+0000","last_became_peered":"2024-09-20T21:05:55.492104+0000","last_unstale":"2024-09-20T21:05:55.492841+0000","last_undegraded":"2024-09-20T21:05:55.492841+0000","last_fullsized":"2024-09-20T21:05:55.492841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.580757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390006+0000","last_change":"2024-09-20T21:05:33.527599+0000","last_active":"2024-09-20T21:05:55.390006+0000","last_peered":"2024-09-20T21:05:55.390006+0000","last_clean":"2024-09-20T21:05:55.390006+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:05:55.390006+0000","last_undegraded":"2024-09-20T21:05:55.390006+0000","last_fullsized":"2024-09-20T21:05:55.390006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:19:18.002155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":122,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217869+0000","last_change":"2024-09-20T21:05:45.329452+0000","last_active":"2024-09-20T21:05:56.217869+0000","last_peered":"2024-09-20T21:05:56.217869+0000","last_clean":"2024-09-20T21:05:56.217869+0000","last_became_active":"2024-09-20T21:05:45.327207+0000","last_became_peered":"2024-09-20T21:05:45.327207+0000","last_unstale":"2024-09-20T21:05:56.217869+0000","last_undegraded":"2024-09-20T21:05:56.217869+0000","last_fullsized":"2024-09-20T21:05:56.217869+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:42.075068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":114,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119123+0000","last_change":"2024-09-20T21:05:54.126680+0000","last_active":"2024-09-20T21:05:56.119123+0000","last_peered":"2024-09-20T21:05:56.119123+0000","last_clean":"2024-09-20T21:05:56.119123+0000","last_became_active":"2024-09-20T21:05:54.124291+0000","last_became_peered":"2024-09-20T21:05:54.124291+0000","last_unstale":"2024-09-20T21:05:56.119123+0000","last_undegraded":"2024-09-20T21:05:56.119123+0000","last_fullsized":"2024-09-20T21:05:56.119123+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:05.334214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392938+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:55.392938+0000","last_peered":"2024-09-20T21:05:55.392938+0000","last_clean":"2024-09-20T21:05:55.392938+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:55.392938+0000","last_undegraded":"2024-09-20T21:05:55.392938+0000","last_fullsized":"2024-09-20T21:05:55.392938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:14:10.131416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119335+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:05:56.119335+0000","last_peered":"2024-09-20T21:05:56.119335+0000","last_clean":"2024-09-20T21:05:56.119335+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:05:56.119335+0000","last_undegraded":"2024-09-20T21:05:56.119335+0000","last_fullsized":"2024-09-20T21:05:56.119335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:51.509743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118688+0000","last_change":"2024-09-20T21:05:54.132356+0000","last_active":"2024-09-20T21:05:56.118688+0000","last_peered":"2024-09-20T21:05:56.118688+0000","last_clean":"2024-09-20T21:05:56.118688+0000","last_became_active":"2024-09-20T21:05:54.128147+0000","last_became_peered":"2024-09-20T21:05:54.128147+0000","last_unstale":"2024-09-20T21:05:56.118688+0000","last_undegraded":"2024-09-20T21:05:56.118688+0000","last_fullsized":"2024-09-20T21:05:56.118688+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:07.742615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391210+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:55.391210+0000","last_peered":"2024-09-20T21:05:55.391210+0000","last_clean":"2024-09-20T21:05:55.391210+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:55.391210+0000","last_undegraded":"2024-09-20T21:05:55.391210+0000","last_fullsized":"2024-09-20T21:05:55.391210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:17.867418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390735+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:55.390735+0000","last_peered":"2024-09-20T21:05:55.390735+0000","last_clean":"2024-09-20T21:05:55.390735+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:55.390735+0000","last_undegraded":"2024-09-20T21:05:55.390735+0000","last_fullsized":"2024-09-20T21:05:55.390735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:36.753632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.490656+0000","last_change":"2024-09-20T21:05:55.490656+0000","last_active":"2024-09-20T21:05:55.490656+0000","last_peered":"2024-09-20T21:05:55.490656+0000","last_clean":"2024-09-20T21:05:55.490656+0000","last_became_active":"2024-09-20T21:05:55.489879+0000","last_became_peered":"2024-09-20T21:05:55.489879+0000","last_unstale":"2024-09-20T21:05:55.490656+0000","last_undegraded":"2024-09-20T21:05:55.490656+0000","last_fullsized":"2024-09-20T21:05:55.490656+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:01.290416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218690+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:56.218690+0000","last_peered":"2024-09-20T21:05:56.218690+0000","last_clean":"2024-09-20T21:05:56.218690+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:56.218690+0000","last_undegraded":"2024-09-20T21:05:56.218690+0000","last_fullsized":"2024-09-20T21:05:56.218690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:23.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119399+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:56.119399+0000","last_peered":"2024-09-20T21:05:56.119399+0000","last_clean":"2024-09-20T21:05:56.119399+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:56.119399+0000","last_undegraded":"2024-09-20T21:05:56.119399+0000","last_fullsized":"2024-09-20T21:05:56.119399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:35:08.728444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":122,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217467+0000","last_change":"2024-09-20T21:05:45.327807+0000","last_active":"2024-09-20T21:05:56.217467+0000","last_peered":"2024-09-20T21:05:56.217467+0000","last_clean":"2024-09-20T21:05:56.217467+0000","last_became_active":"2024-09-20T21:05:45.326913+0000","last_became_peered":"2024-09-20T21:05:45.326913+0000","last_unstale":"2024-09-20T21:05:56.217467+0000","last_undegraded":"2024-09-20T21:05:56.217467+0000","last_fullsized":"2024-09-20T21:05:56.217467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:45.124840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492609+0000","last_change":"2024-09-20T21:05:55.492609+0000","last_active":"2024-09-20T21:05:55.492609+0000","last_peered":"2024-09-20T21:05:55.492609+0000","last_clean":"2024-09-20T21:05:55.492609+0000","last_became_active":"2024-09-20T21:05:55.491995+0000","last_became_peered":"2024-09-20T21:05:55.491995+0000","last_unstale":"2024-09-20T21:05:55.492609+0000","last_undegraded":"2024-09-20T21:05:55.492609+0000","last_fullsized":"2024-09-20T21:05:55.492609+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:00.972806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392131+0000","last_change":"2024-09-20T21:05:33.524928+0000","last_active":"2024-09-20T21:05:55.392131+0000","last_peered":"2024-09-20T21:05:55.392131+0000","last_clean":"2024-09-20T21:05:55.392131+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:05:55.392131+0000","last_undegraded":"2024-09-20T21:05:55.392131+0000","last_fullsized":"2024-09-20T21:05:55.392131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:42.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118361+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:56.118361+0000","last_peered":"2024-09-20T21:05:56.118361+0000","last_clean":"2024-09-20T21:05:56.118361+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:56.118361+0000","last_undegraded":"2024-09-20T21:05:56.118361+0000","last_fullsized":"2024-09-20T21:05:56.118361+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.216512+0000","last_change":"2024-09-20T21:05:52.103930+0000","last_active":"2024-09-20T21:05:56.216512+0000","last_peered":"2024-09-20T21:05:56.216512+0000","last_clean":"2024-09-20T21:05:56.216512+0000","last_became_active":"2024-09-20T21:05:52.103477+0000","last_became_peered":"2024-09-20T21:05:52.103477+0000","last_unstale":"2024-09-20T21:05:56.216512+0000","last_undegraded":"2024-09-20T21:05:56.216512+0000","last_fullsized":"2024-09-20T21:05:56.216512+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":115,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.117973+0000","last_change":"2024-09-20T21:05:54.133334+0000","last_active":"2024-09-20T21:05:56.117973+0000","last_peered":"2024-09-20T21:05:56.117973+0000","last_clean":"2024-09-20T21:05:56.117973+0000","last_became_active":"2024-09-20T21:05:54.129639+0000","last_became_peered":"2024-09-20T21:05:54.129639+0000","last_unstale":"2024-09-20T21:05:56.117973+0000","last_undegraded":"2024-09-20T21:05:56.117973+0000","last_fullsized":"2024-09-20T21:05:56.117973+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.120304+0000","last_change":"2024-09-20T21:05:54.126793+0000","last_active":"2024-09-20T21:05:56.120304+0000","last_peered":"2024-09-20T21:05:56.120304+0000","last_clean":"2024-09-20T21:05:56.120304+0000","last_became_active":"2024-09-20T21:05:54.124757+0000","last_became_peered":"2024-09-20T21:05:54.124757+0000","last_unstale":"2024-09-20T21:05:56.120304+0000","last_undegraded":"2024-09-20T21:05:56.120304+0000","last_fullsized":"2024-09-20T21:05:56.120304+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:46:28.346590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217967+0000","last_change":"2024-09-20T21:05:45.324835+0000","last_active":"2024-09-20T21:05:56.217967+0000","last_peered":"2024-09-20T21:05:56.217967+0000","last_clean":"2024-09-20T21:05:56.217967+0000","last_became_active":"2024-09-20T21:05:45.321767+0000","last_became_peered":"2024-09-20T21:05:45.321767+0000","last_unstale":"2024-09-20T21:05:56.217967+0000","last_undegraded":"2024-09-20T21:05:56.217967+0000","last_fullsized":"2024-09-20T21:05:56.217967+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:16.302231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392754+0000","last_change":"2024-09-20T21:05:33.528984+0000","last_active":"2024-09-20T21:05:55.392754+0000","last_peered":"2024-09-20T21:05:55.392754+0000","last_clean":"2024-09-20T21:05:55.392754+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:05:55.392754+0000","last_undegraded":"2024-09-20T21:05:55.392754+0000","last_fullsized":"2024-09-20T21:05:55.392754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:53.623013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119830+0000","last_change":"2024-09-20T21:05:54.121935+0000","last_active":"2024-09-20T21:05:56.119830+0000","last_peered":"2024-09-20T21:05:56.119830+0000","last_clean":"2024-09-20T21:05:56.119830+0000","last_became_active":"2024-09-20T21:05:54.120990+0000","last_became_peered":"2024-09-20T21:05:54.120990+0000","last_unstale":"2024-09-20T21:05:56.119830+0000","last_undegraded":"2024-09-20T21:05:56.119830+0000","last_fullsized":"2024-09-20T21:05:56.119830+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218094+0000","last_change":"2024-09-20T21:05:37.268677+0000","last_active":"2024-09-20T21:05:56.218094+0000","last_peered":"2024-09-20T21:05:56.218094+0000","last_clean":"2024-09-20T21:05:56.218094+0000","last_became_active":"2024-09-20T21:05:37.267096+0000","last_became_peered":"2024-09-20T21:05:37.267096+0000","last_unstale":"2024-09-20T21:05:56.218094+0000","last_undegraded":"2024-09-20T21:05:56.218094+0000","last_fullsized":"2024-09-20T21:05:56.218094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118937+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:56.118937+0000","last_peered":"2024-09-20T21:05:56.118937+0000","last_clean":"2024-09-20T21:05:56.118937+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:56.118937+0000","last_undegraded":"2024-09-20T21:05:56.118937+0000","last_fullsized":"2024-09-20T21:05:56.118937+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:14.544896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.216668+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:56.216668+0000","last_peered":"2024-09-20T21:05:56.216668+0000","last_clean":"2024-09-20T21:05:56.216668+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:56.216668+0000","last_undegraded":"2024-09-20T21:05:56.216668+0000","last_fullsized":"2024-09-20T21:05:56.216668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:03.832383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389829+0000","last_change":"2024-09-20T21:05:33.520634+0000","last_active":"2024-09-20T21:05:55.389829+0000","last_peered":"2024-09-20T21:05:55.389829+0000","last_clean":"2024-09-20T21:05:55.389829+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:05:55.389829+0000","last_undegraded":"2024-09-20T21:05:55.389829+0000","last_fullsized":"2024-09-20T21:05:55.389829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.341860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":121,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119756+0000","last_change":"2024-09-20T21:05:54.132673+0000","last_active":"2024-09-20T21:05:56.119756+0000","last_peered":"2024-09-20T21:05:56.119756+0000","last_clean":"2024-09-20T21:05:56.119756+0000","last_became_active":"2024-09-20T21:05:54.128119+0000","last_became_peered":"2024-09-20T21:05:54.128119+0000","last_unstale":"2024-09-20T21:05:56.119756+0000","last_undegraded":"2024-09-20T21:05:56.119756+0000","last_fullsized":"2024-09-20T21:05:56.119756+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391078+0000","last_change":"2024-09-20T21:05:33.523453+0000","last_active":"2024-09-20T21:05:55.391078+0000","last_peered":"2024-09-20T21:05:55.391078+0000","last_clean":"2024-09-20T21:05:55.391078+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:05:55.391078+0000","last_undegraded":"2024-09-20T21:05:55.391078+0000","last_fullsized":"2024-09-20T21:05:55.391078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:10:59.275158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":114,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119745+0000","last_change":"2024-09-20T21:05:54.133190+0000","last_active":"2024-09-20T21:05:56.119745+0000","last_peered":"2024-09-20T21:05:56.119745+0000","last_clean":"2024-09-20T21:05:56.119745+0000","last_became_active":"2024-09-20T21:05:54.130889+0000","last_became_peered":"2024-09-20T21:05:54.130889+0000","last_unstale":"2024-09-20T21:05:56.119745+0000","last_undegraded":"2024-09-20T21:05:56.119745+0000","last_fullsized":"2024-09-20T21:05:56.119745+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.216925+0000","last_change":"2024-09-20T21:05:34.265360+0000","last_active":"2024-09-20T21:05:56.216925+0000","last_peered":"2024-09-20T21:05:56.216925+0000","last_clean":"2024-09-20T21:05:56.216925+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:05:56.216925+0000","last_undegraded":"2024-09-20T21:05:56.216925+0000","last_fullsized":"2024-09-20T21:05:56.216925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:02.949435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218595+0000","last_change":"2024-09-20T21:05:34.264103+0000","last_active":"2024-09-20T21:05:56.218595+0000","last_peered":"2024-09-20T21:05:56.218595+0000","last_clean":"2024-09-20T21:05:56.218595+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:05:56.218595+0000","last_undegraded":"2024-09-20T21:05:56.218595+0000","last_fullsized":"2024-09-20T21:05:56.218595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.354082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118360+0000","last_change":"2024-09-20T21:05:54.126994+0000","last_active":"2024-09-20T21:05:56.118360+0000","last_peered":"2024-09-20T21:05:56.118360+0000","last_clean":"2024-09-20T21:05:56.118360+0000","last_became_active":"2024-09-20T21:05:54.124655+0000","last_became_peered":"2024-09-20T21:05:54.124655+0000","last_unstale":"2024-09-20T21:05:56.118360+0000","last_undegraded":"2024-09-20T21:05:56.118360+0000","last_fullsized":"2024-09-20T21:05:56.118360+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:41.063171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217966+0000","last_change":"2024-09-20T21:05:45.324641+0000","last_active":"2024-09-20T21:05:56.217966+0000","last_peered":"2024-09-20T21:05:56.217966+0000","last_clean":"2024-09-20T21:05:56.217966+0000","last_became_active":"2024-09-20T21:05:45.323784+0000","last_became_peered":"2024-09-20T21:05:45.323784+0000","last_unstale":"2024-09-20T21:05:56.217966+0000","last_undegraded":"2024-09-20T21:05:56.217966+0000","last_fullsized":"2024-09-20T21:05:56.217966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:42.679240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389770+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:55.389770+0000","last_peered":"2024-09-20T21:05:55.389770+0000","last_clean":"2024-09-20T21:05:55.389770+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:55.389770+0000","last_undegraded":"2024-09-20T21:05:55.389770+0000","last_fullsized":"2024-09-20T21:05:55.389770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:41.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393613+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:55.393613+0000","last_peered":"2024-09-20T21:05:55.393613+0000","last_clean":"2024-09-20T21:05:55.393613+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:55.393613+0000","last_undegraded":"2024-09-20T21:05:55.393613+0000","last_fullsized":"2024-09-20T21:05:55.393613+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:04.604590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.117975+0000","last_change":"2024-09-20T21:05:54.126691+0000","last_active":"2024-09-20T21:05:56.117975+0000","last_peered":"2024-09-20T21:05:56.117975+0000","last_clean":"2024-09-20T21:05:56.117975+0000","last_became_active":"2024-09-20T21:05:54.124815+0000","last_became_peered":"2024-09-20T21:05:54.124815+0000","last_unstale":"2024-09-20T21:05:56.117975+0000","last_undegraded":"2024-09-20T21:05:56.117975+0000","last_fullsized":"2024-09-20T21:05:56.117975+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119684+0000","last_change":"2024-09-20T21:05:54.121201+0000","last_active":"2024-09-20T21:05:56.119684+0000","last_peered":"2024-09-20T21:05:56.119684+0000","last_clean":"2024-09-20T21:05:56.119684+0000","last_became_active":"2024-09-20T21:05:54.119189+0000","last_became_peered":"2024-09-20T21:05:54.119189+0000","last_unstale":"2024-09-20T21:05:56.119684+0000","last_undegraded":"2024-09-20T21:05:56.119684+0000","last_fullsized":"2024-09-20T21:05:56.119684+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:15.290334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":121,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118092+0000","last_change":"2024-09-20T21:05:54.130286+0000","last_active":"2024-09-20T21:05:56.118092+0000","last_peered":"2024-09-20T21:05:56.118092+0000","last_clean":"2024-09-20T21:05:56.118092+0000","last_became_active":"2024-09-20T21:05:54.127969+0000","last_became_peered":"2024-09-20T21:05:54.127969+0000","last_unstale":"2024-09-20T21:05:56.118092+0000","last_undegraded":"2024-09-20T21:05:56.118092+0000","last_fullsized":"2024-09-20T21:05:56.118092+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:27.343016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392395+0000","last_change":"2024-09-20T21:05:33.529620+0000","last_active":"2024-09-20T21:05:55.392395+0000","last_peered":"2024-09-20T21:05:55.392395+0000","last_clean":"2024-09-20T21:05:55.392395+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:05:55.392395+0000","last_undegraded":"2024-09-20T21:05:55.392395+0000","last_fullsized":"2024-09-20T21:05:55.392395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:39.374497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391679+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:55.391679+0000","last_peered":"2024-09-20T21:05:55.391679+0000","last_clean":"2024-09-20T21:05:55.391679+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:55.391679+0000","last_undegraded":"2024-09-20T21:05:55.391679+0000","last_fullsized":"2024-09-20T21:05:55.391679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:30.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391647+0000","last_change":"2024-09-20T21:05:33.516924+0000","last_active":"2024-09-20T21:05:55.391647+0000","last_peered":"2024-09-20T21:05:55.391647+0000","last_clean":"2024-09-20T21:05:55.391647+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:05:55.391647+0000","last_undegraded":"2024-09-20T21:05:55.391647+0000","last_fullsized":"2024-09-20T21:05:55.391647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:55.590471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217686+0000","last_change":"2024-09-20T21:05:45.324359+0000","last_active":"2024-09-20T21:05:56.217686+0000","last_peered":"2024-09-20T21:05:56.217686+0000","last_clean":"2024-09-20T21:05:56.217686+0000","last_became_active":"2024-09-20T21:05:45.321407+0000","last_became_peered":"2024-09-20T21:05:45.321407+0000","last_unstale":"2024-09-20T21:05:56.217686+0000","last_undegraded":"2024-09-20T21:05:56.217686+0000","last_fullsized":"2024-09-20T21:05:56.217686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:52.767438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218477+0000","last_change":"2024-09-20T21:05:34.264426+0000","last_active":"2024-09-20T21:05:56.218477+0000","last_peered":"2024-09-20T21:05:56.218477+0000","last_clean":"2024-09-20T21:05:56.218477+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:05:56.218477+0000","last_undegraded":"2024-09-20T21:05:56.218477+0000","last_fullsized":"2024-09-20T21:05:56.218477+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:23.886272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392114+0000","last_change":"2024-09-20T21:05:33.517281+0000","last_active":"2024-09-20T21:05:55.392114+0000","last_peered":"2024-09-20T21:05:55.392114+0000","last_clean":"2024-09-20T21:05:55.392114+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:05:55.392114+0000","last_undegraded":"2024-09-20T21:05:55.392114+0000","last_fullsized":"2024-09-20T21:05:55.392114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:44.497231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.492414+0000","last_change":"2024-09-20T21:05:55.492414+0000","last_active":"2024-09-20T21:05:55.492414+0000","last_peered":"2024-09-20T21:05:55.492414+0000","last_clean":"2024-09-20T21:05:55.492414+0000","last_became_active":"2024-09-20T21:05:55.491897+0000","last_became_peered":"2024-09-20T21:05:55.491897+0000","last_unstale":"2024-09-20T21:05:55.492414+0000","last_undegraded":"2024-09-20T21:05:55.492414+0000","last_fullsized":"2024-09-20T21:05:55.492414+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:44:23.615352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392280+0000","last_change":"2024-09-20T21:05:33.527473+0000","last_active":"2024-09-20T21:05:55.392280+0000","last_peered":"2024-09-20T21:05:55.392280+0000","last_clean":"2024-09-20T21:05:55.392280+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:05:55.392280+0000","last_undegraded":"2024-09-20T21:05:55.392280+0000","last_fullsized":"2024-09-20T21:05:55.392280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:43.880199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118416+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:56.118416+0000","last_peered":"2024-09-20T21:05:56.118416+0000","last_clean":"2024-09-20T21:05:56.118416+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:56.118416+0000","last_undegraded":"2024-09-20T21:05:56.118416+0000","last_fullsized":"2024-09-20T21:05:56.118416+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:06:41.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393346+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:55.393346+0000","last_peered":"2024-09-20T21:05:55.393346+0000","last_clean":"2024-09-20T21:05:55.393346+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:55.393346+0000","last_undegraded":"2024-09-20T21:05:55.393346+0000","last_fullsized":"2024-09-20T21:05:55.393346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:57.275101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":117,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119475+0000","last_change":"2024-09-20T21:05:54.121694+0000","last_active":"2024-09-20T21:05:56.119475+0000","last_peered":"2024-09-20T21:05:56.119475+0000","last_clean":"2024-09-20T21:05:56.119475+0000","last_became_active":"2024-09-20T21:05:54.120855+0000","last_became_peered":"2024-09-20T21:05:54.120855+0000","last_unstale":"2024-09-20T21:05:56.119475+0000","last_undegraded":"2024-09-20T21:05:56.119475+0000","last_fullsized":"2024-09-20T21:05:56.119475+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:11.887662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218152+0000","last_change":"2024-09-20T21:01:12.228402+0000","last_active":"2024-09-20T21:05:56.218152+0000","last_peered":"2024-09-20T21:05:56.218152+0000","last_clean":"2024-09-20T21:05:56.218152+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:05:56.218152+0000","last_undegraded":"2024-09-20T21:05:56.218152+0000","last_fullsized":"2024-09-20T21:05:56.218152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:29:41.478340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":273,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389638+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:55.389638+0000","last_peered":"2024-09-20T21:05:55.389638+0000","last_clean":"2024-09-20T21:05:55.389638+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:55.389638+0000","last_undegraded":"2024-09-20T21:05:55.389638+0000","last_fullsized":"2024-09-20T21:05:55.389638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:49.545054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390696+0000","last_change":"2024-09-20T21:05:33.516926+0000","last_active":"2024-09-20T21:05:55.390696+0000","last_peered":"2024-09-20T21:05:55.390696+0000","last_clean":"2024-09-20T21:05:55.390696+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:05:55.390696+0000","last_undegraded":"2024-09-20T21:05:55.390696+0000","last_fullsized":"2024-09-20T21:05:55.390696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:48.429167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217662+0000","last_change":"2024-09-20T21:05:37.268775+0000","last_active":"2024-09-20T21:05:56.217662+0000","last_peered":"2024-09-20T21:05:56.217662+0000","last_clean":"2024-09-20T21:05:56.217662+0000","last_became_active":"2024-09-20T21:05:37.267211+0000","last_became_peered":"2024-09-20T21:05:37.267211+0000","last_unstale":"2024-09-20T21:05:56.217662+0000","last_undegraded":"2024-09-20T21:05:56.217662+0000","last_fullsized":"2024-09-20T21:05:56.217662+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:45:50.497847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392545+0000","last_change":"2024-09-20T21:05:33.527863+0000","last_active":"2024-09-20T21:05:55.392545+0000","last_peered":"2024-09-20T21:05:55.392545+0000","last_clean":"2024-09-20T21:05:55.392545+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:05:55.392545+0000","last_undegraded":"2024-09-20T21:05:55.392545+0000","last_fullsized":"2024-09-20T21:05:55.392545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:28.039071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390092+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:55.390092+0000","last_peered":"2024-09-20T21:05:55.390092+0000","last_clean":"2024-09-20T21:05:55.390092+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:55.390092+0000","last_undegraded":"2024-09-20T21:05:55.390092+0000","last_fullsized":"2024-09-20T21:05:55.390092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:58.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217679+0000","last_change":"2024-09-20T21:05:45.323068+0000","last_active":"2024-09-20T21:05:56.217679+0000","last_peered":"2024-09-20T21:05:56.217679+0000","last_clean":"2024-09-20T21:05:56.217679+0000","last_became_active":"2024-09-20T21:05:45.321160+0000","last_became_peered":"2024-09-20T21:05:45.321160+0000","last_unstale":"2024-09-20T21:05:56.217679+0000","last_undegraded":"2024-09-20T21:05:56.217679+0000","last_fullsized":"2024-09-20T21:05:56.217679+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:32.144771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119485+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:56.119485+0000","last_peered":"2024-09-20T21:05:56.119485+0000","last_clean":"2024-09-20T21:05:56.119485+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:56.119485+0000","last_undegraded":"2024-09-20T21:05:56.119485+0000","last_fullsized":"2024-09-20T21:05:56.119485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:30.853117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218139+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:56.218139+0000","last_peered":"2024-09-20T21:05:56.218139+0000","last_clean":"2024-09-20T21:05:56.218139+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:56.218139+0000","last_undegraded":"2024-09-20T21:05:56.218139+0000","last_fullsized":"2024-09-20T21:05:56.218139+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:49:25.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118286+0000","last_change":"2024-09-20T21:05:54.126982+0000","last_active":"2024-09-20T21:05:56.118286+0000","last_peered":"2024-09-20T21:05:56.118286+0000","last_clean":"2024-09-20T21:05:56.118286+0000","last_became_active":"2024-09-20T21:05:54.121776+0000","last_became_peered":"2024-09-20T21:05:54.121776+0000","last_unstale":"2024-09-20T21:05:56.118286+0000","last_undegraded":"2024-09-20T21:05:56.118286+0000","last_fullsized":"2024-09-20T21:05:56.118286+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:05:46.297334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":116,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218367+0000","last_change":"2024-09-20T21:05:52.101432+0000","last_active":"2024-09-20T21:05:56.218367+0000","last_peered":"2024-09-20T21:05:56.218367+0000","last_clean":"2024-09-20T21:05:56.218367+0000","last_became_active":"2024-09-20T21:05:52.100421+0000","last_became_peered":"2024-09-20T21:05:52.100421+0000","last_unstale":"2024-09-20T21:05:56.218367+0000","last_undegraded":"2024-09-20T21:05:56.218367+0000","last_fullsized":"2024-09-20T21:05:56.218367+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:16.009222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390114+0000","last_change":"2024-09-20T21:05:33.525394+0000","last_active":"2024-09-20T21:05:55.390114+0000","last_peered":"2024-09-20T21:05:55.390114+0000","last_clean":"2024-09-20T21:05:55.390114+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:05:55.390114+0000","last_undegraded":"2024-09-20T21:05:55.390114+0000","last_fullsized":"2024-09-20T21:05:55.390114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:51:33.922257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390976+0000","last_change":"2024-09-20T21:05:33.522984+0000","last_active":"2024-09-20T21:05:55.390976+0000","last_peered":"2024-09-20T21:05:55.390976+0000","last_clean":"2024-09-20T21:05:55.390976+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:05:55.390976+0000","last_undegraded":"2024-09-20T21:05:55.390976+0000","last_fullsized":"2024-09-20T21:05:55.390976+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:22:14.870718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":122,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218874+0000","last_change":"2024-09-20T21:05:45.331015+0000","last_active":"2024-09-20T21:05:56.218874+0000","last_peered":"2024-09-20T21:05:56.218874+0000","last_clean":"2024-09-20T21:05:56.218874+0000","last_became_active":"2024-09-20T21:05:45.330361+0000","last_became_peered":"2024-09-20T21:05:45.330361+0000","last_unstale":"2024-09-20T21:05:56.218874+0000","last_undegraded":"2024-09-20T21:05:56.218874+0000","last_fullsized":"2024-09-20T21:05:56.218874+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:34.866730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390741+0000","last_change":"2024-09-20T21:05:33.530100+0000","last_active":"2024-09-20T21:05:55.390741+0000","last_peered":"2024-09-20T21:05:55.390741+0000","last_clean":"2024-09-20T21:05:55.390741+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:05:55.390741+0000","last_undegraded":"2024-09-20T21:05:55.390741+0000","last_fullsized":"2024-09-20T21:05:55.390741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:12.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.219172+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:56.219172+0000","last_peered":"2024-09-20T21:05:56.219172+0000","last_clean":"2024-09-20T21:05:56.219172+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:56.219172+0000","last_undegraded":"2024-09-20T21:05:56.219172+0000","last_fullsized":"2024-09-20T21:05:56.219172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:29:16.846427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118584+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:56.118584+0000","last_peered":"2024-09-20T21:05:56.118584+0000","last_clean":"2024-09-20T21:05:56.118584+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:56.118584+0000","last_undegraded":"2024-09-20T21:05:56.118584+0000","last_fullsized":"2024-09-20T21:05:56.118584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:03.961332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218993+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:56.218993+0000","last_peered":"2024-09-20T21:05:56.218993+0000","last_clean":"2024-09-20T21:05:56.218993+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:56.218993+0000","last_undegraded":"2024-09-20T21:05:56.218993+0000","last_fullsized":"2024-09-20T21:05:56.218993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:50:13.997375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.120303+0000","last_change":"2024-09-20T21:05:54.121905+0000","last_active":"2024-09-20T21:05:56.120303+0000","last_peered":"2024-09-20T21:05:56.120303+0000","last_clean":"2024-09-20T21:05:56.120303+0000","last_became_active":"2024-09-20T21:05:54.121064+0000","last_became_peered":"2024-09-20T21:05:54.121064+0000","last_unstale":"2024-09-20T21:05:56.120303+0000","last_undegraded":"2024-09-20T21:05:56.120303+0000","last_fullsized":"2024-09-20T21:05:56.120303+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:54:14.429868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118958+0000","last_change":"2024-09-20T21:05:54.132710+0000","last_active":"2024-09-20T21:05:56.118958+0000","last_peered":"2024-09-20T21:05:56.118958+0000","last_clean":"2024-09-20T21:05:56.118958+0000","last_became_active":"2024-09-20T21:05:54.127863+0000","last_became_peered":"2024-09-20T21:05:54.127863+0000","last_unstale":"2024-09-20T21:05:56.118958+0000","last_undegraded":"2024-09-20T21:05:56.118958+0000","last_fullsized":"2024-09-20T21:05:56.118958+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:59.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218822+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:56.218822+0000","last_peered":"2024-09-20T21:05:56.218822+0000","last_clean":"2024-09-20T21:05:56.218822+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:56.218822+0000","last_undegraded":"2024-09-20T21:05:56.218822+0000","last_fullsized":"2024-09-20T21:05:56.218822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:11:51.198490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.219078+0000","last_change":"2024-09-20T21:01:09.022787+0000","last_active":"2024-09-20T21:05:56.219078+0000","last_peered":"2024-09-20T21:05:56.219078+0000","last_clean":"2024-09-20T21:05:56.219078+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:05:56.219078+0000","last_undegraded":"2024-09-20T21:05:56.219078+0000","last_fullsized":"2024-09-20T21:05:56.219078+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:44.442112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217045+0000","last_change":"2024-09-20T21:05:37.267287+0000","last_active":"2024-09-20T21:05:56.217045+0000","last_peered":"2024-09-20T21:05:56.217045+0000","last_clean":"2024-09-20T21:05:56.217045+0000","last_became_active":"2024-09-20T21:05:37.266438+0000","last_became_peered":"2024-09-20T21:05:37.266438+0000","last_unstale":"2024-09-20T21:05:56.217045+0000","last_undegraded":"2024-09-20T21:05:56.217045+0000","last_fullsized":"2024-09-20T21:05:56.217045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:28.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.219027+0000","last_change":"2024-09-20T21:05:34.264862+0000","last_active":"2024-09-20T21:05:56.219027+0000","last_peered":"2024-09-20T21:05:56.219027+0000","last_clean":"2024-09-20T21:05:56.219027+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:05:56.219027+0000","last_undegraded":"2024-09-20T21:05:56.219027+0000","last_fullsized":"2024-09-20T21:05:56.219027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:32.512356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.395346+0000","last_change":"2024-09-20T21:05:55.395346+0000","last_active":"2024-09-20T21:05:55.395346+0000","last_peered":"2024-09-20T21:05:55.395346+0000","last_clean":"2024-09-20T21:05:55.395346+0000","last_became_active":"2024-09-20T21:05:55.394868+0000","last_became_peered":"2024-09-20T21:05:55.394868+0000","last_unstale":"2024-09-20T21:05:55.395346+0000","last_undegraded":"2024-09-20T21:05:55.395346+0000","last_fullsized":"2024-09-20T21:05:55.395346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:38.909352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118155+0000","last_change":"2024-09-20T21:05:54.121933+0000","last_active":"2024-09-20T21:05:56.118155+0000","last_peered":"2024-09-20T21:05:56.118155+0000","last_clean":"2024-09-20T21:05:56.118155+0000","last_became_active":"2024-09-20T21:05:54.119503+0000","last_became_peered":"2024-09-20T21:05:54.119503+0000","last_unstale":"2024-09-20T21:05:56.118155+0000","last_undegraded":"2024-09-20T21:05:56.118155+0000","last_fullsized":"2024-09-20T21:05:56.118155+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:02.194094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391433+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:55.391433+0000","last_peered":"2024-09-20T21:05:55.391433+0000","last_clean":"2024-09-20T21:05:55.391433+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:55.391433+0000","last_undegraded":"2024-09-20T21:05:55.391433+0000","last_fullsized":"2024-09-20T21:05:55.391433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:49.172273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390555+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:55.390555+0000","last_peered":"2024-09-20T21:05:55.390555+0000","last_clean":"2024-09-20T21:05:55.390555+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:55.390555+0000","last_undegraded":"2024-09-20T21:05:55.390555+0000","last_fullsized":"2024-09-20T21:05:55.390555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:07:07.242939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.216463+0000","last_change":"2024-09-20T21:01:12.225056+0000","last_active":"2024-09-20T21:05:56.216463+0000","last_peered":"2024-09-20T21:05:56.216463+0000","last_clean":"2024-09-20T21:05:56.216463+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:05:56.216463+0000","last_undegraded":"2024-09-20T21:05:56.216463+0000","last_fullsized":"2024-09-20T21:05:56.216463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:00.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.120197+0000","last_change":"2024-09-20T21:05:54.130634+0000","last_active":"2024-09-20T21:05:56.120197+0000","last_peered":"2024-09-20T21:05:56.120197+0000","last_clean":"2024-09-20T21:05:56.120197+0000","last_became_active":"2024-09-20T21:05:54.128221+0000","last_became_peered":"2024-09-20T21:05:54.128221+0000","last_unstale":"2024-09-20T21:05:56.120197+0000","last_undegraded":"2024-09-20T21:05:56.120197+0000","last_fullsized":"2024-09-20T21:05:56.120197+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:37.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.392938+0000","last_change":"2024-09-20T21:05:33.525151+0000","last_active":"2024-09-20T21:05:55.392938+0000","last_peered":"2024-09-20T21:05:55.392938+0000","last_clean":"2024-09-20T21:05:55.392938+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:05:55.392938+0000","last_undegraded":"2024-09-20T21:05:55.392938+0000","last_fullsized":"2024-09-20T21:05:55.392938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:51.245496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.216810+0000","last_change":"2024-09-20T21:05:52.104238+0000","last_active":"2024-09-20T21:05:56.216810+0000","last_peered":"2024-09-20T21:05:56.216810+0000","last_clean":"2024-09-20T21:05:56.216810+0000","last_became_active":"2024-09-20T21:05:52.103630+0000","last_became_peered":"2024-09-20T21:05:52.103630+0000","last_unstale":"2024-09-20T21:05:56.216810+0000","last_undegraded":"2024-09-20T21:05:56.216810+0000","last_fullsized":"2024-09-20T21:05:56.216810+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:22.445415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218566+0000","last_change":"2024-09-20T21:05:34.264735+0000","last_active":"2024-09-20T21:05:56.218566+0000","last_peered":"2024-09-20T21:05:56.218566+0000","last_clean":"2024-09-20T21:05:56.218566+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:05:56.218566+0000","last_undegraded":"2024-09-20T21:05:56.218566+0000","last_fullsized":"2024-09-20T21:05:56.218566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:16.718841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":77,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.215802+0000","last_change":"2024-09-20T21:05:52.100914+0000","last_active":"2024-09-20T21:05:56.215802+0000","last_peered":"2024-09-20T21:05:56.215802+0000","last_clean":"2024-09-20T21:05:56.215802+0000","last_became_active":"2024-09-20T21:05:52.100104+0000","last_became_peered":"2024-09-20T21:05:52.100104+0000","last_unstale":"2024-09-20T21:05:56.215802+0000","last_undegraded":"2024-09-20T21:05:56.215802+0000","last_fullsized":"2024-09-20T21:05:56.215802+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:51:38.241935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.120435+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:56.120435+0000","last_peered":"2024-09-20T21:05:56.120435+0000","last_clean":"2024-09-20T21:05:56.120435+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:56.120435+0000","last_undegraded":"2024-09-20T21:05:56.120435+0000","last_fullsized":"2024-09-20T21:05:56.120435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:39.486200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.216169+0000","last_change":"2024-09-20T21:05:37.269662+0000","last_active":"2024-09-20T21:05:56.216169+0000","last_peered":"2024-09-20T21:05:56.216169+0000","last_clean":"2024-09-20T21:05:56.216169+0000","last_became_active":"2024-09-20T21:05:37.268982+0000","last_became_peered":"2024-09-20T21:05:37.268982+0000","last_unstale":"2024-09-20T21:05:56.216169+0000","last_undegraded":"2024-09-20T21:05:56.216169+0000","last_fullsized":"2024-09-20T21:05:56.216169+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:38.474304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217620+0000","last_change":"2024-09-20T21:05:45.321820+0000","last_active":"2024-09-20T21:05:56.217620+0000","last_peered":"2024-09-20T21:05:56.217620+0000","last_clean":"2024-09-20T21:05:56.217620+0000","last_became_active":"2024-09-20T21:05:45.320924+0000","last_became_peered":"2024-09-20T21:05:45.320924+0000","last_unstale":"2024-09-20T21:05:56.217620+0000","last_undegraded":"2024-09-20T21:05:56.217620+0000","last_fullsized":"2024-09-20T21:05:56.217620+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:18:23.772854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217244+0000","last_change":"2024-09-20T21:05:45.321935+0000","last_active":"2024-09-20T21:05:56.217244+0000","last_peered":"2024-09-20T21:05:56.217244+0000","last_clean":"2024-09-20T21:05:56.217244+0000","last_became_active":"2024-09-20T21:05:45.321031+0000","last_became_peered":"2024-09-20T21:05:45.321031+0000","last_unstale":"2024-09-20T21:05:56.217244+0000","last_undegraded":"2024-09-20T21:05:56.217244+0000","last_fullsized":"2024-09-20T21:05:56.217244+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:01.849318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119483+0000","last_change":"2024-09-20T21:05:54.127603+0000","last_active":"2024-09-20T21:05:56.119483+0000","last_peered":"2024-09-20T21:05:56.119483+0000","last_clean":"2024-09-20T21:05:56.119483+0000","last_became_active":"2024-09-20T21:05:54.125123+0000","last_became_peered":"2024-09-20T21:05:54.125123+0000","last_unstale":"2024-09-20T21:05:56.119483+0000","last_undegraded":"2024-09-20T21:05:56.119483+0000","last_fullsized":"2024-09-20T21:05:56.119483+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:43:09.663833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":117,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119008+0000","last_change":"2024-09-20T21:05:54.122334+0000","last_active":"2024-09-20T21:05:56.119008+0000","last_peered":"2024-09-20T21:05:56.119008+0000","last_clean":"2024-09-20T21:05:56.119008+0000","last_became_active":"2024-09-20T21:05:54.121466+0000","last_became_peered":"2024-09-20T21:05:54.121466+0000","last_unstale":"2024-09-20T21:05:56.119008+0000","last_undegraded":"2024-09-20T21:05:56.119008+0000","last_fullsized":"2024-09-20T21:05:56.119008+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:41.667343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119578+0000","last_change":"2024-09-20T21:05:54.132657+0000","last_active":"2024-09-20T21:05:56.119578+0000","last_peered":"2024-09-20T21:05:56.119578+0000","last_clean":"2024-09-20T21:05:56.119578+0000","last_became_active":"2024-09-20T21:05:54.129891+0000","last_became_peered":"2024-09-20T21:05:54.129891+0000","last_unstale":"2024-09-20T21:05:56.119578+0000","last_undegraded":"2024-09-20T21:05:56.119578+0000","last_fullsized":"2024-09-20T21:05:56.119578+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:26.911986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119401+0000","last_change":"2024-09-20T21:05:54.127321+0000","last_active":"2024-09-20T21:05:56.119401+0000","last_peered":"2024-09-20T21:05:56.119401+0000","last_clean":"2024-09-20T21:05:56.119401+0000","last_became_active":"2024-09-20T21:05:54.120527+0000","last_became_peered":"2024-09-20T21:05:54.120527+0000","last_unstale":"2024-09-20T21:05:56.119401+0000","last_undegraded":"2024-09-20T21:05:56.119401+0000","last_fullsized":"2024-09-20T21:05:56.119401+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:25.400362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391620+0000","last_change":"2024-09-20T21:05:33.523783+0000","last_active":"2024-09-20T21:05:55.391620+0000","last_peered":"2024-09-20T21:05:55.391620+0000","last_clean":"2024-09-20T21:05:55.391620+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:05:55.391620+0000","last_undegraded":"2024-09-20T21:05:55.391620+0000","last_fullsized":"2024-09-20T21:05:55.391620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:29.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391369+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:55.391369+0000","last_peered":"2024-09-20T21:05:55.391369+0000","last_clean":"2024-09-20T21:05:55.391369+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:55.391369+0000","last_undegraded":"2024-09-20T21:05:55.391369+0000","last_fullsized":"2024-09-20T21:05:55.391369+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:45:47.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390604+0000","last_change":"2024-09-20T21:05:33.525036+0000","last_active":"2024-09-20T21:05:55.390604+0000","last_peered":"2024-09-20T21:05:55.390604+0000","last_clean":"2024-09-20T21:05:55.390604+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:05:55.390604+0000","last_undegraded":"2024-09-20T21:05:55.390604+0000","last_fullsized":"2024-09-20T21:05:55.390604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:13.120671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.120014+0000","last_change":"2024-09-20T21:05:54.126814+0000","last_active":"2024-09-20T21:05:56.120014+0000","last_peered":"2024-09-20T21:05:56.120014+0000","last_clean":"2024-09-20T21:05:56.120014+0000","last_became_active":"2024-09-20T21:05:54.124075+0000","last_became_peered":"2024-09-20T21:05:54.124075+0000","last_unstale":"2024-09-20T21:05:56.120014+0000","last_undegraded":"2024-09-20T21:05:56.120014+0000","last_fullsized":"2024-09-20T21:05:56.120014+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:18.839315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":114,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118628+0000","last_change":"2024-09-20T21:05:54.122485+0000","last_active":"2024-09-20T21:05:56.118628+0000","last_peered":"2024-09-20T21:05:56.118628+0000","last_clean":"2024-09-20T21:05:56.118628+0000","last_became_active":"2024-09-20T21:05:54.121408+0000","last_became_peered":"2024-09-20T21:05:54.121408+0000","last_unstale":"2024-09-20T21:05:56.118628+0000","last_undegraded":"2024-09-20T21:05:56.118628+0000","last_fullsized":"2024-09-20T21:05:56.118628+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:36.479778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218328+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:56.218328+0000","last_peered":"2024-09-20T21:05:56.218328+0000","last_clean":"2024-09-20T21:05:56.218328+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:56.218328+0000","last_undegraded":"2024-09-20T21:05:56.218328+0000","last_fullsized":"2024-09-20T21:05:56.218328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:14.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390271+0000","last_change":"2024-09-20T21:05:33.529399+0000","last_active":"2024-09-20T21:05:55.390271+0000","last_peered":"2024-09-20T21:05:55.390271+0000","last_clean":"2024-09-20T21:05:55.390271+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:05:55.390271+0000","last_undegraded":"2024-09-20T21:05:55.390271+0000","last_fullsized":"2024-09-20T21:05:55.390271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:36.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217561+0000","last_change":"2024-09-20T21:05:45.323879+0000","last_active":"2024-09-20T21:05:56.217561+0000","last_peered":"2024-09-20T21:05:56.217561+0000","last_clean":"2024-09-20T21:05:56.217561+0000","last_became_active":"2024-09-20T21:05:45.321268+0000","last_became_peered":"2024-09-20T21:05:45.321268+0000","last_unstale":"2024-09-20T21:05:56.217561+0000","last_undegraded":"2024-09-20T21:05:56.217561+0000","last_fullsized":"2024-09-20T21:05:56.217561+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:53.346461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216928,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94154912,"statfs":{"total":96636764160,"available":96414629888,"internally_reserved":0,"allocated":1126400,"data_stored":1004346,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350983,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54640,"kb_used_data":1112,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317200,"statfs":{"total":96636764160,"available":96580812800,"internally_reserved":0,"allocated":1138688,"data_stored":1004981,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325144,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046696,"statfs":{"total":96636764160,"available":96303816704,"internally_reserved":0,"allocated":1052672,"data_stored":412819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:06:02.842 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.842 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.842 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.843 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.843 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.843 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.843 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.843 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.843 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.843 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.843 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.843 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.844 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.844 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.844 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.844 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.844 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.844 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.844 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.844 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.844 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.844 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.845 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.845 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.845 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.845 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.845 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.845 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.845 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.845 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.845 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.846 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.846 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.846 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.846 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.846 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.846 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.846 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.846 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.846 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.846 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.847 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.847 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.847 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.847 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.847 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.847 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.847 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.847 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.847 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.848 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.848 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.848 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.848 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.848 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.848 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.848 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-20T21:01:00.942617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.848 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.848 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.848 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.849 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.849 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.849 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.849 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.849 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.849 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.849 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.849 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.849 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.850 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.850 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.850 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.850 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.850 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.850 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.850 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.850 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.850 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.850 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.851 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.851 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.851 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.851 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.851 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.851 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.851 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.851 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.851 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.851 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.852 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.852 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.852 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.852 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.852 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.852 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.852 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.852 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.852 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.852 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.853 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.853 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.853 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.853 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.853 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.853 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:02.853 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-20T21:06:22.854 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:06:23.177 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:06:23.179 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:06:23.194 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-09-20T21:06:23.001362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596696,"kb_used_data":3240,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282518824,"statfs":{"total":289910292480,"available":289299275776,"internally_reserved":0,"allocated":3317760,"data_stored":2422146,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004291"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":116,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.120321+0000","last_change":"2024-09-20T21:05:54.129746+0000","last_active":"2024-09-20T21:05:56.120321+0000","last_peered":"2024-09-20T21:05:56.120321+0000","last_clean":"2024-09-20T21:05:56.120321+0000","last_became_active":"2024-09-20T21:05:54.127664+0000","last_became_peered":"2024-09-20T21:05:54.127664+0000","last_unstale":"2024-09-20T21:05:56.120321+0000","last_undegraded":"2024-09-20T21:05:56.120321+0000","last_fullsized":"2024-09-20T21:05:56.120321+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":130,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:04.509992+0000","last_change":"2024-09-20T21:06:04.510043+0000","last_active":"2024-09-20T21:06:04.509992+0000","last_peered":"2024-09-20T21:06:04.509992+0000","last_clean":"2024-09-20T21:06:04.509992+0000","last_became_active":"2024-09-20T21:05:54.124269+0000","last_became_peered":"2024-09-20T21:05:54.124269+0000","last_unstale":"2024-09-20T21:06:04.509992+0000","last_undegraded":"2024-09-20T21:06:04.509992+0000","last_fullsized":"2024-09-20T21:06:04.509992+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:04.509812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:04.509812+0000","last_clean_scrub_stamp":"2024-09-20T21:06:04.509812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:26:55.494813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.536559+0000","last_change":"2024-09-20T21:06:02.536609+0000","last_active":"2024-09-20T21:06:02.536559+0000","last_peered":"2024-09-20T21:06:02.536559+0000","last_clean":"2024-09-20T21:06:02.536559+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:06:02.536559+0000","last_undegraded":"2024-09-20T21:06:02.536559+0000","last_fullsized":"2024-09-20T21:06:02.536559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:02.536374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:02.536374+0000","last_clean_scrub_stamp":"2024-09-20T21:06:02.536374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:27:24.589839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:14.604780+0000","last_change":"2024-09-20T21:06:14.604831+0000","last_active":"2024-09-20T21:06:14.604780+0000","last_peered":"2024-09-20T21:06:14.604780+0000","last_clean":"2024-09-20T21:06:14.604780+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:06:14.604780+0000","last_undegraded":"2024-09-20T21:06:14.604780+0000","last_fullsized":"2024-09-20T21:06:14.604780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:14.604590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:14.604590+0000","last_clean_scrub_stamp":"2024-09-20T21:06:14.604590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:05.449605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":116,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.519782+0000","last_change":"2024-09-20T21:05:54.130938+0000","last_active":"2024-09-20T21:06:02.519782+0000","last_peered":"2024-09-20T21:06:02.519782+0000","last_clean":"2024-09-20T21:06:02.519782+0000","last_became_active":"2024-09-20T21:05:54.125511+0000","last_became_peered":"2024-09-20T21:05:54.125511+0000","last_unstale":"2024-09-20T21:06:02.519782+0000","last_undegraded":"2024-09-20T21:06:02.519782+0000","last_fullsized":"2024-09-20T21:06:02.519782+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:17.591702+0000","last_change":"2024-09-20T21:06:17.591759+0000","last_active":"2024-09-20T21:06:17.591702+0000","last_peered":"2024-09-20T21:06:17.591702+0000","last_clean":"2024-09-20T21:06:17.591702+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:06:17.591702+0000","last_undegraded":"2024-09-20T21:06:17.591702+0000","last_fullsized":"2024-09-20T21:06:17.591702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:17.591513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:17.591513+0000","last_clean_scrub_stamp":"2024-09-20T21:06:17.591513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:33:03.503561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.494076+0000","last_change":"2024-09-20T21:05:55.492841+0000","last_active":"2024-09-20T21:05:55.494076+0000","last_peered":"2024-09-20T21:05:55.494076+0000","last_clean":"2024-09-20T21:05:55.494076+0000","last_became_active":"2024-09-20T21:05:55.492104+0000","last_became_peered":"2024-09-20T21:05:55.492104+0000","last_unstale":"2024-09-20T21:05:55.494076+0000","last_undegraded":"2024-09-20T21:05:55.494076+0000","last_fullsized":"2024-09-20T21:05:55.494076+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:21.514969+0000","last_change":"2024-09-20T21:06:21.515038+0000","last_active":"2024-09-20T21:06:21.514969+0000","last_peered":"2024-09-20T21:06:21.514969+0000","last_clean":"2024-09-20T21:06:21.514969+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:06:21.514969+0000","last_undegraded":"2024-09-20T21:06:21.514969+0000","last_fullsized":"2024-09-20T21:06:21.514969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:21.514750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:21.514750+0000","last_clean_scrub_stamp":"2024-09-20T21:06:21.514750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:52.959852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":123,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218021+0000","last_change":"2024-09-20T21:05:45.329452+0000","last_active":"2024-09-20T21:05:56.218021+0000","last_peered":"2024-09-20T21:05:56.218021+0000","last_clean":"2024-09-20T21:05:56.218021+0000","last_became_active":"2024-09-20T21:05:45.327207+0000","last_became_peered":"2024-09-20T21:05:45.327207+0000","last_unstale":"2024-09-20T21:05:56.218021+0000","last_undegraded":"2024-09-20T21:05:56.218021+0000","last_fullsized":"2024-09-20T21:05:56.218021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:05.499952+0000","last_change":"2024-09-20T21:06:05.500004+0000","last_active":"2024-09-20T21:06:05.499952+0000","last_peered":"2024-09-20T21:06:05.499952+0000","last_clean":"2024-09-20T21:06:05.499952+0000","last_became_active":"2024-09-20T21:05:54.124291+0000","last_became_peered":"2024-09-20T21:05:54.124291+0000","last_unstale":"2024-09-20T21:06:05.499952+0000","last_undegraded":"2024-09-20T21:06:05.499952+0000","last_fullsized":"2024-09-20T21:06:05.499952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:05.499755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:05.499755+0000","last_clean_scrub_stamp":"2024-09-20T21:06:05.499755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:06:12.890860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393080+0000","last_change":"2024-09-20T21:05:36.542903+0000","last_active":"2024-09-20T21:05:55.393080+0000","last_peered":"2024-09-20T21:05:55.393080+0000","last_clean":"2024-09-20T21:05:55.393080+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:05:55.393080+0000","last_undegraded":"2024-09-20T21:05:55.393080+0000","last_fullsized":"2024-09-20T21:05:55.393080+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.519600+0000","last_change":"2024-09-20T21:05:34.247457+0000","last_active":"2024-09-20T21:06:02.519600+0000","last_peered":"2024-09-20T21:06:02.519600+0000","last_clean":"2024-09-20T21:06:02.519600+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:06:02.519600+0000","last_undegraded":"2024-09-20T21:06:02.519600+0000","last_fullsized":"2024-09-20T21:06:02.519600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.519571+0000","last_change":"2024-09-20T21:05:54.132356+0000","last_active":"2024-09-20T21:06:02.519571+0000","last_peered":"2024-09-20T21:06:02.519571+0000","last_clean":"2024-09-20T21:06:02.519571+0000","last_became_active":"2024-09-20T21:05:54.128147+0000","last_became_peered":"2024-09-20T21:05:54.128147+0000","last_unstale":"2024-09-20T21:06:02.519571+0000","last_undegraded":"2024-09-20T21:06:02.519571+0000","last_fullsized":"2024-09-20T21:06:02.519571+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391336+0000","last_change":"2024-09-20T21:05:33.509029+0000","last_active":"2024-09-20T21:05:55.391336+0000","last_peered":"2024-09-20T21:05:55.391336+0000","last_clean":"2024-09-20T21:05:55.391336+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:05:55.391336+0000","last_undegraded":"2024-09-20T21:05:55.391336+0000","last_fullsized":"2024-09-20T21:05:55.391336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390916+0000","last_change":"2024-09-20T21:05:33.512057+0000","last_active":"2024-09-20T21:05:55.390916+0000","last_peered":"2024-09-20T21:05:55.390916+0000","last_clean":"2024-09-20T21:05:55.390916+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:05:55.390916+0000","last_undegraded":"2024-09-20T21:05:55.390916+0000","last_fullsized":"2024-09-20T21:05:55.390916+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.491714+0000","last_change":"2024-09-20T21:05:55.490656+0000","last_active":"2024-09-20T21:05:55.491714+0000","last_peered":"2024-09-20T21:05:55.491714+0000","last_clean":"2024-09-20T21:05:55.491714+0000","last_became_active":"2024-09-20T21:05:55.489879+0000","last_became_peered":"2024-09-20T21:05:55.489879+0000","last_unstale":"2024-09-20T21:05:55.491714+0000","last_undegraded":"2024-09-20T21:05:55.491714+0000","last_fullsized":"2024-09-20T21:05:55.491714+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218818+0000","last_change":"2024-09-20T21:01:12.222901+0000","last_active":"2024-09-20T21:05:56.218818+0000","last_peered":"2024-09-20T21:05:56.218818+0000","last_clean":"2024-09-20T21:05:56.218818+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:05:56.218818+0000","last_undegraded":"2024-09-20T21:05:56.218818+0000","last_fullsized":"2024-09-20T21:05:56.218818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119539+0000","last_change":"2024-09-20T21:01:12.236613+0000","last_active":"2024-09-20T21:05:56.119539+0000","last_peered":"2024-09-20T21:05:56.119539+0000","last_clean":"2024-09-20T21:05:56.119539+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:05:56.119539+0000","last_undegraded":"2024-09-20T21:05:56.119539+0000","last_fullsized":"2024-09-20T21:05:56.119539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":123,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217576+0000","last_change":"2024-09-20T21:05:45.327807+0000","last_active":"2024-09-20T21:05:56.217576+0000","last_peered":"2024-09-20T21:05:56.217576+0000","last_clean":"2024-09-20T21:05:56.217576+0000","last_became_active":"2024-09-20T21:05:45.326913+0000","last_became_peered":"2024-09-20T21:05:45.326913+0000","last_unstale":"2024-09-20T21:05:56.217576+0000","last_undegraded":"2024-09-20T21:05:56.217576+0000","last_fullsized":"2024-09-20T21:05:56.217576+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.494052+0000","last_change":"2024-09-20T21:05:55.492609+0000","last_active":"2024-09-20T21:05:55.494052+0000","last_peered":"2024-09-20T21:05:55.494052+0000","last_clean":"2024-09-20T21:05:55.494052+0000","last_became_active":"2024-09-20T21:05:55.491995+0000","last_became_peered":"2024-09-20T21:05:55.491995+0000","last_unstale":"2024-09-20T21:05:55.494052+0000","last_undegraded":"2024-09-20T21:05:55.494052+0000","last_fullsized":"2024-09-20T21:05:55.494052+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:09.602953+0000","last_change":"2024-09-20T21:06:09.603007+0000","last_active":"2024-09-20T21:06:09.602953+0000","last_peered":"2024-09-20T21:06:09.602953+0000","last_clean":"2024-09-20T21:06:09.602953+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:06:09.602953+0000","last_undegraded":"2024-09-20T21:06:09.602953+0000","last_fullsized":"2024-09-20T21:06:09.602953+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:09.602773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:09.602773+0000","last_clean_scrub_stamp":"2024-09-20T21:06:09.602773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:08.291067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118773+0000","last_change":"2024-09-20T21:05:34.242174+0000","last_active":"2024-09-20T21:05:56.118773+0000","last_peered":"2024-09-20T21:05:56.118773+0000","last_clean":"2024-09-20T21:05:56.118773+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:05:56.118773+0000","last_undegraded":"2024-09-20T21:05:56.118773+0000","last_fullsized":"2024-09-20T21:05:56.118773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.216660+0000","last_change":"2024-09-20T21:05:52.103930+0000","last_active":"2024-09-20T21:05:56.216660+0000","last_peered":"2024-09-20T21:05:56.216660+0000","last_clean":"2024-09-20T21:05:56.216660+0000","last_became_active":"2024-09-20T21:05:52.103477+0000","last_became_peered":"2024-09-20T21:05:52.103477+0000","last_unstale":"2024-09-20T21:05:56.216660+0000","last_undegraded":"2024-09-20T21:05:56.216660+0000","last_fullsized":"2024-09-20T21:05:56.216660+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":116,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118136+0000","last_change":"2024-09-20T21:05:54.133334+0000","last_active":"2024-09-20T21:05:56.118136+0000","last_peered":"2024-09-20T21:05:56.118136+0000","last_clean":"2024-09-20T21:05:56.118136+0000","last_became_active":"2024-09-20T21:05:54.129639+0000","last_became_peered":"2024-09-20T21:05:54.129639+0000","last_unstale":"2024-09-20T21:05:56.118136+0000","last_undegraded":"2024-09-20T21:05:56.118136+0000","last_fullsized":"2024-09-20T21:05:56.118136+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:06.516713+0000","last_change":"2024-09-20T21:06:06.516774+0000","last_active":"2024-09-20T21:06:06.516713+0000","last_peered":"2024-09-20T21:06:06.516713+0000","last_clean":"2024-09-20T21:06:06.516713+0000","last_became_active":"2024-09-20T21:05:54.124757+0000","last_became_peered":"2024-09-20T21:05:54.124757+0000","last_unstale":"2024-09-20T21:06:06.516713+0000","last_undegraded":"2024-09-20T21:06:06.516713+0000","last_fullsized":"2024-09-20T21:06:06.516713+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:06.516526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:06.516526+0000","last_clean_scrub_stamp":"2024-09-20T21:06:06.516526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:23.791289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.203966+0000","last_change":"2024-09-20T21:06:02.204018+0000","last_active":"2024-09-20T21:06:02.203966+0000","last_peered":"2024-09-20T21:06:02.203966+0000","last_clean":"2024-09-20T21:06:02.203966+0000","last_became_active":"2024-09-20T21:05:45.321767+0000","last_became_peered":"2024-09-20T21:05:45.321767+0000","last_unstale":"2024-09-20T21:06:02.203966+0000","last_undegraded":"2024-09-20T21:06:02.203966+0000","last_fullsized":"2024-09-20T21:06:02.203966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:02.203778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:02.203778+0000","last_clean_scrub_stamp":"2024-09-20T21:06:02.203778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:54:43.920771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:04.512459+0000","last_change":"2024-09-20T21:06:04.512512+0000","last_active":"2024-09-20T21:06:04.512459+0000","last_peered":"2024-09-20T21:06:04.512459+0000","last_clean":"2024-09-20T21:06:04.512459+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:06:04.512459+0000","last_undegraded":"2024-09-20T21:06:04.512459+0000","last_fullsized":"2024-09-20T21:06:04.512459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:04.512266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:04.512266+0000","last_clean_scrub_stamp":"2024-09-20T21:06:04.512266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:08.753845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:15.489478+0000","last_change":"2024-09-20T21:06:15.489529+0000","last_active":"2024-09-20T21:06:15.489478+0000","last_peered":"2024-09-20T21:06:15.489478+0000","last_clean":"2024-09-20T21:06:15.489478+0000","last_became_active":"2024-09-20T21:05:54.120990+0000","last_became_peered":"2024-09-20T21:05:54.120990+0000","last_unstale":"2024-09-20T21:06:15.489478+0000","last_undegraded":"2024-09-20T21:06:15.489478+0000","last_fullsized":"2024-09-20T21:06:15.489478+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:15.489279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:15.489279+0000","last_clean_scrub_stamp":"2024-09-20T21:06:15.489279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:48:24.262607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:03.242740+0000","last_change":"2024-09-20T21:06:03.242792+0000","last_active":"2024-09-20T21:06:03.242740+0000","last_peered":"2024-09-20T21:06:03.242740+0000","last_clean":"2024-09-20T21:06:03.242740+0000","last_became_active":"2024-09-20T21:05:37.267096+0000","last_became_peered":"2024-09-20T21:05:37.267096+0000","last_unstale":"2024-09-20T21:06:03.242740+0000","last_undegraded":"2024-09-20T21:06:03.242740+0000","last_fullsized":"2024-09-20T21:06:03.242740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:03.242543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:03.242543+0000","last_clean_scrub_stamp":"2024-09-20T21:06:03.242543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:58.207826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119068+0000","last_change":"2024-09-20T21:05:34.245672+0000","last_active":"2024-09-20T21:05:56.119068+0000","last_peered":"2024-09-20T21:05:56.119068+0000","last_clean":"2024-09-20T21:05:56.119068+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:05:56.119068+0000","last_undegraded":"2024-09-20T21:05:56.119068+0000","last_fullsized":"2024-09-20T21:05:56.119068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.217548+0000","last_change":"2024-09-20T21:01:12.224676+0000","last_active":"2024-09-20T21:05:56.217548+0000","last_peered":"2024-09-20T21:05:56.217548+0000","last_clean":"2024-09-20T21:05:56.217548+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:05:56.217548+0000","last_undegraded":"2024-09-20T21:05:56.217548+0000","last_fullsized":"2024-09-20T21:05:56.217548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:12.618035+0000","last_change":"2024-09-20T21:06:12.618087+0000","last_active":"2024-09-20T21:06:12.618035+0000","last_peered":"2024-09-20T21:06:12.618035+0000","last_clean":"2024-09-20T21:06:12.618035+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:06:12.618035+0000","last_undegraded":"2024-09-20T21:06:12.618035+0000","last_fullsized":"2024-09-20T21:06:12.618035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:12.617835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:12.617835+0000","last_clean_scrub_stamp":"2024-09-20T21:06:12.617835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:50:06.150380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":122,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119825+0000","last_change":"2024-09-20T21:05:54.132673+0000","last_active":"2024-09-20T21:05:56.119825+0000","last_peered":"2024-09-20T21:05:56.119825+0000","last_clean":"2024-09-20T21:05:56.119825+0000","last_became_active":"2024-09-20T21:05:54.128119+0000","last_became_peered":"2024-09-20T21:05:54.128119+0000","last_unstale":"2024-09-20T21:05:56.119825+0000","last_undegraded":"2024-09-20T21:05:56.119825+0000","last_fullsized":"2024-09-20T21:05:56.119825+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"95'4","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:08.560177+0000","last_change":"2024-09-20T21:06:08.560246+0000","last_active":"2024-09-20T21:06:08.560177+0000","last_peered":"2024-09-20T21:06:08.560177+0000","last_clean":"2024-09-20T21:06:08.560177+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:06:08.560177+0000","last_undegraded":"2024-09-20T21:06:08.560177+0000","last_fullsized":"2024-09-20T21:06:08.560177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'4","last_scrub_stamp":"2024-09-20T21:06:08.559988+0000","last_deep_scrub":"95'4","last_deep_scrub_stamp":"2024-09-20T21:06:08.559988+0000","last_clean_scrub_stamp":"2024-09-20T21:06:08.559988+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:10.036982+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":116,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.519202+0000","last_change":"2024-09-20T21:05:54.133190+0000","last_active":"2024-09-20T21:06:02.519202+0000","last_peered":"2024-09-20T21:06:02.519202+0000","last_clean":"2024-09-20T21:06:02.519202+0000","last_became_active":"2024-09-20T21:05:54.130889+0000","last_became_peered":"2024-09-20T21:05:54.130889+0000","last_unstale":"2024-09-20T21:06:02.519202+0000","last_undegraded":"2024-09-20T21:06:02.519202+0000","last_fullsized":"2024-09-20T21:06:02.519202+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:06.224012+0000","last_change":"2024-09-20T21:06:06.224084+0000","last_active":"2024-09-20T21:06:06.224012+0000","last_peered":"2024-09-20T21:06:06.224012+0000","last_clean":"2024-09-20T21:06:06.224012+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:06:06.224012+0000","last_undegraded":"2024-09-20T21:06:06.224012+0000","last_fullsized":"2024-09-20T21:06:06.224012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:06.223824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:06.223824+0000","last_clean_scrub_stamp":"2024-09-20T21:06:06.223824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:22.296470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:14.189296+0000","last_change":"2024-09-20T21:06:14.189355+0000","last_active":"2024-09-20T21:06:14.189296+0000","last_peered":"2024-09-20T21:06:14.189296+0000","last_clean":"2024-09-20T21:06:14.189296+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:06:14.189296+0000","last_undegraded":"2024-09-20T21:06:14.189296+0000","last_fullsized":"2024-09-20T21:06:14.189296+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:14.189094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:14.189094+0000","last_clean_scrub_stamp":"2024-09-20T21:06:14.189094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:25:16.979082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:12.519350+0000","last_change":"2024-09-20T21:06:12.519406+0000","last_active":"2024-09-20T21:06:12.519350+0000","last_peered":"2024-09-20T21:06:12.519350+0000","last_clean":"2024-09-20T21:06:12.519350+0000","last_became_active":"2024-09-20T21:05:54.124655+0000","last_became_peered":"2024-09-20T21:05:54.124655+0000","last_unstale":"2024-09-20T21:06:12.519350+0000","last_undegraded":"2024-09-20T21:06:12.519350+0000","last_fullsized":"2024-09-20T21:06:12.519350+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:12.519156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:12.519156+0000","last_clean_scrub_stamp":"2024-09-20T21:06:12.519156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:56:36.326861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:01.583931+0000","last_change":"2024-09-20T21:05:45.324641+0000","last_active":"2024-09-20T21:06:01.583931+0000","last_peered":"2024-09-20T21:06:01.583931+0000","last_clean":"2024-09-20T21:06:01.583931+0000","last_became_active":"2024-09-20T21:05:45.323784+0000","last_became_peered":"2024-09-20T21:05:45.323784+0000","last_unstale":"2024-09-20T21:06:01.583931+0000","last_undegraded":"2024-09-20T21:06:01.583931+0000","last_fullsized":"2024-09-20T21:06:01.583931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":72,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389855+0000","last_change":"2024-09-20T21:05:33.508645+0000","last_active":"2024-09-20T21:05:55.389855+0000","last_peered":"2024-09-20T21:05:55.389855+0000","last_clean":"2024-09-20T21:05:55.389855+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:05:55.389855+0000","last_undegraded":"2024-09-20T21:05:55.389855+0000","last_fullsized":"2024-09-20T21:05:55.389855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393694+0000","last_change":"2024-09-20T21:05:33.514140+0000","last_active":"2024-09-20T21:05:55.393694+0000","last_peered":"2024-09-20T21:05:55.393694+0000","last_clean":"2024-09-20T21:05:55.393694+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:05:55.393694+0000","last_undegraded":"2024-09-20T21:05:55.393694+0000","last_fullsized":"2024-09-20T21:05:55.393694+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:18.454978+0000","last_change":"2024-09-20T21:06:18.455085+0000","last_active":"2024-09-20T21:06:18.454978+0000","last_peered":"2024-09-20T21:06:18.454978+0000","last_clean":"2024-09-20T21:06:18.454978+0000","last_became_active":"2024-09-20T21:05:54.124815+0000","last_became_peered":"2024-09-20T21:05:54.124815+0000","last_unstale":"2024-09-20T21:06:18.454978+0000","last_undegraded":"2024-09-20T21:06:18.454978+0000","last_fullsized":"2024-09-20T21:06:18.454978+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:18.454684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:18.454684+0000","last_clean_scrub_stamp":"2024-09-20T21:06:18.454684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:20.248639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"95'3","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:07.540023+0000","last_change":"2024-09-20T21:06:07.540175+0000","last_active":"2024-09-20T21:06:07.540023+0000","last_peered":"2024-09-20T21:06:07.540023+0000","last_clean":"2024-09-20T21:06:07.540023+0000","last_became_active":"2024-09-20T21:05:54.119189+0000","last_became_peered":"2024-09-20T21:05:54.119189+0000","last_unstale":"2024-09-20T21:06:07.540023+0000","last_undegraded":"2024-09-20T21:06:07.540023+0000","last_fullsized":"2024-09-20T21:06:07.540023+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T21:06:07.539800+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T21:06:07.539800+0000","last_clean_scrub_stamp":"2024-09-20T21:06:07.539800+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:55.719961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":130,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:03.488018+0000","last_change":"2024-09-20T21:06:03.488069+0000","last_active":"2024-09-20T21:06:03.488018+0000","last_peered":"2024-09-20T21:06:03.488018+0000","last_clean":"2024-09-20T21:06:03.488018+0000","last_became_active":"2024-09-20T21:05:54.127969+0000","last_became_peered":"2024-09-20T21:05:54.127969+0000","last_unstale":"2024-09-20T21:06:03.488018+0000","last_undegraded":"2024-09-20T21:06:03.488018+0000","last_fullsized":"2024-09-20T21:06:03.488018+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:03.487830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:03.487830+0000","last_clean_scrub_stamp":"2024-09-20T21:06:03.487830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:58.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"95'2","reported_seq":74,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:01.563405+0000","last_change":"2024-09-20T21:06:01.563473+0000","last_active":"2024-09-20T21:06:01.563405+0000","last_peered":"2024-09-20T21:06:01.563405+0000","last_clean":"2024-09-20T21:06:01.563405+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:06:01.563405+0000","last_undegraded":"2024-09-20T21:06:01.563405+0000","last_fullsized":"2024-09-20T21:06:01.563405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-20T21:06:01.563216+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-20T21:06:01.563216+0000","last_clean_scrub_stamp":"2024-09-20T21:06:01.563216+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:54.399978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391795+0000","last_change":"2024-09-20T21:05:33.527661+0000","last_active":"2024-09-20T21:05:55.391795+0000","last_peered":"2024-09-20T21:05:55.391795+0000","last_clean":"2024-09-20T21:05:55.391795+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:05:55.391795+0000","last_undegraded":"2024-09-20T21:05:55.391795+0000","last_fullsized":"2024-09-20T21:05:55.391795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:20.555989+0000","last_change":"2024-09-20T21:06:20.556050+0000","last_active":"2024-09-20T21:06:20.555989+0000","last_peered":"2024-09-20T21:06:20.555989+0000","last_clean":"2024-09-20T21:06:20.555989+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:06:20.555989+0000","last_undegraded":"2024-09-20T21:06:20.555989+0000","last_fullsized":"2024-09-20T21:06:20.555989+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:20.555777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:20.555777+0000","last_clean_scrub_stamp":"2024-09-20T21:06:20.555777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:53.535851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:17.227849+0000","last_change":"2024-09-20T21:06:17.227908+0000","last_active":"2024-09-20T21:06:17.227849+0000","last_peered":"2024-09-20T21:06:17.227849+0000","last_clean":"2024-09-20T21:06:17.227849+0000","last_became_active":"2024-09-20T21:05:45.321407+0000","last_became_peered":"2024-09-20T21:05:45.321407+0000","last_unstale":"2024-09-20T21:06:17.227849+0000","last_undegraded":"2024-09-20T21:06:17.227849+0000","last_fullsized":"2024-09-20T21:06:17.227849+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:17.227655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:17.227655+0000","last_clean_scrub_stamp":"2024-09-20T21:06:17.227655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:18.923766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"95'3","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:12.277890+0000","last_change":"2024-09-20T21:06:12.277959+0000","last_active":"2024-09-20T21:06:12.277890+0000","last_peered":"2024-09-20T21:06:12.277890+0000","last_clean":"2024-09-20T21:06:12.277890+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:06:12.277890+0000","last_undegraded":"2024-09-20T21:06:12.277890+0000","last_fullsized":"2024-09-20T21:06:12.277890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T21:06:12.277700+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T21:06:12.277700+0000","last_clean_scrub_stamp":"2024-09-20T21:06:12.277700+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:28.257090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:16.635079+0000","last_change":"2024-09-20T21:06:16.635131+0000","last_active":"2024-09-20T21:06:16.635079+0000","last_peered":"2024-09-20T21:06:16.635079+0000","last_clean":"2024-09-20T21:06:16.635079+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:06:16.635079+0000","last_undegraded":"2024-09-20T21:06:16.635079+0000","last_fullsized":"2024-09-20T21:06:16.635079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:16.634879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:16.634879+0000","last_clean_scrub_stamp":"2024-09-20T21:06:16.634879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:21.040805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.493523+0000","last_change":"2024-09-20T21:05:55.492414+0000","last_active":"2024-09-20T21:05:55.493523+0000","last_peered":"2024-09-20T21:05:55.493523+0000","last_clean":"2024-09-20T21:05:55.493523+0000","last_became_active":"2024-09-20T21:05:55.491897+0000","last_became_peered":"2024-09-20T21:05:55.491897+0000","last_unstale":"2024-09-20T21:05:55.493523+0000","last_undegraded":"2024-09-20T21:05:55.493523+0000","last_fullsized":"2024-09-20T21:05:55.493523+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:19.551532+0000","last_change":"2024-09-20T21:06:19.551583+0000","last_active":"2024-09-20T21:06:19.551532+0000","last_peered":"2024-09-20T21:06:19.551532+0000","last_clean":"2024-09-20T21:06:19.551532+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:06:19.551532+0000","last_undegraded":"2024-09-20T21:06:19.551532+0000","last_fullsized":"2024-09-20T21:06:19.551532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:19.551342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:19.551342+0000","last_clean_scrub_stamp":"2024-09-20T21:06:19.551342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:45.177805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118548+0000","last_change":"2024-09-20T21:05:34.241783+0000","last_active":"2024-09-20T21:05:56.118548+0000","last_peered":"2024-09-20T21:05:56.118548+0000","last_clean":"2024-09-20T21:05:56.118548+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:05:56.118548+0000","last_undegraded":"2024-09-20T21:05:56.118548+0000","last_fullsized":"2024-09-20T21:05:56.118548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.393463+0000","last_change":"2024-09-20T21:05:33.506556+0000","last_active":"2024-09-20T21:05:55.393463+0000","last_peered":"2024-09-20T21:05:55.393463+0000","last_clean":"2024-09-20T21:05:55.393463+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:05:55.393463+0000","last_undegraded":"2024-09-20T21:05:55.393463+0000","last_fullsized":"2024-09-20T21:05:55.393463+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":126,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:19.450576+0000","last_change":"2024-09-20T21:06:19.450629+0000","last_active":"2024-09-20T21:06:19.450576+0000","last_peered":"2024-09-20T21:06:19.450576+0000","last_clean":"2024-09-20T21:06:19.450576+0000","last_became_active":"2024-09-20T21:05:54.120855+0000","last_became_peered":"2024-09-20T21:05:54.120855+0000","last_unstale":"2024-09-20T21:06:19.450576+0000","last_undegraded":"2024-09-20T21:06:19.450576+0000","last_fullsized":"2024-09-20T21:06:19.450576+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:19.450382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:19.450382+0000","last_clean_scrub_stamp":"2024-09-20T21:06:19.450382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:09.823794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:16.187193+0000","last_change":"2024-09-20T21:06:16.187340+0000","last_active":"2024-09-20T21:06:16.187193+0000","last_peered":"2024-09-20T21:06:16.187193+0000","last_clean":"2024-09-20T21:06:16.187193+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:06:16.187193+0000","last_undegraded":"2024-09-20T21:06:16.187193+0000","last_fullsized":"2024-09-20T21:06:16.187193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:16.186966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:16.186966+0000","last_clean_scrub_stamp":"2024-09-20T21:06:16.186966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:58.421836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":274,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.389723+0000","last_change":"2024-09-20T21:05:33.509032+0000","last_active":"2024-09-20T21:05:55.389723+0000","last_peered":"2024-09-20T21:05:55.389723+0000","last_clean":"2024-09-20T21:05:55.389723+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:05:55.389723+0000","last_undegraded":"2024-09-20T21:05:55.389723+0000","last_fullsized":"2024-09-20T21:05:55.389723+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:00.942617+0000","last_clean_scrub_stamp":"2024-09-20T21:01:00.942617+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"95'2","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:18.585937+0000","last_change":"2024-09-20T21:06:18.586108+0000","last_active":"2024-09-20T21:06:18.585937+0000","last_peered":"2024-09-20T21:06:18.585937+0000","last_clean":"2024-09-20T21:06:18.585937+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:06:18.585937+0000","last_undegraded":"2024-09-20T21:06:18.585937+0000","last_fullsized":"2024-09-20T21:06:18.585937+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-20T21:06:18.585722+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-20T21:06:18.585722+0000","last_clean_scrub_stamp":"2024-09-20T21:06:18.585722+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:40.842507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:05.264120+0000","last_change":"2024-09-20T21:06:05.264179+0000","last_active":"2024-09-20T21:06:05.264120+0000","last_peered":"2024-09-20T21:06:05.264120+0000","last_clean":"2024-09-20T21:06:05.264120+0000","last_became_active":"2024-09-20T21:05:37.267211+0000","last_became_peered":"2024-09-20T21:05:37.267211+0000","last_unstale":"2024-09-20T21:06:05.264120+0000","last_undegraded":"2024-09-20T21:06:05.264120+0000","last_fullsized":"2024-09-20T21:06:05.264120+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:05.263914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:05.263914+0000","last_clean_scrub_stamp":"2024-09-20T21:06:05.263914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:06:12.655019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:06.548944+0000","last_change":"2024-09-20T21:06:06.548996+0000","last_active":"2024-09-20T21:06:06.548944+0000","last_peered":"2024-09-20T21:06:06.548944+0000","last_clean":"2024-09-20T21:06:06.548944+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:06:06.548944+0000","last_undegraded":"2024-09-20T21:06:06.548944+0000","last_fullsized":"2024-09-20T21:06:06.548944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:06.548742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:06.548742+0000","last_clean_scrub_stamp":"2024-09-20T21:06:06.548742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:02.694715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390206+0000","last_change":"2024-09-20T21:05:33.509204+0000","last_active":"2024-09-20T21:05:55.390206+0000","last_peered":"2024-09-20T21:05:55.390206+0000","last_clean":"2024-09-20T21:05:55.390206+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:05:55.390206+0000","last_undegraded":"2024-09-20T21:05:55.390206+0000","last_fullsized":"2024-09-20T21:05:55.390206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:13.232313+0000","last_change":"2024-09-20T21:06:13.232367+0000","last_active":"2024-09-20T21:06:13.232313+0000","last_peered":"2024-09-20T21:06:13.232313+0000","last_clean":"2024-09-20T21:06:13.232313+0000","last_became_active":"2024-09-20T21:05:45.321160+0000","last_became_peered":"2024-09-20T21:05:45.321160+0000","last_unstale":"2024-09-20T21:06:13.232313+0000","last_undegraded":"2024-09-20T21:06:13.232313+0000","last_fullsized":"2024-09-20T21:06:13.232313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:13.232087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:13.232087+0000","last_clean_scrub_stamp":"2024-09-20T21:06:13.232087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:40.487222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119602+0000","last_change":"2024-09-20T21:01:12.241036+0000","last_active":"2024-09-20T21:05:56.119602+0000","last_peered":"2024-09-20T21:05:56.119602+0000","last_clean":"2024-09-20T21:05:56.119602+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:05:56.119602+0000","last_undegraded":"2024-09-20T21:05:56.119602+0000","last_fullsized":"2024-09-20T21:05:56.119602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218249+0000","last_change":"2024-09-20T21:01:09.022729+0000","last_active":"2024-09-20T21:05:56.218249+0000","last_peered":"2024-09-20T21:05:56.218249+0000","last_clean":"2024-09-20T21:05:56.218249+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:05:56.218249+0000","last_undegraded":"2024-09-20T21:05:56.218249+0000","last_fullsized":"2024-09-20T21:05:56.218249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:10.538704+0000","last_change":"2024-09-20T21:06:10.538824+0000","last_active":"2024-09-20T21:06:10.538704+0000","last_peered":"2024-09-20T21:06:10.538704+0000","last_clean":"2024-09-20T21:06:10.538704+0000","last_became_active":"2024-09-20T21:05:54.121776+0000","last_became_peered":"2024-09-20T21:05:54.121776+0000","last_unstale":"2024-09-20T21:06:10.538704+0000","last_undegraded":"2024-09-20T21:06:10.538704+0000","last_fullsized":"2024-09-20T21:06:10.538704+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:10.538415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:10.538415+0000","last_clean_scrub_stamp":"2024-09-20T21:06:10.538415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:55.758434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":117,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218485+0000","last_change":"2024-09-20T21:05:52.101432+0000","last_active":"2024-09-20T21:05:56.218485+0000","last_peered":"2024-09-20T21:05:56.218485+0000","last_clean":"2024-09-20T21:05:56.218485+0000","last_became_active":"2024-09-20T21:05:52.100421+0000","last_became_peered":"2024-09-20T21:05:52.100421+0000","last_unstale":"2024-09-20T21:05:56.218485+0000","last_undegraded":"2024-09-20T21:05:56.218485+0000","last_fullsized":"2024-09-20T21:05:56.218485+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"95'3","reported_seq":79,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:13.654211+0000","last_change":"2024-09-20T21:06:13.654275+0000","last_active":"2024-09-20T21:06:13.654211+0000","last_peered":"2024-09-20T21:06:13.654211+0000","last_clean":"2024-09-20T21:06:13.654211+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:06:13.654211+0000","last_undegraded":"2024-09-20T21:06:13.654211+0000","last_fullsized":"2024-09-20T21:06:13.654211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T21:06:13.654024+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T21:06:13.654024+0000","last_clean_scrub_stamp":"2024-09-20T21:06:13.654024+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:17:51.099314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:10.630764+0000","last_change":"2024-09-20T21:06:10.630817+0000","last_active":"2024-09-20T21:06:10.630764+0000","last_peered":"2024-09-20T21:06:10.630764+0000","last_clean":"2024-09-20T21:06:10.630764+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:06:10.630764+0000","last_undegraded":"2024-09-20T21:06:10.630764+0000","last_fullsized":"2024-09-20T21:06:10.630764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:10.630570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:10.630570+0000","last_clean_scrub_stamp":"2024-09-20T21:06:10.630570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:42.252620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":123,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.219047+0000","last_change":"2024-09-20T21:05:45.331015+0000","last_active":"2024-09-20T21:05:56.219047+0000","last_peered":"2024-09-20T21:05:56.219047+0000","last_clean":"2024-09-20T21:05:56.219047+0000","last_became_active":"2024-09-20T21:05:45.330361+0000","last_became_peered":"2024-09-20T21:05:45.330361+0000","last_unstale":"2024-09-20T21:05:56.219047+0000","last_undegraded":"2024-09-20T21:05:56.219047+0000","last_fullsized":"2024-09-20T21:05:56.219047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:05.559363+0000","last_change":"2024-09-20T21:06:05.559416+0000","last_active":"2024-09-20T21:06:05.559363+0000","last_peered":"2024-09-20T21:06:05.559363+0000","last_clean":"2024-09-20T21:06:05.559363+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:06:05.559363+0000","last_undegraded":"2024-09-20T21:06:05.559363+0000","last_fullsized":"2024-09-20T21:06:05.559363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:05.559178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:05.559178+0000","last_clean_scrub_stamp":"2024-09-20T21:06:05.559178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:33.356703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.219273+0000","last_change":"2024-09-20T21:01:09.023198+0000","last_active":"2024-09-20T21:05:56.219273+0000","last_peered":"2024-09-20T21:05:56.219273+0000","last_clean":"2024-09-20T21:05:56.219273+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:05:56.219273+0000","last_undegraded":"2024-09-20T21:05:56.219273+0000","last_fullsized":"2024-09-20T21:05:56.219273+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.118852+0000","last_change":"2024-09-20T21:05:34.241501+0000","last_active":"2024-09-20T21:05:56.118852+0000","last_peered":"2024-09-20T21:05:56.118852+0000","last_clean":"2024-09-20T21:05:56.118852+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:05:56.118852+0000","last_undegraded":"2024-09-20T21:05:56.118852+0000","last_fullsized":"2024-09-20T21:05:56.118852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.219113+0000","last_change":"2024-09-20T21:01:11.210176+0000","last_active":"2024-09-20T21:05:56.219113+0000","last_peered":"2024-09-20T21:05:56.219113+0000","last_clean":"2024-09-20T21:05:56.219113+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:05:56.219113+0000","last_undegraded":"2024-09-20T21:05:56.219113+0000","last_fullsized":"2024-09-20T21:05:56.219113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:17.481433+0000","last_change":"2024-09-20T21:06:17.481486+0000","last_active":"2024-09-20T21:06:17.481433+0000","last_peered":"2024-09-20T21:06:17.481433+0000","last_clean":"2024-09-20T21:06:17.481433+0000","last_became_active":"2024-09-20T21:05:54.121064+0000","last_became_peered":"2024-09-20T21:05:54.121064+0000","last_unstale":"2024-09-20T21:06:17.481433+0000","last_undegraded":"2024-09-20T21:06:17.481433+0000","last_fullsized":"2024-09-20T21:06:17.481433+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:17.481241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:17.481241+0000","last_clean_scrub_stamp":"2024-09-20T21:06:17.481241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:02:12.942672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.119075+0000","last_change":"2024-09-20T21:05:54.132710+0000","last_active":"2024-09-20T21:05:56.119075+0000","last_peered":"2024-09-20T21:05:56.119075+0000","last_clean":"2024-09-20T21:05:56.119075+0000","last_became_active":"2024-09-20T21:05:54.127863+0000","last_became_peered":"2024-09-20T21:05:54.127863+0000","last_unstale":"2024-09-20T21:05:56.119075+0000","last_undegraded":"2024-09-20T21:05:56.119075+0000","last_fullsized":"2024-09-20T21:05:56.119075+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218949+0000","last_change":"2024-09-20T21:01:11.210384+0000","last_active":"2024-09-20T21:05:56.218949+0000","last_peered":"2024-09-20T21:05:56.218949+0000","last_clean":"2024-09-20T21:05:56.218949+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:05:56.218949+0000","last_undegraded":"2024-09-20T21:05:56.218949+0000","last_fullsized":"2024-09-20T21:05:56.218949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:19.226605+0000","last_change":"2024-09-20T21:06:19.226657+0000","last_active":"2024-09-20T21:06:19.226605+0000","last_peered":"2024-09-20T21:06:19.226605+0000","last_clean":"2024-09-20T21:06:19.226605+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:06:19.226605+0000","last_undegraded":"2024-09-20T21:06:19.226605+0000","last_fullsized":"2024-09-20T21:06:19.226605+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:19.226409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:19.226409+0000","last_clean_scrub_stamp":"2024-09-20T21:06:19.226409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:09.599821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:04.226543+0000","last_change":"2024-09-20T21:06:04.226599+0000","last_active":"2024-09-20T21:06:04.226543+0000","last_peered":"2024-09-20T21:06:04.226543+0000","last_clean":"2024-09-20T21:06:04.226543+0000","last_became_active":"2024-09-20T21:05:37.266438+0000","last_became_peered":"2024-09-20T21:05:37.266438+0000","last_unstale":"2024-09-20T21:06:04.226543+0000","last_undegraded":"2024-09-20T21:06:04.226543+0000","last_fullsized":"2024-09-20T21:06:04.226543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:04.226344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:04.226344+0000","last_clean_scrub_stamp":"2024-09-20T21:06:04.226344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:26:55.211345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"95'2","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:08.170260+0000","last_change":"2024-09-20T21:06:08.170326+0000","last_active":"2024-09-20T21:06:08.170260+0000","last_peered":"2024-09-20T21:06:08.170260+0000","last_clean":"2024-09-20T21:06:08.170260+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:06:08.170260+0000","last_undegraded":"2024-09-20T21:06:08.170260+0000","last_fullsized":"2024-09-20T21:06:08.170260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-20T21:06:08.170067+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-20T21:06:08.170067+0000","last_clean_scrub_stamp":"2024-09-20T21:06:08.170067+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:36:07.743961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.396271+0000","last_change":"2024-09-20T21:05:55.395346+0000","last_active":"2024-09-20T21:05:55.396271+0000","last_peered":"2024-09-20T21:05:55.396271+0000","last_clean":"2024-09-20T21:05:55.396271+0000","last_became_active":"2024-09-20T21:05:55.394868+0000","last_became_peered":"2024-09-20T21:05:55.394868+0000","last_unstale":"2024-09-20T21:05:55.396271+0000","last_undegraded":"2024-09-20T21:05:55.396271+0000","last_fullsized":"2024-09-20T21:05:55.396271+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:05.975597+0000","last_clean_scrub_stamp":"2024-09-20T21:01:05.975597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:13.521938+0000","last_change":"2024-09-20T21:06:13.521993+0000","last_active":"2024-09-20T21:06:13.521938+0000","last_peered":"2024-09-20T21:06:13.521938+0000","last_clean":"2024-09-20T21:06:13.521938+0000","last_became_active":"2024-09-20T21:05:54.119503+0000","last_became_peered":"2024-09-20T21:05:54.119503+0000","last_unstale":"2024-09-20T21:06:13.521938+0000","last_undegraded":"2024-09-20T21:06:13.521938+0000","last_fullsized":"2024-09-20T21:06:13.521938+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:13.521724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:13.521724+0000","last_clean_scrub_stamp":"2024-09-20T21:06:13.521724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:40.776859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391561+0000","last_change":"2024-09-20T21:05:33.511892+0000","last_active":"2024-09-20T21:05:55.391561+0000","last_peered":"2024-09-20T21:05:55.391561+0000","last_clean":"2024-09-20T21:05:55.391561+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:05:55.391561+0000","last_undegraded":"2024-09-20T21:05:55.391561+0000","last_fullsized":"2024-09-20T21:05:55.391561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.390904+0000","last_change":"2024-09-20T21:05:33.506663+0000","last_active":"2024-09-20T21:05:55.390904+0000","last_peered":"2024-09-20T21:05:55.390904+0000","last_clean":"2024-09-20T21:05:55.390904+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:05:55.390904+0000","last_undegraded":"2024-09-20T21:05:55.390904+0000","last_fullsized":"2024-09-20T21:05:55.390904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:18.244287+0000","last_change":"2024-09-20T21:06:18.244344+0000","last_active":"2024-09-20T21:06:18.244287+0000","last_peered":"2024-09-20T21:06:18.244287+0000","last_clean":"2024-09-20T21:06:18.244287+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:06:18.244287+0000","last_undegraded":"2024-09-20T21:06:18.244287+0000","last_fullsized":"2024-09-20T21:06:18.244287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:18.244086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:18.244086+0000","last_clean_scrub_stamp":"2024-09-20T21:06:18.244086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:20.038040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"95'5","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.544064+0000","last_change":"2024-09-20T21:06:02.544064+0000","last_active":"2024-09-20T21:06:02.544064+0000","last_peered":"2024-09-20T21:06:02.544064+0000","last_clean":"2024-09-20T21:06:02.544064+0000","last_became_active":"2024-09-20T21:05:54.128221+0000","last_became_peered":"2024-09-20T21:05:54.128221+0000","last_unstale":"2024-09-20T21:06:02.544064+0000","last_undegraded":"2024-09-20T21:06:02.544064+0000","last_fullsized":"2024-09-20T21:06:02.544064+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'5","last_scrub_stamp":"2024-09-20T21:06:02.543814+0000","last_deep_scrub":"95'5","last_deep_scrub_stamp":"2024-09-20T21:06:02.543814+0000","last_clean_scrub_stamp":"2024-09-20T21:06:02.543814+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:54:44.260806+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:15.650760+0000","last_change":"2024-09-20T21:06:15.650811+0000","last_active":"2024-09-20T21:06:15.650760+0000","last_peered":"2024-09-20T21:06:15.650760+0000","last_clean":"2024-09-20T21:06:15.650760+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:06:15.650760+0000","last_undegraded":"2024-09-20T21:06:15.650760+0000","last_fullsized":"2024-09-20T21:06:15.650760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:15.650560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:15.650560+0000","last_clean_scrub_stamp":"2024-09-20T21:06:15.650560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:05.868240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.216997+0000","last_change":"2024-09-20T21:05:52.104238+0000","last_active":"2024-09-20T21:05:56.216997+0000","last_peered":"2024-09-20T21:05:56.216997+0000","last_clean":"2024-09-20T21:05:56.216997+0000","last_became_active":"2024-09-20T21:05:52.103630+0000","last_became_peered":"2024-09-20T21:05:52.103630+0000","last_unstale":"2024-09-20T21:05:56.216997+0000","last_undegraded":"2024-09-20T21:05:56.216997+0000","last_fullsized":"2024-09-20T21:05:56.216997+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:10.233120+0000","last_change":"2024-09-20T21:06:10.233177+0000","last_active":"2024-09-20T21:06:10.233120+0000","last_peered":"2024-09-20T21:06:10.233120+0000","last_clean":"2024-09-20T21:06:10.233120+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:06:10.233120+0000","last_undegraded":"2024-09-20T21:06:10.233120+0000","last_fullsized":"2024-09-20T21:06:10.233120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:10.232921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:10.232921+0000","last_clean_scrub_stamp":"2024-09-20T21:06:10.232921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:55.452940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.215951+0000","last_change":"2024-09-20T21:05:52.100914+0000","last_active":"2024-09-20T21:05:56.215951+0000","last_peered":"2024-09-20T21:05:56.215951+0000","last_clean":"2024-09-20T21:05:56.215951+0000","last_became_active":"2024-09-20T21:05:52.100104+0000","last_became_peered":"2024-09-20T21:05:52.100104+0000","last_unstale":"2024-09-20T21:05:56.215951+0000","last_undegraded":"2024-09-20T21:05:56.215951+0000","last_fullsized":"2024-09-20T21:05:56.215951+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.120535+0000","last_change":"2024-09-20T21:05:34.248368+0000","last_active":"2024-09-20T21:05:56.120535+0000","last_peered":"2024-09-20T21:05:56.120535+0000","last_clean":"2024-09-20T21:05:56.120535+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:05:56.120535+0000","last_undegraded":"2024-09-20T21:05:56.120535+0000","last_fullsized":"2024-09-20T21:05:56.120535+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:07.198885+0000","last_change":"2024-09-20T21:06:07.198988+0000","last_active":"2024-09-20T21:06:07.198885+0000","last_peered":"2024-09-20T21:06:07.198885+0000","last_clean":"2024-09-20T21:06:07.198885+0000","last_became_active":"2024-09-20T21:05:37.268982+0000","last_became_peered":"2024-09-20T21:05:37.268982+0000","last_unstale":"2024-09-20T21:06:07.198885+0000","last_undegraded":"2024-09-20T21:06:07.198885+0000","last_fullsized":"2024-09-20T21:06:07.198885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:07.198669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:07.198669+0000","last_clean_scrub_stamp":"2024-09-20T21:06:07.198669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:55.378830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:09.184857+0000","last_change":"2024-09-20T21:06:09.184908+0000","last_active":"2024-09-20T21:06:09.184857+0000","last_peered":"2024-09-20T21:06:09.184857+0000","last_clean":"2024-09-20T21:06:09.184857+0000","last_became_active":"2024-09-20T21:05:45.320924+0000","last_became_peered":"2024-09-20T21:05:45.320924+0000","last_unstale":"2024-09-20T21:06:09.184857+0000","last_undegraded":"2024-09-20T21:06:09.184857+0000","last_fullsized":"2024-09-20T21:06:09.184857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:09.184666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:09.184666+0000","last_clean_scrub_stamp":"2024-09-20T21:06:09.184666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:24.931905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:11.269769+0000","last_change":"2024-09-20T21:06:11.269825+0000","last_active":"2024-09-20T21:06:11.269769+0000","last_peered":"2024-09-20T21:06:11.269769+0000","last_clean":"2024-09-20T21:06:11.269769+0000","last_became_active":"2024-09-20T21:05:45.321031+0000","last_became_peered":"2024-09-20T21:05:45.321031+0000","last_unstale":"2024-09-20T21:06:11.269769+0000","last_undegraded":"2024-09-20T21:06:11.269769+0000","last_fullsized":"2024-09-20T21:06:11.269769+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:11.269575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:11.269575+0000","last_clean_scrub_stamp":"2024-09-20T21:06:11.269575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:46.791985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:16.519128+0000","last_change":"2024-09-20T21:06:16.519226+0000","last_active":"2024-09-20T21:06:16.519128+0000","last_peered":"2024-09-20T21:06:16.519128+0000","last_clean":"2024-09-20T21:06:16.519128+0000","last_became_active":"2024-09-20T21:05:54.125123+0000","last_became_peered":"2024-09-20T21:05:54.125123+0000","last_unstale":"2024-09-20T21:06:16.519128+0000","last_undegraded":"2024-09-20T21:06:16.519128+0000","last_fullsized":"2024-09-20T21:06:16.519128+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:16.518848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:16.518848+0000","last_clean_scrub_stamp":"2024-09-20T21:06:16.518848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:50.967089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":127,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:11.493306+0000","last_change":"2024-09-20T21:06:11.493306+0000","last_active":"2024-09-20T21:06:11.493306+0000","last_peered":"2024-09-20T21:06:11.493306+0000","last_clean":"2024-09-20T21:06:11.493306+0000","last_became_active":"2024-09-20T21:05:54.121466+0000","last_became_peered":"2024-09-20T21:05:54.121466+0000","last_unstale":"2024-09-20T21:06:11.493306+0000","last_undegraded":"2024-09-20T21:06:11.493306+0000","last_fullsized":"2024-09-20T21:06:11.493306+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-20T21:06:11.493042+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-20T21:06:11.493042+0000","last_clean_scrub_stamp":"2024-09-20T21:06:11.493042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:05:01.552593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":126,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.519192+0000","last_change":"2024-09-20T21:05:54.132657+0000","last_active":"2024-09-20T21:06:02.519192+0000","last_peered":"2024-09-20T21:06:02.519192+0000","last_clean":"2024-09-20T21:06:02.519192+0000","last_became_active":"2024-09-20T21:05:54.129891+0000","last_became_peered":"2024-09-20T21:05:54.129891+0000","last_unstale":"2024-09-20T21:06:02.519192+0000","last_undegraded":"2024-09-20T21:06:02.519192+0000","last_fullsized":"2024-09-20T21:06:02.519192+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:11.169670+0000","last_clean_scrub_stamp":"2024-09-20T21:01:11.169670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:14.537241+0000","last_change":"2024-09-20T21:06:14.537241+0000","last_active":"2024-09-20T21:06:14.537241+0000","last_peered":"2024-09-20T21:06:14.537241+0000","last_clean":"2024-09-20T21:06:14.537241+0000","last_became_active":"2024-09-20T21:05:54.120527+0000","last_became_peered":"2024-09-20T21:05:54.120527+0000","last_unstale":"2024-09-20T21:06:14.537241+0000","last_undegraded":"2024-09-20T21:06:14.537241+0000","last_fullsized":"2024-09-20T21:06:14.537241+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-20T21:06:14.536978+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-20T21:06:14.536978+0000","last_clean_scrub_stamp":"2024-09-20T21:06:14.536978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:25:17.326966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:07.542492+0000","last_change":"2024-09-20T21:06:07.542549+0000","last_active":"2024-09-20T21:06:07.542492+0000","last_peered":"2024-09-20T21:06:07.542492+0000","last_clean":"2024-09-20T21:06:07.542492+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:06:07.542492+0000","last_undegraded":"2024-09-20T21:06:07.542492+0000","last_fullsized":"2024-09-20T21:06:07.542492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:07.542297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:07.542297+0000","last_clean_scrub_stamp":"2024-09-20T21:06:07.542297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:31.587837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:55.391491+0000","last_change":"2024-09-20T21:05:36.556689+0000","last_active":"2024-09-20T21:05:55.391491+0000","last_peered":"2024-09-20T21:05:55.391491+0000","last_clean":"2024-09-20T21:05:55.391491+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:05:55.391491+0000","last_undegraded":"2024-09-20T21:05:55.391491+0000","last_fullsized":"2024-09-20T21:05:55.391491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:11.612328+0000","last_change":"2024-09-20T21:06:11.612382+0000","last_active":"2024-09-20T21:06:11.612328+0000","last_peered":"2024-09-20T21:06:11.612328+0000","last_clean":"2024-09-20T21:06:11.612328+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:06:11.612328+0000","last_undegraded":"2024-09-20T21:06:11.612328+0000","last_fullsized":"2024-09-20T21:06:11.612328+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:11.612097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:11.612097+0000","last_clean_scrub_stamp":"2024-09-20T21:06:11.612097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:54.713831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"95'3","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:08.544238+0000","last_change":"2024-09-20T21:06:08.544238+0000","last_active":"2024-09-20T21:06:08.544238+0000","last_peered":"2024-09-20T21:06:08.544238+0000","last_clean":"2024-09-20T21:06:08.544238+0000","last_became_active":"2024-09-20T21:05:54.124075+0000","last_became_peered":"2024-09-20T21:05:54.124075+0000","last_unstale":"2024-09-20T21:06:08.544238+0000","last_undegraded":"2024-09-20T21:06:08.544238+0000","last_fullsized":"2024-09-20T21:06:08.544238+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T21:06:08.543852+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T21:06:08.543852+0000","last_clean_scrub_stamp":"2024-09-20T21:06:08.543852+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:20.421052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:09.551625+0000","last_change":"2024-09-20T21:06:09.551678+0000","last_active":"2024-09-20T21:06:09.551625+0000","last_peered":"2024-09-20T21:06:09.551625+0000","last_clean":"2024-09-20T21:06:09.551625+0000","last_became_active":"2024-09-20T21:05:54.121408+0000","last_became_peered":"2024-09-20T21:05:54.121408+0000","last_unstale":"2024-09-20T21:06:09.551625+0000","last_undegraded":"2024-09-20T21:06:09.551625+0000","last_fullsized":"2024-09-20T21:06:09.551625+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:09.551425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:09.551425+0000","last_clean_scrub_stamp":"2024-09-20T21:06:09.551425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:25.298665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:05:56.218451+0000","last_change":"2024-09-20T21:01:11.218346+0000","last_active":"2024-09-20T21:05:56.218451+0000","last_peered":"2024-09-20T21:05:56.218451+0000","last_clean":"2024-09-20T21:05:56.218451+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:05:56.218451+0000","last_undegraded":"2024-09-20T21:05:56.218451+0000","last_fullsized":"2024-09-20T21:05:56.218451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:01:10.157774+0000","last_clean_scrub_stamp":"2024-09-20T21:01:10.157774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:03.496977+0000","last_change":"2024-09-20T21:06:03.497031+0000","last_active":"2024-09-20T21:06:03.496977+0000","last_peered":"2024-09-20T21:06:03.496977+0000","last_clean":"2024-09-20T21:06:03.496977+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:06:03.496977+0000","last_undegraded":"2024-09-20T21:06:03.496977+0000","last_fullsized":"2024-09-20T21:06:03.496977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:03.496798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:03.496798+0000","last_clean_scrub_stamp":"2024-09-20T21:06:03.496798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:49.946589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"95'6","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:15.188822+0000","last_change":"2024-09-20T21:06:15.188888+0000","last_active":"2024-09-20T21:06:15.188822+0000","last_peered":"2024-09-20T21:06:15.188822+0000","last_clean":"2024-09-20T21:06:15.188822+0000","last_became_active":"2024-09-20T21:05:45.321268+0000","last_became_peered":"2024-09-20T21:05:45.321268+0000","last_unstale":"2024-09-20T21:06:15.188822+0000","last_undegraded":"2024-09-20T21:06:15.188822+0000","last_fullsized":"2024-09-20T21:06:15.188822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'6","last_scrub_stamp":"2024-09-20T21:06:15.188637+0000","last_deep_scrub":"95'6","last_deep_scrub_stamp":"2024-09-20T21:06:15.188637+0000","last_clean_scrub_stamp":"2024-09-20T21:06:15.188637+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:48:23.961965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738437,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216924,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94154916,"statfs":{"total":96636764160,"available":96414633984,"internally_reserved":0,"allocated":1126400,"data_stored":1004346,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350988,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54632,"kb_used_data":1112,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317208,"statfs":{"total":96636764160,"available":96580820992,"internally_reserved":0,"allocated":1138688,"data_stored":1004981,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325140,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046700,"statfs":{"total":96636764160,"available":96303820800,"internally_reserved":0,"allocated":1052672,"data_stored":412819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:06:23.198 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.198 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.198 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.199 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.199 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.199 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.199 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.199 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.199 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.199 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.199 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.199 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.200 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.200 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.200 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.200 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.200 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.200 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.200 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.200 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.200 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.201 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.201 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.201 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.201 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.201 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.201 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.201 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.201 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-20T21:01:00.942617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.202 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.202 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.202 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.202 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.203 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.203 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.203 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.203 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.203 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.203 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.203 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-20T21:01:05.975597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=5, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.203 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.203 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.204 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.204 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.204 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.204 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-20T21:01:11.169670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=11, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.204 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.204 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-20T21:01:10.157774+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=1, tm_sec=10, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=21, tm_min=6, tm_sec=0, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T21:06:23.204 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-20T21:06:43.206 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T21:06:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:06:43.515 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-20T21:06:43.530 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-09-20T21:06:43.008623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":596696,"kb_used_data":3240,"kb_used_omap":10,"kb_used_meta":593397,"kb_avail":282518824,"statfs":{"total":289910292480,"available":289299275776,"internally_reserved":0,"allocated":3317760,"data_stored":2422146,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":10334,"internal_metadata":607639458},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004550"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:28.293738+0000","last_change":"2024-09-20T21:06:28.293790+0000","last_active":"2024-09-20T21:06:28.293738+0000","last_peered":"2024-09-20T21:06:28.293738+0000","last_clean":"2024-09-20T21:06:28.293738+0000","last_became_active":"2024-09-20T21:05:54.127664+0000","last_became_peered":"2024-09-20T21:05:54.127664+0000","last_unstale":"2024-09-20T21:06:28.293738+0000","last_undegraded":"2024-09-20T21:06:28.293738+0000","last_fullsized":"2024-09-20T21:06:28.293738+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:28.293546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:28.293546+0000","last_clean_scrub_stamp":"2024-09-20T21:06:28.293546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:15.280089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":130,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:04.509992+0000","last_change":"2024-09-20T21:06:04.510043+0000","last_active":"2024-09-20T21:06:04.509992+0000","last_peered":"2024-09-20T21:06:04.509992+0000","last_clean":"2024-09-20T21:06:04.509992+0000","last_became_active":"2024-09-20T21:05:54.124269+0000","last_became_peered":"2024-09-20T21:05:54.124269+0000","last_unstale":"2024-09-20T21:06:04.509992+0000","last_undegraded":"2024-09-20T21:06:04.509992+0000","last_fullsized":"2024-09-20T21:06:04.509992+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:04.509812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:04.509812+0000","last_clean_scrub_stamp":"2024-09-20T21:06:04.509812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:26:55.494813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.536559+0000","last_change":"2024-09-20T21:06:02.536609+0000","last_active":"2024-09-20T21:06:02.536559+0000","last_peered":"2024-09-20T21:06:02.536559+0000","last_clean":"2024-09-20T21:06:02.536559+0000","last_became_active":"2024-09-20T21:05:33.523572+0000","last_became_peered":"2024-09-20T21:05:33.523572+0000","last_unstale":"2024-09-20T21:06:02.536559+0000","last_undegraded":"2024-09-20T21:06:02.536559+0000","last_fullsized":"2024-09-20T21:06:02.536559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:02.536374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:02.536374+0000","last_clean_scrub_stamp":"2024-09-20T21:06:02.536374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:27:24.589839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:14.604780+0000","last_change":"2024-09-20T21:06:14.604831+0000","last_active":"2024-09-20T21:06:14.604780+0000","last_peered":"2024-09-20T21:06:14.604780+0000","last_clean":"2024-09-20T21:06:14.604780+0000","last_became_active":"2024-09-20T21:05:33.514641+0000","last_became_peered":"2024-09-20T21:05:33.514641+0000","last_unstale":"2024-09-20T21:06:14.604780+0000","last_undegraded":"2024-09-20T21:06:14.604780+0000","last_fullsized":"2024-09-20T21:06:14.604780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:14.604590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:14.604590+0000","last_clean_scrub_stamp":"2024-09-20T21:06:14.604590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:05.449605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:29.318233+0000","last_change":"2024-09-20T21:06:29.318287+0000","last_active":"2024-09-20T21:06:29.318233+0000","last_peered":"2024-09-20T21:06:29.318233+0000","last_clean":"2024-09-20T21:06:29.318233+0000","last_became_active":"2024-09-20T21:05:54.125511+0000","last_became_peered":"2024-09-20T21:05:54.125511+0000","last_unstale":"2024-09-20T21:06:29.318233+0000","last_undegraded":"2024-09-20T21:06:29.318233+0000","last_fullsized":"2024-09-20T21:06:29.318233+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:29.318012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:29.318012+0000","last_clean_scrub_stamp":"2024-09-20T21:06:29.318012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:00.193164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:17.591702+0000","last_change":"2024-09-20T21:06:17.591759+0000","last_active":"2024-09-20T21:06:17.591702+0000","last_peered":"2024-09-20T21:06:17.591702+0000","last_clean":"2024-09-20T21:06:17.591702+0000","last_became_active":"2024-09-20T21:05:33.521075+0000","last_became_peered":"2024-09-20T21:05:33.521075+0000","last_unstale":"2024-09-20T21:06:17.591702+0000","last_undegraded":"2024-09-20T21:06:17.591702+0000","last_fullsized":"2024-09-20T21:06:17.591702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:17.591513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:17.591513+0000","last_clean_scrub_stamp":"2024-09-20T21:06:17.591513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:33:03.503561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:38.615219+0000","last_change":"2024-09-20T21:06:38.615274+0000","last_active":"2024-09-20T21:06:38.615219+0000","last_peered":"2024-09-20T21:06:38.615219+0000","last_clean":"2024-09-20T21:06:38.615219+0000","last_became_active":"2024-09-20T21:05:55.492104+0000","last_became_peered":"2024-09-20T21:05:55.492104+0000","last_unstale":"2024-09-20T21:06:38.615219+0000","last_undegraded":"2024-09-20T21:06:38.615219+0000","last_fullsized":"2024-09-20T21:06:38.615219+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:38.615033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:38.615033+0000","last_clean_scrub_stamp":"2024-09-20T21:06:38.615033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:33.562178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:21.514969+0000","last_change":"2024-09-20T21:06:21.515038+0000","last_active":"2024-09-20T21:06:21.514969+0000","last_peered":"2024-09-20T21:06:21.514969+0000","last_clean":"2024-09-20T21:06:21.514969+0000","last_became_active":"2024-09-20T21:05:33.517933+0000","last_became_peered":"2024-09-20T21:05:33.517933+0000","last_unstale":"2024-09-20T21:06:21.514969+0000","last_undegraded":"2024-09-20T21:06:21.514969+0000","last_fullsized":"2024-09-20T21:06:21.514969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:21.514750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:21.514750+0000","last_clean_scrub_stamp":"2024-09-20T21:06:21.514750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:52.959852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:29.157121+0000","last_change":"2024-09-20T21:06:29.157177+0000","last_active":"2024-09-20T21:06:29.157121+0000","last_peered":"2024-09-20T21:06:29.157121+0000","last_clean":"2024-09-20T21:06:29.157121+0000","last_became_active":"2024-09-20T21:05:45.327207+0000","last_became_peered":"2024-09-20T21:05:45.327207+0000","last_unstale":"2024-09-20T21:06:29.157121+0000","last_undegraded":"2024-09-20T21:06:29.157121+0000","last_fullsized":"2024-09-20T21:06:29.157121+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:29.156932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:29.156932+0000","last_clean_scrub_stamp":"2024-09-20T21:06:29.156932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:02.155515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:05.499952+0000","last_change":"2024-09-20T21:06:05.500004+0000","last_active":"2024-09-20T21:06:05.499952+0000","last_peered":"2024-09-20T21:06:05.499952+0000","last_clean":"2024-09-20T21:06:05.499952+0000","last_became_active":"2024-09-20T21:05:54.124291+0000","last_became_peered":"2024-09-20T21:05:54.124291+0000","last_unstale":"2024-09-20T21:06:05.499952+0000","last_undegraded":"2024-09-20T21:06:05.499952+0000","last_fullsized":"2024-09-20T21:06:05.499952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:05.499755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:05.499755+0000","last_clean_scrub_stamp":"2024-09-20T21:06:05.499755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:06:12.890860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:32.526176+0000","last_change":"2024-09-20T21:06:32.526232+0000","last_active":"2024-09-20T21:06:32.526176+0000","last_peered":"2024-09-20T21:06:32.526176+0000","last_clean":"2024-09-20T21:06:32.526176+0000","last_became_active":"2024-09-20T21:05:36.541895+0000","last_became_peered":"2024-09-20T21:05:36.541895+0000","last_unstale":"2024-09-20T21:06:32.526176+0000","last_undegraded":"2024-09-20T21:06:32.526176+0000","last_fullsized":"2024-09-20T21:06:32.526176+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:32.525986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:32.525986+0000","last_clean_scrub_stamp":"2024-09-20T21:06:32.525986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:28:47.166960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:26.330705+0000","last_change":"2024-09-20T21:06:26.330774+0000","last_active":"2024-09-20T21:06:26.330705+0000","last_peered":"2024-09-20T21:06:26.330705+0000","last_clean":"2024-09-20T21:06:26.330705+0000","last_became_active":"2024-09-20T21:05:34.246735+0000","last_became_peered":"2024-09-20T21:05:34.246735+0000","last_unstale":"2024-09-20T21:06:26.330705+0000","last_undegraded":"2024-09-20T21:06:26.330705+0000","last_fullsized":"2024-09-20T21:06:26.330705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:26.330488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:26.330488+0000","last_clean_scrub_stamp":"2024-09-20T21:06:26.330488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:28:49.321249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:30.360698+0000","last_change":"2024-09-20T21:06:30.360750+0000","last_active":"2024-09-20T21:06:30.360698+0000","last_peered":"2024-09-20T21:06:30.360698+0000","last_clean":"2024-09-20T21:06:30.360698+0000","last_became_active":"2024-09-20T21:05:54.128147+0000","last_became_peered":"2024-09-20T21:05:54.128147+0000","last_unstale":"2024-09-20T21:06:30.360698+0000","last_undegraded":"2024-09-20T21:06:30.360698+0000","last_fullsized":"2024-09-20T21:06:30.360698+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:30.360499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:30.360499+0000","last_clean_scrub_stamp":"2024-09-20T21:06:30.360499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:35.683893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:27.558364+0000","last_change":"2024-09-20T21:06:27.558419+0000","last_active":"2024-09-20T21:06:27.558364+0000","last_peered":"2024-09-20T21:06:27.558364+0000","last_clean":"2024-09-20T21:06:27.558364+0000","last_became_active":"2024-09-20T21:05:33.507198+0000","last_became_peered":"2024-09-20T21:05:33.507198+0000","last_unstale":"2024-09-20T21:06:27.558364+0000","last_undegraded":"2024-09-20T21:06:27.558364+0000","last_fullsized":"2024-09-20T21:06:27.558364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:27.558163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:27.558163+0000","last_clean_scrub_stamp":"2024-09-20T21:06:27.558163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:10.100790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:30.497343+0000","last_change":"2024-09-20T21:06:30.497400+0000","last_active":"2024-09-20T21:06:30.497343+0000","last_peered":"2024-09-20T21:06:30.497343+0000","last_clean":"2024-09-20T21:06:30.497343+0000","last_became_active":"2024-09-20T21:05:33.508979+0000","last_became_peered":"2024-09-20T21:05:33.508979+0000","last_unstale":"2024-09-20T21:06:30.497343+0000","last_undegraded":"2024-09-20T21:06:30.497343+0000","last_fullsized":"2024-09-20T21:06:30.497343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:30.497143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:30.497143+0000","last_clean_scrub_stamp":"2024-09-20T21:06:30.497143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:34.805967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:35.617450+0000","last_change":"2024-09-20T21:06:35.617619+0000","last_active":"2024-09-20T21:06:35.617450+0000","last_peered":"2024-09-20T21:06:35.617450+0000","last_clean":"2024-09-20T21:06:35.617450+0000","last_became_active":"2024-09-20T21:05:55.489879+0000","last_became_peered":"2024-09-20T21:05:55.489879+0000","last_unstale":"2024-09-20T21:06:35.617450+0000","last_undegraded":"2024-09-20T21:06:35.617450+0000","last_fullsized":"2024-09-20T21:06:35.617450+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:35.617237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:35.617237+0000","last_clean_scrub_stamp":"2024-09-20T21:06:35.617237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:25.149012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:25.259793+0000","last_change":"2024-09-20T21:06:25.259845+0000","last_active":"2024-09-20T21:06:25.259793+0000","last_peered":"2024-09-20T21:06:25.259793+0000","last_clean":"2024-09-20T21:06:25.259793+0000","last_became_active":"2024-09-20T21:01:12.221944+0000","last_became_peered":"2024-09-20T21:01:12.221944+0000","last_unstale":"2024-09-20T21:06:25.259793+0000","last_undegraded":"2024-09-20T21:06:25.259793+0000","last_fullsized":"2024-09-20T21:06:25.259793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:25.259590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:25.259590+0000","last_clean_scrub_stamp":"2024-09-20T21:06:25.259590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:29:08.877148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:20.457965+0000","last_change":"2024-09-20T21:06:20.458017+0000","last_active":"2024-09-20T21:06:20.457965+0000","last_peered":"2024-09-20T21:06:20.457965+0000","last_clean":"2024-09-20T21:06:20.457965+0000","last_became_active":"2024-09-20T21:01:12.235821+0000","last_became_peered":"2024-09-20T21:01:12.235821+0000","last_unstale":"2024-09-20T21:06:20.457965+0000","last_undegraded":"2024-09-20T21:06:20.457965+0000","last_fullsized":"2024-09-20T21:06:20.457965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:20.457778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:20.457778+0000","last_clean_scrub_stamp":"2024-09-20T21:06:20.457778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:02:39.382961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:28.192655+0000","last_change":"2024-09-20T21:06:28.192781+0000","last_active":"2024-09-20T21:06:28.192655+0000","last_peered":"2024-09-20T21:06:28.192655+0000","last_clean":"2024-09-20T21:06:28.192655+0000","last_became_active":"2024-09-20T21:05:45.326913+0000","last_became_peered":"2024-09-20T21:05:45.326913+0000","last_unstale":"2024-09-20T21:06:28.192655+0000","last_undegraded":"2024-09-20T21:06:28.192655+0000","last_fullsized":"2024-09-20T21:06:28.192655+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:28.192427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:28.192427+0000","last_clean_scrub_stamp":"2024-09-20T21:06:28.192427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:18.956160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:37.579610+0000","last_change":"2024-09-20T21:06:37.579660+0000","last_active":"2024-09-20T21:06:37.579610+0000","last_peered":"2024-09-20T21:06:37.579610+0000","last_clean":"2024-09-20T21:06:37.579610+0000","last_became_active":"2024-09-20T21:05:55.491995+0000","last_became_peered":"2024-09-20T21:05:55.491995+0000","last_unstale":"2024-09-20T21:06:37.579610+0000","last_undegraded":"2024-09-20T21:06:37.579610+0000","last_fullsized":"2024-09-20T21:06:37.579610+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:37.579431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:37.579431+0000","last_clean_scrub_stamp":"2024-09-20T21:06:37.579431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:17:31.113042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:09.602953+0000","last_change":"2024-09-20T21:06:09.603007+0000","last_active":"2024-09-20T21:06:09.602953+0000","last_peered":"2024-09-20T21:06:09.602953+0000","last_clean":"2024-09-20T21:06:09.602953+0000","last_became_active":"2024-09-20T21:05:33.521185+0000","last_became_peered":"2024-09-20T21:05:33.521185+0000","last_unstale":"2024-09-20T21:06:09.602953+0000","last_undegraded":"2024-09-20T21:06:09.602953+0000","last_fullsized":"2024-09-20T21:06:09.602953+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:09.602773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:09.602773+0000","last_clean_scrub_stamp":"2024-09-20T21:06:09.602773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:08.291067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:24.362396+0000","last_change":"2024-09-20T21:06:24.362457+0000","last_active":"2024-09-20T21:06:24.362396+0000","last_peered":"2024-09-20T21:06:24.362396+0000","last_clean":"2024-09-20T21:06:24.362396+0000","last_became_active":"2024-09-20T21:05:34.240859+0000","last_became_peered":"2024-09-20T21:05:34.240859+0000","last_unstale":"2024-09-20T21:06:24.362396+0000","last_undegraded":"2024-09-20T21:06:24.362396+0000","last_fullsized":"2024-09-20T21:06:24.362396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:24.362186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:24.362186+0000","last_clean_scrub_stamp":"2024-09-20T21:06:24.362186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:30:17.920172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:33.115075+0000","last_change":"2024-09-20T21:06:33.115127+0000","last_active":"2024-09-20T21:06:33.115075+0000","last_peered":"2024-09-20T21:06:33.115075+0000","last_clean":"2024-09-20T21:06:33.115075+0000","last_became_active":"2024-09-20T21:05:52.103477+0000","last_became_peered":"2024-09-20T21:05:52.103477+0000","last_unstale":"2024-09-20T21:06:33.115075+0000","last_undegraded":"2024-09-20T21:06:33.115075+0000","last_fullsized":"2024-09-20T21:06:33.115075+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:33.114880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:33.114880+0000","last_clean_scrub_stamp":"2024-09-20T21:06:33.114880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:05:45.698072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:35.324545+0000","last_change":"2024-09-20T21:06:35.324607+0000","last_active":"2024-09-20T21:06:35.324545+0000","last_peered":"2024-09-20T21:06:35.324545+0000","last_clean":"2024-09-20T21:06:35.324545+0000","last_became_active":"2024-09-20T21:05:54.129639+0000","last_became_peered":"2024-09-20T21:05:54.129639+0000","last_unstale":"2024-09-20T21:06:35.324545+0000","last_undegraded":"2024-09-20T21:06:35.324545+0000","last_fullsized":"2024-09-20T21:06:35.324545+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:35.324354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:35.324354+0000","last_clean_scrub_stamp":"2024-09-20T21:06:35.324354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:42:15.802486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:06.516713+0000","last_change":"2024-09-20T21:06:06.516774+0000","last_active":"2024-09-20T21:06:06.516713+0000","last_peered":"2024-09-20T21:06:06.516713+0000","last_clean":"2024-09-20T21:06:06.516713+0000","last_became_active":"2024-09-20T21:05:54.124757+0000","last_became_peered":"2024-09-20T21:05:54.124757+0000","last_unstale":"2024-09-20T21:06:06.516713+0000","last_undegraded":"2024-09-20T21:06:06.516713+0000","last_fullsized":"2024-09-20T21:06:06.516713+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:06.516526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:06.516526+0000","last_clean_scrub_stamp":"2024-09-20T21:06:06.516526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:23.791289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.203966+0000","last_change":"2024-09-20T21:06:02.204018+0000","last_active":"2024-09-20T21:06:02.203966+0000","last_peered":"2024-09-20T21:06:02.203966+0000","last_clean":"2024-09-20T21:06:02.203966+0000","last_became_active":"2024-09-20T21:05:45.321767+0000","last_became_peered":"2024-09-20T21:05:45.321767+0000","last_unstale":"2024-09-20T21:06:02.203966+0000","last_undegraded":"2024-09-20T21:06:02.203966+0000","last_fullsized":"2024-09-20T21:06:02.203966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:02.203778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:02.203778+0000","last_clean_scrub_stamp":"2024-09-20T21:06:02.203778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:54:43.920771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:04.512459+0000","last_change":"2024-09-20T21:06:04.512512+0000","last_active":"2024-09-20T21:06:04.512459+0000","last_peered":"2024-09-20T21:06:04.512459+0000","last_clean":"2024-09-20T21:06:04.512459+0000","last_became_active":"2024-09-20T21:05:33.517938+0000","last_became_peered":"2024-09-20T21:05:33.517938+0000","last_unstale":"2024-09-20T21:06:04.512459+0000","last_undegraded":"2024-09-20T21:06:04.512459+0000","last_fullsized":"2024-09-20T21:06:04.512459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:04.512266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:04.512266+0000","last_clean_scrub_stamp":"2024-09-20T21:06:04.512266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:08.753845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:15.489478+0000","last_change":"2024-09-20T21:06:15.489529+0000","last_active":"2024-09-20T21:06:15.489478+0000","last_peered":"2024-09-20T21:06:15.489478+0000","last_clean":"2024-09-20T21:06:15.489478+0000","last_became_active":"2024-09-20T21:05:54.120990+0000","last_became_peered":"2024-09-20T21:05:54.120990+0000","last_unstale":"2024-09-20T21:06:15.489478+0000","last_undegraded":"2024-09-20T21:06:15.489478+0000","last_fullsized":"2024-09-20T21:06:15.489478+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:15.489279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:15.489279+0000","last_clean_scrub_stamp":"2024-09-20T21:06:15.489279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:48:24.262607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:03.242740+0000","last_change":"2024-09-20T21:06:03.242792+0000","last_active":"2024-09-20T21:06:03.242740+0000","last_peered":"2024-09-20T21:06:03.242740+0000","last_clean":"2024-09-20T21:06:03.242740+0000","last_became_active":"2024-09-20T21:05:37.267096+0000","last_became_peered":"2024-09-20T21:05:37.267096+0000","last_unstale":"2024-09-20T21:06:03.242740+0000","last_undegraded":"2024-09-20T21:06:03.242740+0000","last_fullsized":"2024-09-20T21:06:03.242740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:03.242543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:03.242543+0000","last_clean_scrub_stamp":"2024-09-20T21:06:03.242543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:58.207826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:25.321346+0000","last_change":"2024-09-20T21:06:25.321401+0000","last_active":"2024-09-20T21:06:25.321346+0000","last_peered":"2024-09-20T21:06:25.321346+0000","last_clean":"2024-09-20T21:06:25.321346+0000","last_became_active":"2024-09-20T21:05:34.244900+0000","last_became_peered":"2024-09-20T21:05:34.244900+0000","last_unstale":"2024-09-20T21:06:25.321346+0000","last_undegraded":"2024-09-20T21:06:25.321346+0000","last_fullsized":"2024-09-20T21:06:25.321346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:25.321156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:25.321156+0000","last_clean_scrub_stamp":"2024-09-20T21:06:25.321156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:58.919093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:26.249366+0000","last_change":"2024-09-20T21:06:26.249508+0000","last_active":"2024-09-20T21:06:26.249366+0000","last_peered":"2024-09-20T21:06:26.249366+0000","last_clean":"2024-09-20T21:06:26.249366+0000","last_became_active":"2024-09-20T21:01:12.222512+0000","last_became_peered":"2024-09-20T21:01:12.222512+0000","last_unstale":"2024-09-20T21:06:26.249366+0000","last_undegraded":"2024-09-20T21:06:26.249366+0000","last_fullsized":"2024-09-20T21:06:26.249366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:26.249139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:26.249139+0000","last_clean_scrub_stamp":"2024-09-20T21:06:26.249139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:10.445714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:12.618035+0000","last_change":"2024-09-20T21:06:12.618087+0000","last_active":"2024-09-20T21:06:12.618035+0000","last_peered":"2024-09-20T21:06:12.618035+0000","last_clean":"2024-09-20T21:06:12.618035+0000","last_became_active":"2024-09-20T21:05:33.515201+0000","last_became_peered":"2024-09-20T21:05:33.515201+0000","last_unstale":"2024-09-20T21:06:12.618035+0000","last_undegraded":"2024-09-20T21:06:12.618035+0000","last_fullsized":"2024-09-20T21:06:12.618035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:12.617835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:12.617835+0000","last_clean_scrub_stamp":"2024-09-20T21:06:12.617835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:50:06.150380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":130,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:31.384812+0000","last_change":"2024-09-20T21:06:31.384862+0000","last_active":"2024-09-20T21:06:31.384812+0000","last_peered":"2024-09-20T21:06:31.384812+0000","last_clean":"2024-09-20T21:06:31.384812+0000","last_became_active":"2024-09-20T21:05:54.128119+0000","last_became_peered":"2024-09-20T21:05:54.128119+0000","last_unstale":"2024-09-20T21:06:31.384812+0000","last_undegraded":"2024-09-20T21:06:31.384812+0000","last_fullsized":"2024-09-20T21:06:31.384812+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:31.384616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:31.384616+0000","last_clean_scrub_stamp":"2024-09-20T21:06:31.384616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:59.844630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"95'4","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:08.560177+0000","last_change":"2024-09-20T21:06:08.560246+0000","last_active":"2024-09-20T21:06:08.560177+0000","last_peered":"2024-09-20T21:06:08.560177+0000","last_clean":"2024-09-20T21:06:08.560177+0000","last_became_active":"2024-09-20T21:05:33.520660+0000","last_became_peered":"2024-09-20T21:05:33.520660+0000","last_unstale":"2024-09-20T21:06:08.560177+0000","last_undegraded":"2024-09-20T21:06:08.560177+0000","last_fullsized":"2024-09-20T21:06:08.560177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'4","last_scrub_stamp":"2024-09-20T21:06:08.559988+0000","last_deep_scrub":"95'4","last_deep_scrub_stamp":"2024-09-20T21:06:08.559988+0000","last_clean_scrub_stamp":"2024-09-20T21:06:08.559988+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:10.036982+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:34.346702+0000","last_change":"2024-09-20T21:06:34.346831+0000","last_active":"2024-09-20T21:06:34.346702+0000","last_peered":"2024-09-20T21:06:34.346702+0000","last_clean":"2024-09-20T21:06:34.346702+0000","last_became_active":"2024-09-20T21:05:54.130889+0000","last_became_peered":"2024-09-20T21:05:54.130889+0000","last_unstale":"2024-09-20T21:06:34.346702+0000","last_undegraded":"2024-09-20T21:06:34.346702+0000","last_fullsized":"2024-09-20T21:06:34.346702+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:34.346484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:34.346484+0000","last_clean_scrub_stamp":"2024-09-20T21:06:34.346484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:05:46.929675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:06.224012+0000","last_change":"2024-09-20T21:06:06.224084+0000","last_active":"2024-09-20T21:06:06.224012+0000","last_peered":"2024-09-20T21:06:06.224012+0000","last_clean":"2024-09-20T21:06:06.224012+0000","last_became_active":"2024-09-20T21:05:34.264852+0000","last_became_peered":"2024-09-20T21:05:34.264852+0000","last_unstale":"2024-09-20T21:06:06.224012+0000","last_undegraded":"2024-09-20T21:06:06.224012+0000","last_fullsized":"2024-09-20T21:06:06.224012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:06.223824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:06.223824+0000","last_clean_scrub_stamp":"2024-09-20T21:06:06.223824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:22.296470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:14.189296+0000","last_change":"2024-09-20T21:06:14.189355+0000","last_active":"2024-09-20T21:06:14.189296+0000","last_peered":"2024-09-20T21:06:14.189296+0000","last_clean":"2024-09-20T21:06:14.189296+0000","last_became_active":"2024-09-20T21:05:34.263200+0000","last_became_peered":"2024-09-20T21:05:34.263200+0000","last_unstale":"2024-09-20T21:06:14.189296+0000","last_undegraded":"2024-09-20T21:06:14.189296+0000","last_fullsized":"2024-09-20T21:06:14.189296+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:14.189094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:14.189094+0000","last_clean_scrub_stamp":"2024-09-20T21:06:14.189094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:25:16.979082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:12.519350+0000","last_change":"2024-09-20T21:06:12.519406+0000","last_active":"2024-09-20T21:06:12.519350+0000","last_peered":"2024-09-20T21:06:12.519350+0000","last_clean":"2024-09-20T21:06:12.519350+0000","last_became_active":"2024-09-20T21:05:54.124655+0000","last_became_peered":"2024-09-20T21:05:54.124655+0000","last_unstale":"2024-09-20T21:06:12.519350+0000","last_undegraded":"2024-09-20T21:06:12.519350+0000","last_fullsized":"2024-09-20T21:06:12.519350+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:12.519156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:12.519156+0000","last_clean_scrub_stamp":"2024-09-20T21:06:12.519156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:56:36.326861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:27.232558+0000","last_change":"2024-09-20T21:06:27.232610+0000","last_active":"2024-09-20T21:06:27.232558+0000","last_peered":"2024-09-20T21:06:27.232558+0000","last_clean":"2024-09-20T21:06:27.232558+0000","last_became_active":"2024-09-20T21:05:45.323784+0000","last_became_peered":"2024-09-20T21:05:45.323784+0000","last_unstale":"2024-09-20T21:06:27.232558+0000","last_undegraded":"2024-09-20T21:06:27.232558+0000","last_fullsized":"2024-09-20T21:06:27.232558+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:27.232363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:27.232363+0000","last_clean_scrub_stamp":"2024-09-20T21:06:27.232363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:59:49.334168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"95'12","reported_seq":84,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:25.558886+0000","last_change":"2024-09-20T21:06:25.558960+0000","last_active":"2024-09-20T21:06:25.558886+0000","last_peered":"2024-09-20T21:06:25.558886+0000","last_clean":"2024-09-20T21:06:25.558886+0000","last_became_active":"2024-09-20T21:05:33.506501+0000","last_became_peered":"2024-09-20T21:05:33.506501+0000","last_unstale":"2024-09-20T21:06:25.558886+0000","last_undegraded":"2024-09-20T21:06:25.558886+0000","last_fullsized":"2024-09-20T21:06:25.558886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-20T21:06:25.558701+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-20T21:06:25.558701+0000","last_clean_scrub_stamp":"2024-09-20T21:06:25.558701+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:26.972235+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"95'2","reported_seq":65,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:22.538440+0000","last_change":"2024-09-20T21:06:22.538504+0000","last_active":"2024-09-20T21:06:22.538440+0000","last_peered":"2024-09-20T21:06:22.538440+0000","last_clean":"2024-09-20T21:06:22.538440+0000","last_became_active":"2024-09-20T21:05:33.512031+0000","last_became_peered":"2024-09-20T21:05:33.512031+0000","last_unstale":"2024-09-20T21:06:22.538440+0000","last_undegraded":"2024-09-20T21:06:22.538440+0000","last_fullsized":"2024-09-20T21:06:22.538440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-20T21:06:22.538232+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-20T21:06:22.538232+0000","last_clean_scrub_stamp":"2024-09-20T21:06:22.538232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:11.205896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:18.454978+0000","last_change":"2024-09-20T21:06:18.455085+0000","last_active":"2024-09-20T21:06:18.454978+0000","last_peered":"2024-09-20T21:06:18.454978+0000","last_clean":"2024-09-20T21:06:18.454978+0000","last_became_active":"2024-09-20T21:05:54.124815+0000","last_became_peered":"2024-09-20T21:05:54.124815+0000","last_unstale":"2024-09-20T21:06:18.454978+0000","last_undegraded":"2024-09-20T21:06:18.454978+0000","last_fullsized":"2024-09-20T21:06:18.454978+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:18.454684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:18.454684+0000","last_clean_scrub_stamp":"2024-09-20T21:06:18.454684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:20.248639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"95'3","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:07.540023+0000","last_change":"2024-09-20T21:06:07.540175+0000","last_active":"2024-09-20T21:06:07.540023+0000","last_peered":"2024-09-20T21:06:07.540023+0000","last_clean":"2024-09-20T21:06:07.540023+0000","last_became_active":"2024-09-20T21:05:54.119189+0000","last_became_peered":"2024-09-20T21:05:54.119189+0000","last_unstale":"2024-09-20T21:06:07.540023+0000","last_undegraded":"2024-09-20T21:06:07.540023+0000","last_fullsized":"2024-09-20T21:06:07.540023+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T21:06:07.539800+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T21:06:07.539800+0000","last_clean_scrub_stamp":"2024-09-20T21:06:07.539800+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:55.719961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":130,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:03.488018+0000","last_change":"2024-09-20T21:06:03.488069+0000","last_active":"2024-09-20T21:06:03.488018+0000","last_peered":"2024-09-20T21:06:03.488018+0000","last_clean":"2024-09-20T21:06:03.488018+0000","last_became_active":"2024-09-20T21:05:54.127969+0000","last_became_peered":"2024-09-20T21:05:54.127969+0000","last_unstale":"2024-09-20T21:06:03.488018+0000","last_undegraded":"2024-09-20T21:06:03.488018+0000","last_fullsized":"2024-09-20T21:06:03.488018+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:03.487830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:03.487830+0000","last_clean_scrub_stamp":"2024-09-20T21:06:03.487830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:58.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"95'2","reported_seq":74,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:01.563405+0000","last_change":"2024-09-20T21:06:01.563473+0000","last_active":"2024-09-20T21:06:01.563405+0000","last_peered":"2024-09-20T21:06:01.563405+0000","last_clean":"2024-09-20T21:06:01.563405+0000","last_became_active":"2024-09-20T21:05:33.522810+0000","last_became_peered":"2024-09-20T21:05:33.522810+0000","last_unstale":"2024-09-20T21:06:01.563405+0000","last_undegraded":"2024-09-20T21:06:01.563405+0000","last_fullsized":"2024-09-20T21:06:01.563405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-20T21:06:01.563216+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-20T21:06:01.563216+0000","last_clean_scrub_stamp":"2024-09-20T21:06:01.563216+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:54.399978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:31.526671+0000","last_change":"2024-09-20T21:06:31.526724+0000","last_active":"2024-09-20T21:06:31.526671+0000","last_peered":"2024-09-20T21:06:31.526671+0000","last_clean":"2024-09-20T21:06:31.526671+0000","last_became_active":"2024-09-20T21:05:33.522862+0000","last_became_peered":"2024-09-20T21:05:33.522862+0000","last_unstale":"2024-09-20T21:06:31.526671+0000","last_undegraded":"2024-09-20T21:06:31.526671+0000","last_fullsized":"2024-09-20T21:06:31.526671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:31.526461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:31.526461+0000","last_clean_scrub_stamp":"2024-09-20T21:06:31.526461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:21.747331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:20.555989+0000","last_change":"2024-09-20T21:06:20.556050+0000","last_active":"2024-09-20T21:06:20.555989+0000","last_peered":"2024-09-20T21:06:20.555989+0000","last_clean":"2024-09-20T21:06:20.555989+0000","last_became_active":"2024-09-20T21:05:33.514895+0000","last_became_peered":"2024-09-20T21:05:33.514895+0000","last_unstale":"2024-09-20T21:06:20.555989+0000","last_undegraded":"2024-09-20T21:06:20.555989+0000","last_fullsized":"2024-09-20T21:06:20.555989+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:20.555777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:20.555777+0000","last_clean_scrub_stamp":"2024-09-20T21:06:20.555777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:53.535851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:17.227849+0000","last_change":"2024-09-20T21:06:17.227908+0000","last_active":"2024-09-20T21:06:17.227849+0000","last_peered":"2024-09-20T21:06:17.227849+0000","last_clean":"2024-09-20T21:06:17.227849+0000","last_became_active":"2024-09-20T21:05:45.321407+0000","last_became_peered":"2024-09-20T21:05:45.321407+0000","last_unstale":"2024-09-20T21:06:17.227849+0000","last_undegraded":"2024-09-20T21:06:17.227849+0000","last_fullsized":"2024-09-20T21:06:17.227849+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:17.227655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:17.227655+0000","last_clean_scrub_stamp":"2024-09-20T21:06:17.227655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:45:18.923766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"95'3","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:12.277890+0000","last_change":"2024-09-20T21:06:12.277959+0000","last_active":"2024-09-20T21:06:12.277890+0000","last_peered":"2024-09-20T21:06:12.277890+0000","last_clean":"2024-09-20T21:06:12.277890+0000","last_became_active":"2024-09-20T21:05:34.263390+0000","last_became_peered":"2024-09-20T21:05:34.263390+0000","last_unstale":"2024-09-20T21:06:12.277890+0000","last_undegraded":"2024-09-20T21:06:12.277890+0000","last_fullsized":"2024-09-20T21:06:12.277890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T21:06:12.277700+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T21:06:12.277700+0000","last_clean_scrub_stamp":"2024-09-20T21:06:12.277700+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:28.257090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:16.635079+0000","last_change":"2024-09-20T21:06:16.635131+0000","last_active":"2024-09-20T21:06:16.635079+0000","last_peered":"2024-09-20T21:06:16.635079+0000","last_clean":"2024-09-20T21:06:16.635079+0000","last_became_active":"2024-09-20T21:05:33.515263+0000","last_became_peered":"2024-09-20T21:05:33.515263+0000","last_unstale":"2024-09-20T21:06:16.635079+0000","last_undegraded":"2024-09-20T21:06:16.635079+0000","last_fullsized":"2024-09-20T21:06:16.635079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:16.634879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:16.634879+0000","last_clean_scrub_stamp":"2024-09-20T21:06:16.634879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:21.040805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:36.593892+0000","last_change":"2024-09-20T21:06:36.593952+0000","last_active":"2024-09-20T21:06:36.593892+0000","last_peered":"2024-09-20T21:06:36.593892+0000","last_clean":"2024-09-20T21:06:36.593892+0000","last_became_active":"2024-09-20T21:05:55.491897+0000","last_became_peered":"2024-09-20T21:05:55.491897+0000","last_unstale":"2024-09-20T21:06:36.593892+0000","last_undegraded":"2024-09-20T21:06:36.593892+0000","last_fullsized":"2024-09-20T21:06:36.593892+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:36.593704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:36.593704+0000","last_clean_scrub_stamp":"2024-09-20T21:06:36.593704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:56.258856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:19.551532+0000","last_change":"2024-09-20T21:06:19.551583+0000","last_active":"2024-09-20T21:06:19.551532+0000","last_peered":"2024-09-20T21:06:19.551532+0000","last_clean":"2024-09-20T21:06:19.551532+0000","last_became_active":"2024-09-20T21:05:33.514604+0000","last_became_peered":"2024-09-20T21:05:33.514604+0000","last_unstale":"2024-09-20T21:06:19.551532+0000","last_undegraded":"2024-09-20T21:06:19.551532+0000","last_fullsized":"2024-09-20T21:06:19.551532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:19.551342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:19.551342+0000","last_clean_scrub_stamp":"2024-09-20T21:06:19.551342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:45.177805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:23.397786+0000","last_change":"2024-09-20T21:06:23.397840+0000","last_active":"2024-09-20T21:06:23.397786+0000","last_peered":"2024-09-20T21:06:23.397786+0000","last_clean":"2024-09-20T21:06:23.397786+0000","last_became_active":"2024-09-20T21:05:34.240880+0000","last_became_peered":"2024-09-20T21:05:34.240880+0000","last_unstale":"2024-09-20T21:06:23.397786+0000","last_undegraded":"2024-09-20T21:06:23.397786+0000","last_fullsized":"2024-09-20T21:06:23.397786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:23.397589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:23.397589+0000","last_clean_scrub_stamp":"2024-09-20T21:06:23.397589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:33:30.171885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:23.522765+0000","last_change":"2024-09-20T21:06:23.522817+0000","last_active":"2024-09-20T21:06:23.522765+0000","last_peered":"2024-09-20T21:06:23.522765+0000","last_clean":"2024-09-20T21:06:23.522765+0000","last_became_active":"2024-09-20T21:05:33.506167+0000","last_became_peered":"2024-09-20T21:05:33.506167+0000","last_unstale":"2024-09-20T21:06:23.522765+0000","last_undegraded":"2024-09-20T21:06:23.522765+0000","last_fullsized":"2024-09-20T21:06:23.522765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:23.522579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:23.522579+0000","last_clean_scrub_stamp":"2024-09-20T21:06:23.522579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:25:59.436830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":126,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:19.450576+0000","last_change":"2024-09-20T21:06:19.450629+0000","last_active":"2024-09-20T21:06:19.450576+0000","last_peered":"2024-09-20T21:06:19.450576+0000","last_clean":"2024-09-20T21:06:19.450576+0000","last_became_active":"2024-09-20T21:05:54.120855+0000","last_became_peered":"2024-09-20T21:05:54.120855+0000","last_unstale":"2024-09-20T21:06:19.450576+0000","last_undegraded":"2024-09-20T21:06:19.450576+0000","last_fullsized":"2024-09-20T21:06:19.450576+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:19.450382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:19.450382+0000","last_clean_scrub_stamp":"2024-09-20T21:06:19.450382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:09.823794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:16.187193+0000","last_change":"2024-09-20T21:06:16.187340+0000","last_active":"2024-09-20T21:06:16.187193+0000","last_peered":"2024-09-20T21:06:16.187193+0000","last_clean":"2024-09-20T21:06:16.187193+0000","last_became_active":"2024-09-20T21:01:12.226036+0000","last_became_peered":"2024-09-20T21:01:12.226036+0000","last_unstale":"2024-09-20T21:06:16.187193+0000","last_undegraded":"2024-09-20T21:06:16.187193+0000","last_fullsized":"2024-09-20T21:06:16.187193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:16.186966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:16.186966+0000","last_clean_scrub_stamp":"2024-09-20T21:06:16.186966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:58.421836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"95'159","reported_seq":285,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:26.582766+0000","last_change":"2024-09-20T21:06:26.582848+0000","last_active":"2024-09-20T21:06:26.582766+0000","last_peered":"2024-09-20T21:06:26.582766+0000","last_clean":"2024-09-20T21:06:26.582766+0000","last_became_active":"2024-09-20T21:05:33.506656+0000","last_became_peered":"2024-09-20T21:05:33.506656+0000","last_unstale":"2024-09-20T21:06:26.582766+0000","last_undegraded":"2024-09-20T21:06:26.582766+0000","last_fullsized":"2024-09-20T21:06:26.582766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'159","last_scrub_stamp":"2024-09-20T21:06:26.582580+0000","last_deep_scrub":"95'159","last_deep_scrub_stamp":"2024-09-20T21:06:26.582580+0000","last_clean_scrub_stamp":"2024-09-20T21:06:26.582580+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:31.679897+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"95'2","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:18.585937+0000","last_change":"2024-09-20T21:06:18.586108+0000","last_active":"2024-09-20T21:06:18.585937+0000","last_peered":"2024-09-20T21:06:18.585937+0000","last_clean":"2024-09-20T21:06:18.585937+0000","last_became_active":"2024-09-20T21:05:33.514812+0000","last_became_peered":"2024-09-20T21:05:33.514812+0000","last_unstale":"2024-09-20T21:06:18.585937+0000","last_undegraded":"2024-09-20T21:06:18.585937+0000","last_fullsized":"2024-09-20T21:06:18.585937+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-20T21:06:18.585722+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-20T21:06:18.585722+0000","last_clean_scrub_stamp":"2024-09-20T21:06:18.585722+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:40.842507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:05.264120+0000","last_change":"2024-09-20T21:06:05.264179+0000","last_active":"2024-09-20T21:06:05.264120+0000","last_peered":"2024-09-20T21:06:05.264120+0000","last_clean":"2024-09-20T21:06:05.264120+0000","last_became_active":"2024-09-20T21:05:37.267211+0000","last_became_peered":"2024-09-20T21:05:37.267211+0000","last_unstale":"2024-09-20T21:06:05.264120+0000","last_undegraded":"2024-09-20T21:06:05.264120+0000","last_fullsized":"2024-09-20T21:06:05.264120+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:05.263914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:05.263914+0000","last_clean_scrub_stamp":"2024-09-20T21:06:05.263914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:06:12.655019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:06.548944+0000","last_change":"2024-09-20T21:06:06.548996+0000","last_active":"2024-09-20T21:06:06.548944+0000","last_peered":"2024-09-20T21:06:06.548944+0000","last_clean":"2024-09-20T21:06:06.548944+0000","last_became_active":"2024-09-20T21:05:33.515140+0000","last_became_peered":"2024-09-20T21:05:33.515140+0000","last_unstale":"2024-09-20T21:06:06.548944+0000","last_undegraded":"2024-09-20T21:06:06.548944+0000","last_fullsized":"2024-09-20T21:06:06.548944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:06.548742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:06.548742+0000","last_clean_scrub_stamp":"2024-09-20T21:06:06.548742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:02.694715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:28.532703+0000","last_change":"2024-09-20T21:06:28.532770+0000","last_active":"2024-09-20T21:06:28.532703+0000","last_peered":"2024-09-20T21:06:28.532703+0000","last_clean":"2024-09-20T21:06:28.532703+0000","last_became_active":"2024-09-20T21:05:33.507248+0000","last_became_peered":"2024-09-20T21:05:33.507248+0000","last_unstale":"2024-09-20T21:06:28.532703+0000","last_undegraded":"2024-09-20T21:06:28.532703+0000","last_fullsized":"2024-09-20T21:06:28.532703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:28.532512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:28.532512+0000","last_clean_scrub_stamp":"2024-09-20T21:06:28.532512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:36.239763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:13.232313+0000","last_change":"2024-09-20T21:06:13.232367+0000","last_active":"2024-09-20T21:06:13.232313+0000","last_peered":"2024-09-20T21:06:13.232313+0000","last_clean":"2024-09-20T21:06:13.232313+0000","last_became_active":"2024-09-20T21:05:45.321160+0000","last_became_peered":"2024-09-20T21:05:45.321160+0000","last_unstale":"2024-09-20T21:06:13.232313+0000","last_undegraded":"2024-09-20T21:06:13.232313+0000","last_fullsized":"2024-09-20T21:06:13.232313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:13.232087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:13.232087+0000","last_clean_scrub_stamp":"2024-09-20T21:06:13.232087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:40.487222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:21.445544+0000","last_change":"2024-09-20T21:06:21.445599+0000","last_active":"2024-09-20T21:06:21.445544+0000","last_peered":"2024-09-20T21:06:21.445544+0000","last_clean":"2024-09-20T21:06:21.445544+0000","last_became_active":"2024-09-20T21:01:12.240393+0000","last_became_peered":"2024-09-20T21:01:12.240393+0000","last_unstale":"2024-09-20T21:06:21.445544+0000","last_undegraded":"2024-09-20T21:06:21.445544+0000","last_fullsized":"2024-09-20T21:06:21.445544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:21.445358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:21.445358+0000","last_clean_scrub_stamp":"2024-09-20T21:06:21.445358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:28.694217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:21.221039+0000","last_change":"2024-09-20T21:06:21.221091+0000","last_active":"2024-09-20T21:06:21.221039+0000","last_peered":"2024-09-20T21:06:21.221039+0000","last_clean":"2024-09-20T21:06:21.221039+0000","last_became_active":"2024-09-20T21:01:06.999729+0000","last_became_peered":"2024-09-20T21:01:06.999729+0000","last_unstale":"2024-09-20T21:06:21.221039+0000","last_undegraded":"2024-09-20T21:06:21.221039+0000","last_fullsized":"2024-09-20T21:06:21.221039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:21.220846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:21.220846+0000","last_clean_scrub_stamp":"2024-09-20T21:06:21.220846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:11.461264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089019299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:10.538704+0000","last_change":"2024-09-20T21:06:10.538824+0000","last_active":"2024-09-20T21:06:10.538704+0000","last_peered":"2024-09-20T21:06:10.538704+0000","last_clean":"2024-09-20T21:06:10.538704+0000","last_became_active":"2024-09-20T21:05:54.121776+0000","last_became_peered":"2024-09-20T21:05:54.121776+0000","last_unstale":"2024-09-20T21:06:10.538704+0000","last_undegraded":"2024-09-20T21:06:10.538704+0000","last_fullsized":"2024-09-20T21:06:10.538704+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:10.538415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:10.538415+0000","last_clean_scrub_stamp":"2024-09-20T21:06:10.538415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:55.758434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":125,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:32.139113+0000","last_change":"2024-09-20T21:06:32.139240+0000","last_active":"2024-09-20T21:06:32.139113+0000","last_peered":"2024-09-20T21:06:32.139113+0000","last_clean":"2024-09-20T21:06:32.139113+0000","last_became_active":"2024-09-20T21:05:52.100421+0000","last_became_peered":"2024-09-20T21:05:52.100421+0000","last_unstale":"2024-09-20T21:06:32.139113+0000","last_undegraded":"2024-09-20T21:06:32.139113+0000","last_fullsized":"2024-09-20T21:06:32.139113+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:32.138856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:32.138856+0000","last_clean_scrub_stamp":"2024-09-20T21:06:32.138856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:53.268904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"95'3","reported_seq":79,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:13.654211+0000","last_change":"2024-09-20T21:06:13.654275+0000","last_active":"2024-09-20T21:06:13.654211+0000","last_peered":"2024-09-20T21:06:13.654211+0000","last_clean":"2024-09-20T21:06:13.654211+0000","last_became_active":"2024-09-20T21:05:33.517348+0000","last_became_peered":"2024-09-20T21:05:33.517348+0000","last_unstale":"2024-09-20T21:06:13.654211+0000","last_undegraded":"2024-09-20T21:06:13.654211+0000","last_fullsized":"2024-09-20T21:06:13.654211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T21:06:13.654024+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T21:06:13.654024+0000","last_clean_scrub_stamp":"2024-09-20T21:06:13.654024+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:17:51.099314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:10.630764+0000","last_change":"2024-09-20T21:06:10.630817+0000","last_active":"2024-09-20T21:06:10.630764+0000","last_peered":"2024-09-20T21:06:10.630764+0000","last_clean":"2024-09-20T21:06:10.630764+0000","last_became_active":"2024-09-20T21:05:33.520601+0000","last_became_peered":"2024-09-20T21:05:33.520601+0000","last_unstale":"2024-09-20T21:06:10.630764+0000","last_undegraded":"2024-09-20T21:06:10.630764+0000","last_fullsized":"2024-09-20T21:06:10.630764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:10.630570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:10.630570+0000","last_clean_scrub_stamp":"2024-09-20T21:06:10.630570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:42.252620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:30.150300+0000","last_change":"2024-09-20T21:06:30.150352+0000","last_active":"2024-09-20T21:06:30.150300+0000","last_peered":"2024-09-20T21:06:30.150300+0000","last_clean":"2024-09-20T21:06:30.150300+0000","last_became_active":"2024-09-20T21:05:45.330361+0000","last_became_peered":"2024-09-20T21:05:45.330361+0000","last_unstale":"2024-09-20T21:06:30.150300+0000","last_undegraded":"2024-09-20T21:06:30.150300+0000","last_fullsized":"2024-09-20T21:06:30.150300+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:30.150105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:30.150105+0000","last_clean_scrub_stamp":"2024-09-20T21:06:30.150105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:34:25.563606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:05.559363+0000","last_change":"2024-09-20T21:06:05.559416+0000","last_active":"2024-09-20T21:06:05.559363+0000","last_peered":"2024-09-20T21:06:05.559363+0000","last_clean":"2024-09-20T21:06:05.559363+0000","last_became_active":"2024-09-20T21:05:33.525661+0000","last_became_peered":"2024-09-20T21:05:33.525661+0000","last_unstale":"2024-09-20T21:06:05.559363+0000","last_undegraded":"2024-09-20T21:06:05.559363+0000","last_fullsized":"2024-09-20T21:06:05.559363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:05.559178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:05.559178+0000","last_clean_scrub_stamp":"2024-09-20T21:06:05.559178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:33.356703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:20.235624+0000","last_change":"2024-09-20T21:06:20.235677+0000","last_active":"2024-09-20T21:06:20.235624+0000","last_peered":"2024-09-20T21:06:20.235624+0000","last_clean":"2024-09-20T21:06:20.235624+0000","last_became_active":"2024-09-20T21:01:06.997115+0000","last_became_peered":"2024-09-20T21:01:06.997115+0000","last_unstale":"2024-09-20T21:06:20.235624+0000","last_undegraded":"2024-09-20T21:06:20.235624+0000","last_fullsized":"2024-09-20T21:06:20.235624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:20.235429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:20.235429+0000","last_clean_scrub_stamp":"2024-09-20T21:06:20.235429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:30:11.688592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001218991,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:22.432248+0000","last_change":"2024-09-20T21:06:22.432303+0000","last_active":"2024-09-20T21:06:22.432248+0000","last_peered":"2024-09-20T21:06:22.432248+0000","last_clean":"2024-09-20T21:06:22.432248+0000","last_became_active":"2024-09-20T21:05:34.240564+0000","last_became_peered":"2024-09-20T21:05:34.240564+0000","last_unstale":"2024-09-20T21:06:22.432248+0000","last_undegraded":"2024-09-20T21:06:22.432248+0000","last_fullsized":"2024-09-20T21:06:22.432248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:22.432056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:22.432056+0000","last_clean_scrub_stamp":"2024-09-20T21:06:22.432056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:47:41.558116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:22.229440+0000","last_change":"2024-09-20T21:06:22.229492+0000","last_active":"2024-09-20T21:06:22.229440+0000","last_peered":"2024-09-20T21:06:22.229440+0000","last_clean":"2024-09-20T21:06:22.229440+0000","last_became_active":"2024-09-20T21:01:11.209503+0000","last_became_peered":"2024-09-20T21:01:11.209503+0000","last_unstale":"2024-09-20T21:06:22.229440+0000","last_undegraded":"2024-09-20T21:06:22.229440+0000","last_fullsized":"2024-09-20T21:06:22.229440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:22.229249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:22.229249+0000","last_clean_scrub_stamp":"2024-09-20T21:06:22.229249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:47:41.355309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:17.481433+0000","last_change":"2024-09-20T21:06:17.481486+0000","last_active":"2024-09-20T21:06:17.481433+0000","last_peered":"2024-09-20T21:06:17.481433+0000","last_clean":"2024-09-20T21:06:17.481433+0000","last_became_active":"2024-09-20T21:05:54.121064+0000","last_became_peered":"2024-09-20T21:05:54.121064+0000","last_unstale":"2024-09-20T21:06:17.481433+0000","last_undegraded":"2024-09-20T21:06:17.481433+0000","last_fullsized":"2024-09-20T21:06:17.481433+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:17.481241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:17.481241+0000","last_clean_scrub_stamp":"2024-09-20T21:06:17.481241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:02:12.942672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:33.362859+0000","last_change":"2024-09-20T21:06:33.362918+0000","last_active":"2024-09-20T21:06:33.362859+0000","last_peered":"2024-09-20T21:06:33.362859+0000","last_clean":"2024-09-20T21:06:33.362859+0000","last_became_active":"2024-09-20T21:05:54.127863+0000","last_became_peered":"2024-09-20T21:05:54.127863+0000","last_unstale":"2024-09-20T21:06:33.362859+0000","last_undegraded":"2024-09-20T21:06:33.362859+0000","last_fullsized":"2024-09-20T21:06:33.362859+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:33.362630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:33.362630+0000","last_clean_scrub_stamp":"2024-09-20T21:06:33.362630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:49.638804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"95'3","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:23.219272+0000","last_change":"2024-09-20T21:06:23.219342+0000","last_active":"2024-09-20T21:06:23.219272+0000","last_peered":"2024-09-20T21:06:23.219272+0000","last_clean":"2024-09-20T21:06:23.219272+0000","last_became_active":"2024-09-20T21:01:11.209606+0000","last_became_peered":"2024-09-20T21:01:11.209606+0000","last_unstale":"2024-09-20T21:06:23.219272+0000","last_undegraded":"2024-09-20T21:06:23.219272+0000","last_fullsized":"2024-09-20T21:06:23.219272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T21:06:23.219053+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T21:06:23.219053+0000","last_clean_scrub_stamp":"2024-09-20T21:06:23.219053+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:33:29.993348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:19.226605+0000","last_change":"2024-09-20T21:06:19.226657+0000","last_active":"2024-09-20T21:06:19.226605+0000","last_peered":"2024-09-20T21:06:19.226605+0000","last_clean":"2024-09-20T21:06:19.226605+0000","last_became_active":"2024-09-20T21:01:06.996875+0000","last_became_peered":"2024-09-20T21:01:06.996875+0000","last_unstale":"2024-09-20T21:06:19.226605+0000","last_undegraded":"2024-09-20T21:06:19.226605+0000","last_fullsized":"2024-09-20T21:06:19.226605+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:19.226409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:19.226409+0000","last_clean_scrub_stamp":"2024-09-20T21:06:19.226409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:09.599821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00079924800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:04.226543+0000","last_change":"2024-09-20T21:06:04.226599+0000","last_active":"2024-09-20T21:06:04.226543+0000","last_peered":"2024-09-20T21:06:04.226543+0000","last_clean":"2024-09-20T21:06:04.226543+0000","last_became_active":"2024-09-20T21:05:37.266438+0000","last_became_peered":"2024-09-20T21:05:37.266438+0000","last_unstale":"2024-09-20T21:06:04.226543+0000","last_undegraded":"2024-09-20T21:06:04.226543+0000","last_fullsized":"2024-09-20T21:06:04.226543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:04.226344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:04.226344+0000","last_clean_scrub_stamp":"2024-09-20T21:06:04.226344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:26:55.211345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"95'2","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:08.170260+0000","last_change":"2024-09-20T21:06:08.170326+0000","last_active":"2024-09-20T21:06:08.170260+0000","last_peered":"2024-09-20T21:06:08.170260+0000","last_clean":"2024-09-20T21:06:08.170260+0000","last_became_active":"2024-09-20T21:05:34.263494+0000","last_became_peered":"2024-09-20T21:05:34.263494+0000","last_unstale":"2024-09-20T21:06:08.170260+0000","last_undegraded":"2024-09-20T21:06:08.170260+0000","last_fullsized":"2024-09-20T21:06:08.170260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-20T21:06:08.170067+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-20T21:06:08.170067+0000","last_clean_scrub_stamp":"2024-09-20T21:06:08.170067+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:36:07.743961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":129,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:34.583009+0000","last_change":"2024-09-20T21:06:34.583068+0000","last_active":"2024-09-20T21:06:34.583009+0000","last_peered":"2024-09-20T21:06:34.583009+0000","last_clean":"2024-09-20T21:06:34.583009+0000","last_became_active":"2024-09-20T21:05:55.394868+0000","last_became_peered":"2024-09-20T21:05:55.394868+0000","last_unstale":"2024-09-20T21:06:34.583009+0000","last_undegraded":"2024-09-20T21:06:34.583009+0000","last_fullsized":"2024-09-20T21:06:34.583009+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:34.582822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:34.582822+0000","last_clean_scrub_stamp":"2024-09-20T21:06:34.582822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:52.669497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:13.521938+0000","last_change":"2024-09-20T21:06:13.521993+0000","last_active":"2024-09-20T21:06:13.521938+0000","last_peered":"2024-09-20T21:06:13.521938+0000","last_clean":"2024-09-20T21:06:13.521938+0000","last_became_active":"2024-09-20T21:05:54.119503+0000","last_became_peered":"2024-09-20T21:05:54.119503+0000","last_unstale":"2024-09-20T21:06:13.521938+0000","last_undegraded":"2024-09-20T21:06:13.521938+0000","last_fullsized":"2024-09-20T21:06:13.521938+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:13.521724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:13.521724+0000","last_clean_scrub_stamp":"2024-09-20T21:06:13.521724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:40.776859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:29.484330+0000","last_change":"2024-09-20T21:06:29.484387+0000","last_active":"2024-09-20T21:06:29.484330+0000","last_peered":"2024-09-20T21:06:29.484330+0000","last_clean":"2024-09-20T21:06:29.484330+0000","last_became_active":"2024-09-20T21:05:33.507046+0000","last_became_peered":"2024-09-20T21:05:33.507046+0000","last_unstale":"2024-09-20T21:06:29.484330+0000","last_undegraded":"2024-09-20T21:06:29.484330+0000","last_fullsized":"2024-09-20T21:06:29.484330+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:29.484143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:29.484143+0000","last_clean_scrub_stamp":"2024-09-20T21:06:29.484143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:51:19.222241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"95'10","reported_seq":82,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:24.547266+0000","last_change":"2024-09-20T21:06:24.547497+0000","last_active":"2024-09-20T21:06:24.547266+0000","last_peered":"2024-09-20T21:06:24.547266+0000","last_clean":"2024-09-20T21:06:24.547266+0000","last_became_active":"2024-09-20T21:05:33.505803+0000","last_became_peered":"2024-09-20T21:05:33.505803+0000","last_unstale":"2024-09-20T21:06:24.547266+0000","last_undegraded":"2024-09-20T21:06:24.547266+0000","last_fullsized":"2024-09-20T21:06:24.547266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-20T21:06:24.547050+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-20T21:06:24.547050+0000","last_clean_scrub_stamp":"2024-09-20T21:06:24.547050+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:26.302476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:18.244287+0000","last_change":"2024-09-20T21:06:18.244344+0000","last_active":"2024-09-20T21:06:18.244287+0000","last_peered":"2024-09-20T21:06:18.244287+0000","last_clean":"2024-09-20T21:06:18.244287+0000","last_became_active":"2024-09-20T21:01:12.224256+0000","last_became_peered":"2024-09-20T21:01:12.224256+0000","last_unstale":"2024-09-20T21:06:18.244287+0000","last_undegraded":"2024-09-20T21:06:18.244287+0000","last_fullsized":"2024-09-20T21:06:18.244287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:18.244086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:18.244086+0000","last_clean_scrub_stamp":"2024-09-20T21:06:18.244086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:20.038040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"95'5","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:02.544064+0000","last_change":"2024-09-20T21:06:02.544064+0000","last_active":"2024-09-20T21:06:02.544064+0000","last_peered":"2024-09-20T21:06:02.544064+0000","last_clean":"2024-09-20T21:06:02.544064+0000","last_became_active":"2024-09-20T21:05:54.128221+0000","last_became_peered":"2024-09-20T21:05:54.128221+0000","last_unstale":"2024-09-20T21:06:02.544064+0000","last_undegraded":"2024-09-20T21:06:02.544064+0000","last_fullsized":"2024-09-20T21:06:02.544064+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'5","last_scrub_stamp":"2024-09-20T21:06:02.543814+0000","last_deep_scrub":"95'5","last_deep_scrub_stamp":"2024-09-20T21:06:02.543814+0000","last_clean_scrub_stamp":"2024-09-20T21:06:02.543814+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:54:44.260806+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:15.650760+0000","last_change":"2024-09-20T21:06:15.650811+0000","last_active":"2024-09-20T21:06:15.650760+0000","last_peered":"2024-09-20T21:06:15.650760+0000","last_clean":"2024-09-20T21:06:15.650760+0000","last_became_active":"2024-09-20T21:05:33.522841+0000","last_became_peered":"2024-09-20T21:05:33.522841+0000","last_unstale":"2024-09-20T21:06:15.650760+0000","last_undegraded":"2024-09-20T21:06:15.650760+0000","last_fullsized":"2024-09-20T21:06:15.650760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:15.650560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:15.650560+0000","last_clean_scrub_stamp":"2024-09-20T21:06:15.650560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:05.868240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:34.131401+0000","last_change":"2024-09-20T21:06:34.131462+0000","last_active":"2024-09-20T21:06:34.131401+0000","last_peered":"2024-09-20T21:06:34.131401+0000","last_clean":"2024-09-20T21:06:34.131401+0000","last_became_active":"2024-09-20T21:05:52.103630+0000","last_became_peered":"2024-09-20T21:05:52.103630+0000","last_unstale":"2024-09-20T21:06:34.131401+0000","last_undegraded":"2024-09-20T21:06:34.131401+0000","last_fullsized":"2024-09-20T21:06:34.131401+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:34.131201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:34.131201+0000","last_clean_scrub_stamp":"2024-09-20T21:06:34.131201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:42:14.609332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:10.233120+0000","last_change":"2024-09-20T21:06:10.233177+0000","last_active":"2024-09-20T21:06:10.233120+0000","last_peered":"2024-09-20T21:06:10.233120+0000","last_clean":"2024-09-20T21:06:10.233120+0000","last_became_active":"2024-09-20T21:05:34.263788+0000","last_became_peered":"2024-09-20T21:05:34.263788+0000","last_unstale":"2024-09-20T21:06:10.233120+0000","last_undegraded":"2024-09-20T21:06:10.233120+0000","last_fullsized":"2024-09-20T21:06:10.233120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:10.232921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:10.232921+0000","last_clean_scrub_stamp":"2024-09-20T21:06:10.232921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:55.452940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":86,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:31.130317+0000","last_change":"2024-09-20T21:06:31.130424+0000","last_active":"2024-09-20T21:06:31.130317+0000","last_peered":"2024-09-20T21:06:31.130317+0000","last_clean":"2024-09-20T21:06:31.130317+0000","last_became_active":"2024-09-20T21:05:52.100104+0000","last_became_peered":"2024-09-20T21:05:52.100104+0000","last_unstale":"2024-09-20T21:06:31.130317+0000","last_undegraded":"2024-09-20T21:06:31.130317+0000","last_fullsized":"2024-09-20T21:06:31.130317+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:31.130088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:31.130088+0000","last_clean_scrub_stamp":"2024-09-20T21:06:31.130088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:28.337563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:27.305320+0000","last_change":"2024-09-20T21:06:27.305383+0000","last_active":"2024-09-20T21:06:27.305320+0000","last_peered":"2024-09-20T21:06:27.305320+0000","last_clean":"2024-09-20T21:06:27.305320+0000","last_became_active":"2024-09-20T21:05:34.247367+0000","last_became_peered":"2024-09-20T21:05:34.247367+0000","last_unstale":"2024-09-20T21:06:27.305320+0000","last_undegraded":"2024-09-20T21:06:27.305320+0000","last_fullsized":"2024-09-20T21:06:27.305320+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:27.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:27.305121+0000","last_clean_scrub_stamp":"2024-09-20T21:06:27.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:17.551018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:07.198885+0000","last_change":"2024-09-20T21:06:07.198988+0000","last_active":"2024-09-20T21:06:07.198885+0000","last_peered":"2024-09-20T21:06:07.198885+0000","last_clean":"2024-09-20T21:06:07.198885+0000","last_became_active":"2024-09-20T21:05:37.268982+0000","last_became_peered":"2024-09-20T21:05:37.268982+0000","last_unstale":"2024-09-20T21:06:07.198885+0000","last_undegraded":"2024-09-20T21:06:07.198885+0000","last_fullsized":"2024-09-20T21:06:07.198885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:07.198669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:07.198669+0000","last_clean_scrub_stamp":"2024-09-20T21:06:07.198669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:55.378830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:09.184857+0000","last_change":"2024-09-20T21:06:09.184908+0000","last_active":"2024-09-20T21:06:09.184857+0000","last_peered":"2024-09-20T21:06:09.184857+0000","last_clean":"2024-09-20T21:06:09.184857+0000","last_became_active":"2024-09-20T21:05:45.320924+0000","last_became_peered":"2024-09-20T21:05:45.320924+0000","last_unstale":"2024-09-20T21:06:09.184857+0000","last_undegraded":"2024-09-20T21:06:09.184857+0000","last_fullsized":"2024-09-20T21:06:09.184857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:09.184666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:09.184666+0000","last_clean_scrub_stamp":"2024-09-20T21:06:09.184666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:24.931905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:11.269769+0000","last_change":"2024-09-20T21:06:11.269825+0000","last_active":"2024-09-20T21:06:11.269769+0000","last_peered":"2024-09-20T21:06:11.269769+0000","last_clean":"2024-09-20T21:06:11.269769+0000","last_became_active":"2024-09-20T21:05:45.321031+0000","last_became_peered":"2024-09-20T21:05:45.321031+0000","last_unstale":"2024-09-20T21:06:11.269769+0000","last_undegraded":"2024-09-20T21:06:11.269769+0000","last_fullsized":"2024-09-20T21:06:11.269769+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:11.269575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:11.269575+0000","last_clean_scrub_stamp":"2024-09-20T21:06:11.269575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:46.791985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:16.519128+0000","last_change":"2024-09-20T21:06:16.519226+0000","last_active":"2024-09-20T21:06:16.519128+0000","last_peered":"2024-09-20T21:06:16.519128+0000","last_clean":"2024-09-20T21:06:16.519128+0000","last_became_active":"2024-09-20T21:05:54.125123+0000","last_became_peered":"2024-09-20T21:05:54.125123+0000","last_unstale":"2024-09-20T21:06:16.519128+0000","last_undegraded":"2024-09-20T21:06:16.519128+0000","last_fullsized":"2024-09-20T21:06:16.519128+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:16.518848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:16.518848+0000","last_clean_scrub_stamp":"2024-09-20T21:06:16.518848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:50.967089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":127,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:11.493306+0000","last_change":"2024-09-20T21:06:11.493306+0000","last_active":"2024-09-20T21:06:11.493306+0000","last_peered":"2024-09-20T21:06:11.493306+0000","last_clean":"2024-09-20T21:06:11.493306+0000","last_became_active":"2024-09-20T21:05:54.121466+0000","last_became_peered":"2024-09-20T21:05:54.121466+0000","last_unstale":"2024-09-20T21:06:11.493306+0000","last_undegraded":"2024-09-20T21:06:11.493306+0000","last_fullsized":"2024-09-20T21:06:11.493306+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-20T21:06:11.493042+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-20T21:06:11.493042+0000","last_clean_scrub_stamp":"2024-09-20T21:06:11.493042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:05:01.552593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:32.380841+0000","last_change":"2024-09-20T21:06:32.380952+0000","last_active":"2024-09-20T21:06:32.380841+0000","last_peered":"2024-09-20T21:06:32.380841+0000","last_clean":"2024-09-20T21:06:32.380841+0000","last_became_active":"2024-09-20T21:05:54.129891+0000","last_became_peered":"2024-09-20T21:05:54.129891+0000","last_unstale":"2024-09-20T21:06:32.380841+0000","last_undegraded":"2024-09-20T21:06:32.380841+0000","last_fullsized":"2024-09-20T21:06:32.380841+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:32.380599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:32.380599+0000","last_clean_scrub_stamp":"2024-09-20T21:06:32.380599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:03.693171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:14.537241+0000","last_change":"2024-09-20T21:06:14.537241+0000","last_active":"2024-09-20T21:06:14.537241+0000","last_peered":"2024-09-20T21:06:14.537241+0000","last_clean":"2024-09-20T21:06:14.537241+0000","last_became_active":"2024-09-20T21:05:54.120527+0000","last_became_peered":"2024-09-20T21:05:54.120527+0000","last_unstale":"2024-09-20T21:06:14.537241+0000","last_undegraded":"2024-09-20T21:06:14.537241+0000","last_fullsized":"2024-09-20T21:06:14.537241+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-20T21:06:14.536978+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-20T21:06:14.536978+0000","last_clean_scrub_stamp":"2024-09-20T21:06:14.536978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:25:17.326966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:07.542492+0000","last_change":"2024-09-20T21:06:07.542549+0000","last_active":"2024-09-20T21:06:07.542492+0000","last_peered":"2024-09-20T21:06:07.542492+0000","last_clean":"2024-09-20T21:06:07.542492+0000","last_became_active":"2024-09-20T21:05:33.521108+0000","last_became_peered":"2024-09-20T21:05:33.521108+0000","last_unstale":"2024-09-20T21:06:07.542492+0000","last_undegraded":"2024-09-20T21:06:07.542492+0000","last_fullsized":"2024-09-20T21:06:07.542492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:07.542297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:07.542297+0000","last_clean_scrub_stamp":"2024-09-20T21:06:07.542297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:31.587837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"95'3","reported_seq":72,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:33.543255+0000","last_change":"2024-09-20T21:06:33.543414+0000","last_active":"2024-09-20T21:06:33.543255+0000","last_peered":"2024-09-20T21:06:33.543255+0000","last_clean":"2024-09-20T21:06:33.543255+0000","last_became_active":"2024-09-20T21:05:36.542244+0000","last_became_peered":"2024-09-20T21:05:36.542244+0000","last_unstale":"2024-09-20T21:06:33.543255+0000","last_undegraded":"2024-09-20T21:06:33.543255+0000","last_fullsized":"2024-09-20T21:06:33.543255+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T21:06:33.543030+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T21:06:33.543030+0000","last_clean_scrub_stamp":"2024-09-20T21:06:33.543030+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:33.166833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:11.612328+0000","last_change":"2024-09-20T21:06:11.612382+0000","last_active":"2024-09-20T21:06:11.612328+0000","last_peered":"2024-09-20T21:06:11.612328+0000","last_clean":"2024-09-20T21:06:11.612328+0000","last_became_active":"2024-09-20T21:05:33.516800+0000","last_became_peered":"2024-09-20T21:05:33.516800+0000","last_unstale":"2024-09-20T21:06:11.612328+0000","last_undegraded":"2024-09-20T21:06:11.612328+0000","last_fullsized":"2024-09-20T21:06:11.612328+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:11.612097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:11.612097+0000","last_clean_scrub_stamp":"2024-09-20T21:06:11.612097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:54.713831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"95'3","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:08.544238+0000","last_change":"2024-09-20T21:06:08.544238+0000","last_active":"2024-09-20T21:06:08.544238+0000","last_peered":"2024-09-20T21:06:08.544238+0000","last_clean":"2024-09-20T21:06:08.544238+0000","last_became_active":"2024-09-20T21:05:54.124075+0000","last_became_peered":"2024-09-20T21:05:54.124075+0000","last_unstale":"2024-09-20T21:06:08.544238+0000","last_undegraded":"2024-09-20T21:06:08.544238+0000","last_fullsized":"2024-09-20T21:06:08.544238+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T21:06:08.543852+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T21:06:08.543852+0000","last_clean_scrub_stamp":"2024-09-20T21:06:08.543852+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:20.421052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:09.551625+0000","last_change":"2024-09-20T21:06:09.551678+0000","last_active":"2024-09-20T21:06:09.551625+0000","last_peered":"2024-09-20T21:06:09.551625+0000","last_clean":"2024-09-20T21:06:09.551625+0000","last_became_active":"2024-09-20T21:05:54.121408+0000","last_became_peered":"2024-09-20T21:05:54.121408+0000","last_unstale":"2024-09-20T21:06:09.551625+0000","last_undegraded":"2024-09-20T21:06:09.551625+0000","last_fullsized":"2024-09-20T21:06:09.551625+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:09.551425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:09.551425+0000","last_clean_scrub_stamp":"2024-09-20T21:06:09.551425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:25.298665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:24.266366+0000","last_change":"2024-09-20T21:06:24.266433+0000","last_active":"2024-09-20T21:06:24.266366+0000","last_peered":"2024-09-20T21:06:24.266366+0000","last_clean":"2024-09-20T21:06:24.266366+0000","last_became_active":"2024-09-20T21:01:11.217610+0000","last_became_peered":"2024-09-20T21:01:11.217610+0000","last_unstale":"2024-09-20T21:06:24.266366+0000","last_undegraded":"2024-09-20T21:06:24.266366+0000","last_fullsized":"2024-09-20T21:06:24.266366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-20T21:06:24.266163+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-20T21:06:24.266163+0000","last_clean_scrub_stamp":"2024-09-20T21:06:24.266163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:31.277534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:03.496977+0000","last_change":"2024-09-20T21:06:03.497031+0000","last_active":"2024-09-20T21:06:03.496977+0000","last_peered":"2024-09-20T21:06:03.496977+0000","last_clean":"2024-09-20T21:06:03.496977+0000","last_became_active":"2024-09-20T21:05:33.528009+0000","last_became_peered":"2024-09-20T21:05:33.528009+0000","last_unstale":"2024-09-20T21:06:03.496977+0000","last_undegraded":"2024-09-20T21:06:03.496977+0000","last_fullsized":"2024-09-20T21:06:03.496977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T21:06:03.496798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T21:06:03.496798+0000","last_clean_scrub_stamp":"2024-09-20T21:06:03.496798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:49.946589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"95'6","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T21:06:15.188822+0000","last_change":"2024-09-20T21:06:15.188888+0000","last_active":"2024-09-20T21:06:15.188822+0000","last_peered":"2024-09-20T21:06:15.188822+0000","last_clean":"2024-09-20T21:06:15.188822+0000","last_became_active":"2024-09-20T21:05:45.321268+0000","last_became_peered":"2024-09-20T21:05:45.321268+0000","last_unstale":"2024-09-20T21:06:15.188822+0000","last_undegraded":"2024-09-20T21:06:15.188822+0000","last_fullsized":"2024-09-20T21:06:15.188822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'6","last_scrub_stamp":"2024-09-20T21:06:15.188637+0000","last_deep_scrub":"95'6","last_deep_scrub_stamp":"2024-09-20T21:06:15.188637+0000","last_clean_scrub_stamp":"2024-09-20T21:06:15.188637+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:48:23.961965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22368,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738441,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216924,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94154916,"statfs":{"total":96636764160,"available":96414633984,"internally_reserved":0,"allocated":1126400,"data_stored":1004346,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":220985796},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":81,"seq":347892350992,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54632,"kb_used_data":1112,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94317208,"statfs":{"total":96636764160,"available":96580820992,"internally_reserved":0,"allocated":1138688,"data_stored":1004981,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":7142,"internal_metadata":54780954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325140,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046700,"statfs":{"total":96636764160,"available":96303820800,"internally_reserved":0,"allocated":1052672,"data_stored":412819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":331872708},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11184,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T21:06:43.536 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-20T21:06:43.897 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-20T21:06:43.897 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T21:06:44.219 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:06:44.219 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"btime":"2024-09-20T21:01:14:206337+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T21:01:11.549887+0000","modified":"2024-09-20T21:01:13.564207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.112:6803/1727517517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1727517517},{"type":"v1","addr":"172.21.15.112:6803","nonce":1727517517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-20T21:06:44.220 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 5 2024-09-20T21:06:44.237 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T21:06:44.560 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:06:44.560 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"btime":"2024-09-20T21:01:14:206337+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T21:01:11.549887+0000","modified":"2024-09-20T21:01:13.564207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.112:6803/1727517517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1727517517},{"type":"v1","addr":"172.21.15.112:6803","nonce":1727517517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-20T21:06:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 5 2024-09-20T21:06:44.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T21:06:44.856 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-20T21:06:44.856 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":95,"fsid":"095c2509-1828-40cb-9515-44c079c52d3b","created":"2024-09-20T21:00:50.259405+0000","modified":"2024-09-20T21:05:56.110600+0000","last_up_change":"2024-09-20T21:05:33.199849+0000","last_in_change":"2024-09-20T21:00:51.161270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T21:01:00.930905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T21:01:05.455429+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T21:01:10.047761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T21:01:10.524533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238496db-6b3e-463e-90eb-e476e93f06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6801","nonce":2576994201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6803","nonce":2576994201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6807","nonce":2576994201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2576994201},{"type":"v1","addr":"172.21.15.139:6805","nonce":2576994201}]},"public_addr":"172.21.15.139:6801/2576994201","cluster_addr":"172.21.15.139:6803/2576994201","heartbeat_back_addr":"172.21.15.139:6807/2576994201","heartbeat_front_addr":"172.21.15.139:6805/2576994201","state":["exists","up"]},{"osd":1,"uuid":"5e46dfeb-5456-40e0-b0a3-d85993becaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":47,"up_from":81,"up_thru":94,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6801","nonce":1262267524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6803","nonce":1262267524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6807","nonce":1262267524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1262267524},{"type":"v1","addr":"172.21.15.161:6805","nonce":1262267524}]},"public_addr":"172.21.15.161:6801/1262267524","cluster_addr":"172.21.15.161:6803/1262267524","heartbeat_back_addr":"172.21.15.161:6807/1262267524","heartbeat_front_addr":"172.21.15.161:6805/1262267524","state":["exists","up"]},{"osd":2,"uuid":"f5e294ac-6f79-4615-93d7-8870379d28e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6801","nonce":1237842363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6803","nonce":1237842363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6807","nonce":1237842363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1237842363},{"type":"v1","addr":"172.21.15.203:6805","nonce":1237842363}]},"public_addr":"172.21.15.203:6801/1237842363","cluster_addr":"172.21.15.203:6803/1237842363","heartbeat_back_addr":"172.21.15.203:6807/1237842363","heartbeat_front_addr":"172.21.15.203:6805/1237842363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.078073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.075785+0000","dead_epoch":47},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T21:00:57.190829+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T21:06:44.874 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-20T21:06:45.199 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-20T21:06:45.200 INFO:tasks.ceph.mds.a.smithi112.stderr: -2153> 2024-09-20T21:01:14.158+0000 7f3336f57640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-20T21:06:45.217 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-20T21:06:45.237 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-20T21:06:46.227 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-20T21:06:47.382 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-20T21:06:47.405 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-20T21:06:48.386 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-20T21:06:48.410 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-20T21:06:48.411 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-20T21:06:48.411 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T21:06:48.422 INFO:tasks.ceph.mds.a:Stopped 2024-09-20T21:06:48.422 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-20T21:06:48.422 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-20T21:06:48.422 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T21:06:48.521 INFO:tasks.ceph.osd.0:Stopped 2024-09-20T21:06:48.521 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-20T21:06:48.522 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T21:06:48.609 INFO:tasks.ceph.osd.1:Stopped 2024-09-20T21:06:48.610 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-20T21:06:48.610 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T21:06:50.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-20T21:06:54.711 INFO:tasks.ceph.osd.2:Stopped 2024-09-20T21:06:54.712 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-20T21:06:54.712 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-20T21:06:54.712 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T21:06:54.742 INFO:tasks.ceph.mgr.x:Stopped 2024-09-20T21:06:54.742 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-20T21:06:54.742 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T21:06:54.816 INFO:tasks.ceph.mgr.y:Stopped 2024-09-20T21:06:54.817 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-20T21:06:54.817 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-20T21:06:54.817 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T21:06:54.870 INFO:tasks.ceph.mon.a:Stopped 2024-09-20T21:06:54.871 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-20T21:06:54.871 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T21:06:54.936 INFO:tasks.ceph.mon.b:Stopped 2024-09-20T21:06:54.936 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-20T21:06:54.936 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T21:06:54.992 INFO:tasks.ceph.mon.c:Stopped 2024-09-20T21:06:54.992 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-20T21:06:54.993 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-20T21:06:55.052 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-20T21:06:55.053 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-20T21:06:55.193 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi161.front.sepia.ceph.com 2024-09-20T21:06:55.193 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-20T21:06:55.319 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-20T21:06:55.319 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-20T21:06:55.454 INFO:tasks.ceph:Archiving mon data... 2024-09-20T21:06:55.455 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/data/mon.a.tgz 2024-09-20T21:06:55.455 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-20T21:06:55.461 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.yHoGS2f8eV 2024-09-20T21:06:55.461 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yHoGS2f8eV 2024-09-20T21:06:55.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.yHoGS2f8eV 2024-09-20T21:06:55.666 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.yHoGS2f8eV is 407KB 2024-09-20T21:06:55.728 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.yHoGS2f8eV 2024-09-20T21:06:55.734 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/data/mon.b.tgz 2024-09-20T21:06:55.734 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-20T21:06:55.782 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.oz68DanTeG 2024-09-20T21:06:55.782 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.oz68DanTeG 2024-09-20T21:06:55.960 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.oz68DanTeG 2024-09-20T21:06:55.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-20T21:06:56.022 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.oz68DanTeG is 561KB 2024-09-20T21:06:56.084 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.oz68DanTeG 2024-09-20T21:06:56.089 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/data/mon.c.tgz 2024-09-20T21:06:56.089 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-20T21:06:56.135 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.jioMMVHiJx 2024-09-20T21:06:56.135 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.jioMMVHiJx 2024-09-20T21:06:56.313 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.jioMMVHiJx 2024-09-20T21:06:56.373 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.jioMMVHiJx is 561KB 2024-09-20T21:06:56.440 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.jioMMVHiJx 2024-09-20T21:06:56.446 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-20T21:06:56.446 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-20T21:06:56.491 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-20T21:06:56.494 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-20T21:06:56.497 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-20T21:06:56.662 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-20T21:06:56.668 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-20T21:06:56.679 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-20T21:06:56.685 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-20T21:06:56.685 INFO:tasks.ceph:Archiving crash dumps... 2024-09-20T21:06:56.686 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi112/crash 2024-09-20T21:06:56.687 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-20T21:06:56.719 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi139/crash 2024-09-20T21:06:56.720 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-20T21:06:56.734 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi161/crash 2024-09-20T21:06:56.734 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-20T21:06:56.767 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi203/crash 2024-09-20T21:06:56.768 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-20T21:06:56.782 INFO:tasks.ceph:Compressing logs... 2024-09-20T21:06:56.782 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T21:06:56.785 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T21:06:56.787 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T21:06:56.811 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25607.log 2024-09-20T21:06:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22621.log 2024-09-20T21:06:56.813 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26912.log 2024-09-20T21:06:56.813 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25607.log.gz 2024-09-20T21:06:56.813 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27022.log 2024-09-20T21:06:56.813 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22621.log.gz 2024-09-20T21:06:56.813 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26912.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.26912.log.gz --verbose 2024-09-20T21:06:56.813 INFO:teuthology.orchestra.run.smithi112.stderr: -- /var/log/ceph/ceph-client.admin.24921.log 2024-09-20T21:06:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26831.log 2024-09-20T21:06:56.815 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27022.log.gz 2024-09-20T21:06:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25191.log 2024-09-20T21:06:56.815 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24921.log.gz 2024-09-20T21:06:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25501.log 2024-09-20T21:06:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26831.log.gz 2024-09-20T21:06:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23275.log 2024-09-20T21:06:56.815 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25191.log.gz 2024-09-20T21:06:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22807.log 2024-09-20T21:06:56.820 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25501.log.gz 2024-09-20T21:06:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23275.log: 48.2% -- replaced with /var/log/ceph/ceph-client.admin.23275.log.gz 2024-09-20T21:06:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28117.log 2024-09-20T21:06:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22807.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-20T21:06:56.820 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22807.log.gz 2024-09-20T21:06:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25578.log 2024-09-20T21:06:56.820 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28117.log.gz 2024-09-20T21:06:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27100.log 2024-09-20T21:06:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25086.log 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25578.log.gz 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26637.log 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27100.log.gz 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25086.log.gz 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22729.log 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22569.log 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26637.log.gz 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22729.log.gz 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25082.log 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25413.log 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22569.log.gz 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26421.log 2024-09-20T21:06:56.821 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25082.log.gz 2024-09-20T21:06:56.822 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T21:06:56.839 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-20T21:06:56.839 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746.log 2024-09-20T21:06:56.839 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746.log.gz 2024-09-20T21:06:56.857 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26310.log 2024-09-20T21:06:56.857 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25413.log.gz 2024-09-20T21:06:56.857 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26421.log.gz 2024-09-20T21:06:56.857 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26747.log 2024-09-20T21:06:56.857 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27807.log 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26310.log.gz 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22135.log 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26747.log.gz 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23472.log 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27807.log.gz 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22135.log.gz 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28195.log 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27729.log 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23472.log.gz 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.28195.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23900.log 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28195.log.gz 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27729.log.gz 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28015.log 2024-09-20T21:06:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23900.log: 93.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23223.log 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23900.log.gz 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26284.log 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28015.log.gz 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26148.log 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23223.log.gz 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28292.log 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26284.log.gz 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26148.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.24600.log -- replaced with /var/log/ceph/ceph-client.admin.26148.log.gz 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24739.log 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28292.log.gz 2024-09-20T21:06:56.859 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24206.log 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24600.log.gz 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22833.log 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24739.log.gz 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23093.log 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24206.log.gz 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22383.log 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22833.log.gz 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26038.log 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23093.log.gz 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27781.log 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22383.log.gz 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27287.log 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26038.log.gz 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23694.log 2024-09-20T21:06:56.860 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27781.log.gz 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27287.log.gz 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28266.log 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22358.log 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23694.log.gz 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27521.log 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28266.log.gz 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22358.log.gz 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28169.log 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28067.log 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27521.log.gz 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27451.log 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28169.log.gz 2024-09-20T21:06:56.861 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28067.log.gz 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25985.log 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28221.log 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27451.log.gz 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27178.log 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25985.log.gz 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28143.log 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28221.log.gz 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25248.log 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27178.log.gz 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25160.log 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28143.log.gz 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25248.log.gz 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24543.log 2024-09-20T21:06:56.862 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22677.log 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25160.log.gz 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25497.log 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24543.log: /var/log/ceph/ceph-client.admin.22677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24543.log.gz 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23249.log 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22677.log.gz 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.25497.log: /var/log/ceph/ceph-client.admin.24568.log 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25497.log.gz 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23249.log.gz 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27989.log 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.24568.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24124.log 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24568.log.gz 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23808.log 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27989.log.gz 2024-09-20T21:06:56.863 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24124.log.gz 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24242.log 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23808.log.gz 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22158.log 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24242.log.gz 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23197.log 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26802.log 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22158.log.gz 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25662.log 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23197.log.gz 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25906.log 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26802.log.gz 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23019.log 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25662.log.gz 2024-09-20T21:06:56.864 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27833.log 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25906.log.gz 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22703.log 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23019.log.gz 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23640.log 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27833.log.gz 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22703.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.22703.log.gz /var/log/ceph/ceph-client.admin.26198.log 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23632.log 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23640.log.gz 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26334.log 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26198.log.gz 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.23632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27859.log 2024-09-20T21:06:56.865 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.23632.log.gz 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23119.log 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26334.log.gz 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23948.log 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27859.log.gz 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23119.log.gz 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28091.log 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.23948.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22865.log 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23948.log.gz 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.28091.log: /var/log/ceph/ceph-client.admin.27911.log 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28091.log.gz 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22865.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22865.log.gz -5 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.25442.log 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24040.log 2024-09-20T21:06:56.866 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27911.log.gz 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.25442.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26502.log 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25442.log.gz 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24040.log.gz 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28041.log 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23603.log 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26502.log.gz 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.28041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27313.log 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28041.log.gz 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23603.log.gz 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22278.log 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24631.log 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27313.log.gz 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23473.log 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22278.log.gz 2024-09-20T21:06:56.867 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24631.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24631.log.gz -5 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.24657.log 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27074.log 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23473.log.gz 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23171.log 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24657.log.gz 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27074.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.27074.log.gz -5 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.27365.log 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26119.log 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23171.log.gz 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25133.log 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27365.log.gz 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26119.log.gz 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27529.log 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23326.log 2024-09-20T21:06:56.868 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25133.log.gz 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24409.log 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27529.log.gz 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25772.log 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23326.log.gz 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24916.log 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24409.log.gz 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24802.log 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25772.log.gz 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24916.log.gz 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23777.log 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22867.log 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24802.log.gz 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23729.log/var/log/ceph/ceph-client.admin.23777.log: 2024-09-20T21:06:56.869 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23777.log.gz 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22867.log.gz 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27126.log 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24036.log/var/log/ceph/ceph-client.admin.23729.log: 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23729.log.gz 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26553.log 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27126.log.gz 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24036.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.24036.log.gz -- 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr: /var/log/ceph/ceph-client.admin.27235.log 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25746.log 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26553.log.gz 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27526.log 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27235.log.gz 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25746.log.gz 2024-09-20T21:06:56.870 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27152.log 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.27526.log: -- /var/log/ceph/ceph-client.admin.24465.log 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27526.log.gz 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.27152.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25467.log 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27152.log.gz 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24465.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.24465.log.gz -5 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22755.log 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26692.log 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25467.log.gz 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.22755.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23832.log 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22755.log.gz 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26692.log.gz 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27599.log 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27608.log 2024-09-20T21:06:56.871 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23832.log.gz 2024-09-20T21:06:56.872 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24434.log 2024-09-20T21:06:56.872 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27599.log.gz 2024-09-20T21:06:56.872 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27608.log.gz 2024-09-20T21:06:56.872 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26174.log 2024-09-20T21:06:56.897 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-20T21:06:56.902 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24771.log 2024-09-20T21:06:56.902 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24434.log.gz 2024-09-20T21:06:56.902 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23023.log 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26174.log.gz 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24771.log.gz 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24885.log 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23023.log.gz 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26776.log 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.24885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26721.log 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24885.log.gz 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26258.log 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26776.log.gz 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26721.log.gz 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-20T21:06:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24321.log 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26258.log.gz 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25358.log 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24321.log.gz 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23475.log 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24518.log 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25358.log.gz 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24238.log 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23475.log.gz 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24518.log.gz 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25272.log 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23899.log 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24238.log.gz 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26420.log 2024-09-20T21:06:56.904 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25272.log.gz 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr: 94.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23899.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.23899.log.gz 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22945.log 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27755.log 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26420.log.gz 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22945.log.gz 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24661.log 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24828.log 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27755.log.gz 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24661.log.gz 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25303.log 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24828.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21740.log 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24828.log.gz 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25303.log.gz 2024-09-20T21:06:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22595.log 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.tmp-client.admin.21740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26064.log 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21740.log.gz 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22595.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22595.log.gz -5 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22937.log 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23979.log 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26064.log.gz 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22937.log.gz 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26467.log 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23352.log 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23979.log.gz 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26467.log.gz 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23865.log 2024-09-20T21:06:56.906 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23352.log.gz 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24492.log 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23865.log.gz 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26885.log 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25937.log 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24492.log.gz 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26885.log.gz 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27339.log 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26229.log 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25937.log.gz 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27339.log.gz 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26996.log 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25025.log 2024-09-20T21:06:56.907 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26229.log.gz 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25217.log 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26996.log.gz 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22452.log 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25025.log.gz 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26009.log 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25217.log.gz 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24294.log 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22452.log.gz 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26009.log.gz 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25961.log 2024-09-20T21:06:56.908 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27417.log 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24294.log.gz 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25961.log.gz 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26093.log 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27204.log 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27417.log.gz 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22333.log 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26093.log.gz 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25827.log 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27204.log.gz 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22333.log.gz 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24999.log 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25551.log 2024-09-20T21:06:56.909 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25827.log.gz 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24999.log.gz 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24714.log 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25551.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25551.log.gz 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24714.log.gz 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26501.log 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26501.log.gz 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24150.log 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27391.log 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.24150.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24150.log.gz 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.26856.log 2024-09-20T21:06:56.910 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27391.log.gz 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27448.log 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26856.log.gz 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24378.log 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24004.log 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27448.log.gz 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24965.log 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24378.log.gz 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27447.log 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24004.log: /var/log/ceph/ceph-client.admin.24965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24004.log.gz 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24965.log.gz 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23477.log 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27447.log.gz 2024-09-20T21:06:56.911 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22866.log 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26938.log 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23477.log.gz 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25387.log 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22866.log.gz 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26938.log.gz 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24181.log 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27048.log 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25387.log.gz 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26582.log 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24181.log.gz 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27048.log.gz 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23015.log 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22781.log 2024-09-20T21:06:56.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26582.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26582.log.gz 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22534.log 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23015.log.gz 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22781.log.gz 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22478.log 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27603.log 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22534.log.gz 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22478.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.22478.log.gz 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22651.log 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27603.log.gz 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26391.log 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23434.log 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22651.log.gz 2024-09-20T21:06:56.913 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26391.log.gz 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24093.log 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.23434.log: /var/log/ceph/ceph-client.admin.24859.log 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23434.log.gz 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22506.log 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24093.log.gz 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27937.log 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24859.log.gz 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22506.log.gz 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25332.log 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21941.log 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27937.log.gz 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26970.log 2024-09-20T21:06:56.914 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25332.log.gz 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.21941.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21941.log.gz 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26608.log 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26970.log.gz 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27963.log 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25717.log 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26608.log.gz 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23725.log 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27963.log.gz 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23378.log 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25717.log.gz 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23404.log 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23725.log.gz 2024-09-20T21:06:56.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26340.log 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23378.log.gz 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27677.log 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23404.log.gz 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27703.log 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26340.log.gz 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23577.log 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27677.log.gz 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22944.log 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27703.log.gz 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25853.log 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23577.log.gz 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23145.log 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22944.log.gz 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25050.log 2024-09-20T21:06:56.916 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25853.log.gz 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26662.log 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23145.log.gz 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24352.log 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25050.log.gz 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25801.log 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26662.log.gz 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25633.log 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24352.log.gz 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25687.log 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25801.log.gz 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27885.log 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25633.log.gz 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27261.log 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25687.log.gz 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25882.log 2024-09-20T21:06:56.917 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27885.log.gz 2024-09-20T21:06:56.918 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22406.log 2024-09-20T21:06:56.918 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27261.log.gz 2024-09-20T21:06:56.918 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25882.log.gz 2024-09-20T21:06:56.918 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22406.log.gz 2024-09-20T21:06:56.930 INFO:teuthology.orchestra.run.smithi112.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-20T21:06:56.944 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-20T21:06:56.945 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22894.log 2024-09-20T21:06:56.945 INFO:teuthology.orchestra.run.smithi203.stderr:gzip/var/log/ceph/ceph-osd.2.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22942.log 2024-09-20T21:06:56.946 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.22894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22894.log.gz 2024-09-20T21:06:56.946 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22918.log 2024-09-20T21:06:56.947 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.22942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22942.log.gz 2024-09-20T21:06:56.948 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.22918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22918.log.gz 2024-09-20T21:06:57.000 INFO:teuthology.orchestra.run.smithi112.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-20T21:06:57.002 INFO:teuthology.orchestra.run.smithi112.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-20T21:06:57.110 INFO:teuthology.orchestra.run.smithi112.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-20T21:06:57.111 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-20T21:06:57.111 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m0.324s 2024-09-20T21:06:57.111 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m0.770s 2024-09-20T21:06:57.112 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m0.076s 2024-09-20T21:07:03.160 INFO:teuthology.orchestra.run.smithi161.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-20T21:07:03.161 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-09-20T21:07:03.161 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m6.342s 2024-09-20T21:07:03.161 INFO:teuthology.orchestra.run.smithi161.stderr:user 0m5.810s 2024-09-20T21:07:03.161 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m0.282s 2024-09-20T21:07:25.082 INFO:teuthology.orchestra.run.smithi203.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-20T21:07:25.084 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-20T21:07:25.084 INFO:teuthology.orchestra.run.smithi203.stderr:real 0m28.251s 2024-09-20T21:07:25.084 INFO:teuthology.orchestra.run.smithi203.stderr:user 0m27.152s 2024-09-20T21:07:25.084 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m1.011s 2024-09-20T21:07:34.252 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-osd.0.log: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-20T21:07:34.254 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-09-20T21:07:34.254 INFO:teuthology.orchestra.run.smithi139.stderr:real 0m37.465s 2024-09-20T21:07:34.254 INFO:teuthology.orchestra.run.smithi139.stderr:user 0m36.084s 2024-09-20T21:07:34.254 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m1.290s 2024-09-20T21:07:34.255 INFO:tasks.ceph:Archiving logs... 2024-09-20T21:07:34.255 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi112/log 2024-09-20T21:07:34.256 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T21:07:34.514 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi139/log 2024-09-20T21:07:34.515 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T21:07:39.324 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi161/log 2024-09-20T21:07:39.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T21:07:40.037 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi203/log 2024-09-20T21:07:40.038 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T21:07:43.563 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-20T21:07:43.573 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-20T21:07:43.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T21:07:43.576 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T21:07:43.578 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T21:07:43.580 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T21:07:43.698 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-20T21:07:43.716 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-20T21:07:43.716 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T21:07:43.719 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T21:07:43.721 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T21:07:43.723 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T21:07:43.730 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T21:07:43.730 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-20T21:07:43.730 INFO:teuthology.orchestra.run.smithi112.stdout:*hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.065 -1.893 1.307 2024-09-20T21:07:43.730 INFO:teuthology.orchestra.run.smithi112.stdout:+hv02.front.sepi 63.231.80.2 3 u 29 64 377 0.072 -0.394 2.122 2024-09-20T21:07:43.730 INFO:teuthology.orchestra.run.smithi112.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 377 0.077 -3.341 2.465 2024-09-20T21:07:43.731 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T21:07:43.732 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T21:07:43.732 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2024-09-20T21:07:43.732 INFO:teuthology.orchestra.run.smithi139.stdout:+hv01.front.sepi 67.205.162.81 3 u 28 64 377 0.073 -0.838 0.764 2024-09-20T21:07:43.732 INFO:teuthology.orchestra.run.smithi139.stdout:*hv02.front.sepi 63.231.80.2 3 u 30 64 377 0.090 -2.146 1.235 2024-09-20T21:07:43.732 INFO:teuthology.orchestra.run.smithi139.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 64 377 0.069 -0.314 0.508 2024-09-20T21:07:43.732 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T21:07:43.736 INFO:teuthology.orchestra.run.smithi203.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T21:07:43.736 INFO:teuthology.orchestra.run.smithi203.stdout:============================================================================== 2024-09-20T21:07:43.736 INFO:teuthology.orchestra.run.smithi203.stdout:+hv01.front.sepi 67.205.162.81 3 u 18 64 377 0.075 -1.345 1.532 2024-09-20T21:07:43.736 INFO:teuthology.orchestra.run.smithi203.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 377 0.082 -1.331 1.397 2024-09-20T21:07:43.736 INFO:teuthology.orchestra.run.smithi203.stdout:*hv03.front.sepi 74.6.168.72 3 u 28 64 377 0.065 -1.486 1.173 2024-09-20T21:07:43.736 INFO:teuthology.orchestra.run.smithi203.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T21:07:43.744 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T21:07:43.744 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-09-20T21:07:43.744 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi 67.205.162.81 3 u 17 64 7 0.083 +726.41 1.255 2024-09-20T21:07:43.744 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi 63.231.80.2 3 u 19 64 7 0.129 +726.72 1.244 2024-09-20T21:07:43.744 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi 74.6.168.72 3 u 15 64 7 0.092 +727.24 1.318 2024-09-20T21:07:43.744 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T21:07:43.745 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-20T21:07:43.785 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-20T21:07:43.786 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-20T21:07:43.861 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-20T21:07:43.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-20T21:07:43.999 INFO:teuthology.task.internal:Duration was 1014.856867 seconds 2024-09-20T21:07:44.000 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-20T21:07:44.093 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-20T21:07:44.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T21:07:44.096 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T21:07:44.098 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T21:07:44.101 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T21:07:44.201 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-20T21:07:44.201 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-20T21:07:44.201 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T21:07:44.212 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-09-20T21:07:44.212 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T21:07:44.222 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-09-20T21:07:44.223 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T21:07:44.233 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-09-20T21:07:44.233 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T21:07:44.243 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-20T21:07:44.243 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T21:07:44.258 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T21:07:44.268 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T21:07:44.279 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T21:07:44.362 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-20T21:07:44.362 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T21:07:44.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T21:07:44.367 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T21:07:44.369 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T21:07:44.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-20T21:07:44.471 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-20T21:07:44.471 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T21:07:44.484 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T21:07:44.496 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T21:07:44.510 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T21:07:44.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-20T21:07:44.535 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T21:07:44.538 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T21:07:44.540 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T21:07:44.547 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-20T21:07:44.549 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-09-20T21:07:44.555 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T21:07:44.576 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-09-20T21:07:44.579 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-09-20T21:07:44.663 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T21:07:44.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T21:07:44.668 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T21:07:44.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T21:07:44.673 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T21:07:44.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T21:07:44.678 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T21:07:44.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T21:07:44.709 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-20T21:07:44.721 INFO:teuthology.task.internal:Transferring archived files... 2024-09-20T21:07:44.722 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi112 2024-09-20T21:07:44.722 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T21:07:44.743 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi139 2024-09-20T21:07:44.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T21:07:44.764 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi161 2024-09-20T21:07:44.764 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T21:07:44.784 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912591/remote/smithi203 2024-09-20T21:07:44.784 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T21:07:44.805 INFO:teuthology.task.internal:Removing archive directory... 2024-09-20T21:07:44.805 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T21:07:44.808 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T21:07:44.810 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T21:07:44.827 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T21:07:44.853 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-20T21:07:44.865 INFO:teuthology.task.internal:Not uploading archives. 2024-09-20T21:07:44.865 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-20T21:07:44.918 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-20T21:07:44.918 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T21:07:44.921 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T21:07:44.923 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T21:07:44.924 INFO:teuthology.orchestra.run.smithi112.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 20 21:07 /home/ubuntu/cephtest 2024-09-20T21:07:44.925 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T21:07:44.927 INFO:teuthology.orchestra.run.smithi139.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 20 21:07 /home/ubuntu/cephtest 2024-09-20T21:07:44.929 INFO:teuthology.orchestra.run.smithi161.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 20 21:07 /home/ubuntu/cephtest 2024-09-20T21:07:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: 658626 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 20 21:07 /home/ubuntu/cephtest 2024-09-20T21:07:44.933 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-20T21:07:44.972 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-20T21:07:45.111 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health} duration: 1014.856867313385 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-20T21:07:45.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T21:07:45.202 INFO:teuthology.run:pass